LAV Filters - DirectShow Media Splitter and Decoders

[mzso]

Hi!
Is there a practical solution to correcting sped up PAL video during playback?

[clsid]

MPC-HC menu > Play > playback Rate > 24fps

Additionally enable the internal audio renderer if you want automatic audio pitch correction.

[chros]

I have an audio splitter question: there's this option "Prefer audio stream with highest quality".
The problem is (let's say the file has 2 audio track: DD ger [default], DTS-HDMA eng) if there's an audio track with default track, then that one will be used (DD ger tack).
So, is there any rules I can use for audio with which I can force to select the highest quality in this case as well (without specifying the language)?
Thanks

[VictorLS]

Originally Posted by jmone

- Original Sample is here : https://behome.dyndns.info/index.php/s/4rYP8bqs4yaRd5p

Thanks - this 17 second video in this sample (btw its size 1,02 GB+0,03 GB 8 PCM audio and 4 others tracks) is h264 4:2:2 10bit (510 Mbis/s 50fps HLG) so I guess it will not be accelerated by any PC videocard in a future.

Originally Posted by jmone

- I tried all the LAV Decoding Option including CUVID

Despite you haven't upload screenshot of DXVA Checker 4.5.1 of your 3090 (and your recoded with some software (?) sample) I asked in my previous post try recoded your FX6 Sample.MXF in HEVC 4:4:4 FX6_Sample.mp4 (2,1 MB - so about 500 time smaller than original) https://yadi.sk/i/BqcTHKuM9dYM2g with CUVID and others. Despite it isn't loseless it'll may be hadware accelerated.

Originally Posted by jmone

- I tried using the MPC Video Renderer but could not successfully build a graph in JRiver Media Center (which I use) so I can't comment

OK - I use MPC-HC for MPC-VR (some days ago SAT receiving program SmartDVB supports MPC-VR well too).

Originally Posted by jmone

requiring a ffmpeg remux (at least that is pretty fast)

What command-line do you use for remux to get output with one (or several) audio track(s)?

PS. Did you try other than LAV Video Decoder like MainConcept (Demo) AVC/H.264 Video Decoder with turned off hardware acceleration in first string of its settings? I.e. my weak Athlon II x3 360 can't decode all 25 fps with LAV Video Decoder of this 20171205-014323_4KUA.ts (73 MB) https://yadi.sk/d/AnnpTSYKkoNkUg sample recorded by me from SAT but with MainConcept (Demo) HEVC Video Decoder despite of about 95% load of each of three core.
PPS. While Turing can HW decode in the centre of article https://developer.nvidia.com/blog/nv...ture-in-depth/ HEVC YUV444 10/12b HDR at 30 fps, H.264 8K, and VP9 10/12b HDR, I've uploaded FX6_Sample_25fps.mp4 (1,9 MB) https://yadi.sk/i/61fKGLxWBoUIyA if Ampere still the same as Turing in HEVC 4:4:4 and can't hardware decode 50-60fps at all.

[nevcairiel]

Originally Posted by chros

I have an audio splitter question: there's this option "Prefer audio stream with highest quality".
The problem is (let's say the file has 2 audio track: DD ger [default], DTS-HDMA eng) if there's an audio track with default track, then that one will be used (DD ger tack).
So, is there any rules I can use for audio with which I can force to select the highest quality in this case as well (without specifying the language)?
Thanks

No, "default" always overrides the selection, as the matroska specification mandates.

The option you named only influences ordering in absence of such a factor, ie. it would always use the first then if its turned off.

[LigH]

So it may be suitable to edit Matroska header flags to achieve your desired default stream selection for this specific file.

[Yups]

Originally Posted by GTPVHD

Yups, Intel released 9079 driver but I'm guessing AV1 bug won't be fixed until next year earliest.

They have fixed DXVA2 AV1 in 9168. However, D3D11 runs faster, this is the preferred mode for Tigerlake.

[chros]

Originally Posted by nevcairiel

No, "default" always overrides the selection, as the matroska specification mandates.

The option you named only influences ordering in absence of such a factor, ie. it would always use the first then if its turned off.

Thanks, I forgot about default flag overrides everything, even the language selector in LAV splitter.

Originally Posted by LigH

So it may be suitable to edit Matroska header flags to achieve your desired default stream selection for this specific file.

Yes, cheers, or I can use the language selector in the player (MPC-HC/BE).

[jmone]

@VictorLS,

Yes the files from the FX6 are large as they are not only 10-Bit, 4:2:2, UHD, 50fps, with HLG, but are all I frame AVC. Great for editing.

Here is a screen shot of DXVA Checker (is that what you want?). - https://behome.dyndns.info/index.php/s/9Q2n7XFRH6Qb3HR

I've tried (common) combinations of HEVC vs AVC / 10-Bit vs 8-Bit / 4:4:4 vs 4:2:2 vs 4:2:0 with the different LAV decoding options coupled with madVR with HDR. Apart from 4:2:0 the rest don't kick in HW Acceleration (including your sample). The "closest" alternative if I want to keep higher chroma sub-sampling and have HDR, is to encode in the same AVC-I (or Long GOP) 10bit 4:2:2 profile but converting the HLG to PQ. This will use SW Decoding, with madVR then doing the HDR processing and it will play just fine on my i7-9900K / RX3090 but my HTPC use older i5's and the SW decoding maxes these boxs out. Anyway, here is the PQ version of the sample file. https://behome.dyndns.info/index.php/s/Sfp8XJESWB8xfdB

Here is what I'm using to mux the fist two Mono Audio channels in the MXF container to MXV with the Video untouched.
ffmpeg -i input.mxf -map 0:0 -c:v copy -filter_complex "[0:1][0:2] amerge=inputs=2" -c:a pcm_s16le output.mkv

[jmone]

So back to where this started. Am I correct in saying:
- nvidia Turning and Ampere cards support decode/encode of HEVC 10-Bit 4:4:4,
- I can see apps like Resolve use it,
- but..... as the HEVC 10-Bit 4:4:4 profile is not enumerated by DXVA2 or D3D11, LAV can not use it?
Thanks
Nathan

[VictorLS]

Originally Posted by jmone

Yes the files from the FX6 are large as they are not only 10-Bit, 4:2:2, UHD, 50fps, with HLG, but are all I frame AVC. Great for editing.

I agree.

Originally Posted by jmone

Here is a screen shot of DXVA Checker (is that what you want?)...the HEVC 10-Bit 4:4:4 profile is not enumerated by DXVA2 or D3D11

Yes - great screenshot where clearly nVIDIA can't hardware decode h265 4:4:4 through DXVA2/D3D11 at all - you're right. So just CUVID and (may be) some next step of nVIDIA's CUVID (can work with 12-bit - old can natively just 8-bit as nevcairiel) can (I don't saing about newest Intel products now).

Originally Posted by jmone

I've tried (common) combinations of HEVC vs AVC / 10-Bit vs 8-Bit / 4:4:4 vs 4:2:2 vs 4:2:0 with the different LAV decoding options coupled with madVR with HDR...Apart from 4:2:0 the rest don't kick in HW Acceleration (including your sample)

Thanks. But for sure I'd propose you to begin from simple MPC-HC(MPC-BE can do HLGtoSDR processing with i.e. EVR-CP or MPC-VR) beginning with ordinary EVR to see hardware acceleration.
Other way is to use consistently
ffmpeg -benchmark -i FX6_Sample_25fps.mp4 -f null out.null
to get like

in comparison with
ffmpeg -benchmark -hwaccel cuda -i FX6_Sample_25fps.mp4 -f null out.null
to get like

if hardware acceleration is working
Btw I've tested and took above screenshots on 4K h265 4:2:0 10-bit HLG 20190526-164153_RTL UHD.ts from https://forum.doom9.org/showthread.p...34#post1919134 - I guess it's good start point for your hardware acceleration testing.

Originally Posted by jmone

Anyway, here is the PQ version of the sample file.

Looks pretty well on my own but size in MB is still amazing...

Originally Posted by jmone

Here is what I'm using to mux the fist two Mono Audio channels in the MXF container to MXV with the Video untouched.
ffmpeg -i input.mxf -map 0:0 -c:v copy -filter_complex "[0:1][0:2] amerge=inputs=2" -c:a pcm_s16le output.mkv

Thanks.

Originally Posted by jmone

I can see apps like Resolve use it

Screenshot?

[jmone]

Here are the screenshots of HEVC 10-Bit 4:4:4 HW Acceleration working with Davinci Resolve for both playback (decoding) and rendering (encoding) of that test clip. It is really fast and works well, even the encoding is about Real Time, and it does not seem to break a sweat with decoding for playback.
Decoding: https://behome.dyndns.info/index.php/s/SknLnYqsgT8eSeN
Encoding: https://behome.dyndns.info/index.php/s/Cj4SWWdsx4YBcwe

So my preference would be for my "best quality" rendering:
- Nev (somehow) enables HEVC 4:4:4 HW Decoding = Good Chroma, Small(ish) File Size & does playback on modern CPU/GPU's combos

else... either of
- HEVC 4:2:0 PQ = Small(ish) File Size, plays back on existing GPU / CPU but has weird Chroma noise in some scenes
- AVC 4:2:2 PQ = Good Chroma, Large File Size (500mbps), will need to upgrade my HTPC CPUs to i7 for SW Decoding (I've got a 2nd hand i7-7700 coming to test)

FYI
- I'm use JRiver Media Center and I'm not going to change to MPC.
- Yup Camera records in 500Mbps AVC 4:2:2 in UHD 50fps, so the files are big!

[VictorLS]

jmone
Thanks for screenshots but small CPU utilization graph in top left corner will be appreciated in a future.
But I see 86% utilization of your powerful CPU when encoding - so not only v3090's encoding blocks is used in process of encoding.
Btw can Davinci Resolve play external files like h265 4:4:4 FX6_Sample.mp4 and FX6_Sample_25fps.mp4? It's interesting can your 3090 accelerate both of them?

Originally Posted by jmone

I'm use JRiver Media Center and I'm not going to change to MPC.

I've understood from first time you wrote but MPC-HC(BE) are just small portable freeware players (btw they are can with near correctly colors play HLG files on SDR monitor - madVR can't) to have as test players only in your case.

[jmone]

Yes. Davinci Resolve will use HW Acceleration for both 4:2:0 and 4:4:4 HEVC for both Playback and Encoding.... though it is not a "player" as such, it's a video editing package but does use HW Acceleration where it can.

Also, keep in mind that the High CPU during the encoding of the HEVC 4:4:4 in Resolve is because the CPU is being used to decode the original AVC 4:2:2 500MBit & the other tasks that Dacinci Resolve is doing (Audio Transcoding, other Effects etc). It can not do HW decoding acceleration for 4:2:2 as the GPU does not support it.

While I've not tested every combination, Davinci Resolve seems to support all the NVDEC supported HW Accelerated Profiles https://en.wikipedia.org/wiki/Nvidia_NVDEC content for both playback (decoding) and rendering (encoding) with a modern nvidia card, which includes HEVC 4:4:4.

[VictorLS]

Originally Posted by jmone

Davinci Resolve will use HW Acceleration for both 4:2:0 and 4:4:4 HEVC for both Playback and Encoding.... though it is not a "player" as such, it's a video editing package but does use HW Acceleration where it can

I try to continue: i.e. both FX6_Sample.mp4 and FX6_Sample_25fps.mp4 are hardware accelerated in Davinci Resolve when I tried to encode them into (some easy format) well - is it true (or just FX6_Sample_25fps.mp4 is accelerated)?
Screenshot with CPU and Video Decode load
Also ffmpeg -benchmark -i FX6_Sample_25fps.mp4 -f null out.null and ffmpeg -benchmark -hwaccel cuda -i FX6_Sample_25fps.mp4 -f null out.null (I use ffmpeg version 2021-01-12-git-ca21cb1e36-full_build-www.gyan.dev Copyright (c) 2000-2021 the FFmpeg developers built with gcc 10.2.0 (Rev6, Built by MSYS2 project) - what version do you use?) are the same so hardware acceleration isn't work - is it true? If not and -hwaccel cuda use Video Decode upload screenshot, please.

Originally Posted by jmone

Also, keep in mind that the High CPU during the encoding of the HEVC 4:4:4 in Resolve is because the CPU is being used to decode the original AVC 4:2:2 500MBit & the other tasks that Dacinci Resolve is doing (Audio Transcoding, other Effects etc). It can not do HW decoding acceleration for 4:2:2 as the GPU does not support it.

I thought the same but your explanation was appreciated.

Originally Posted by jmone

While I've not tested every combination, Davinci Resolve seems to support all the NVDEC supported HW Accelerated Profiles https://en.wikipedia.org/wiki/Nvidia_NVDEC content for both playback (decoding) and rendering (encoding) with a modern nvidia card, which includes HEVC 4:4:4.

I've watched the same on https://developer.nvidia.com/video-e...ort-matrix-new but asterix *H.265 (HEVC) 4:4:4 isn't explaned there - I can assume may be it means i.e. not through DXVA2 or D3D11

[jmone]

Davinci Resolve: HW Acceleration is used for both encoding and decoding the HEVC UHD 4:4:4 10-Bit 50fps sample. Here are the screen shots showing both GPU & CPU usage for:
- AVC UHD 4:2:2 10 Bit 50fps (CPU Decoding) ----> HEVC UHD 4:4:4 10 Bit 50fps (GPU Encoding)
https://behome.dyndns.info/index.php/s/MGsi7amYKRqa4iT
- HEVC UHD 4:4:4 10 Bit 50fps (GPU Encoding) ----> HEVC UHD 4:4:4 10 Bit 50fps (GPU Encoding)
https://behome.dyndns.info/index.php/s/qqfEwYoZ8EAZEAE

I'll look at ffmpeg later.

[jmone]

ffmpeg: Yes HW acceleration (decode) works on the HEVC UHD 10 Bit 4:4:4 50fps sample when adding "-hwaccel cuda" - https://behome.dyndns.info/index.php/s/yxgwZ64ajWioakQ

Here the log of both runs (with and without "-hwaccel cuda") - https://behome.dyndns.info/index.php/s/yZwPLBD8zPoyRsY

[VictorLS]

jmone
Many thanks.
I guess https://behome.dyndns.info/index.php/s/qqfEwYoZ8EAZEAE for FX6_Sample.mp4 namely (on your previous screenshots I saw name of encoding file in Davinci Resolve but this time name of file absent)? If so, I agree test with FX6_Sample_25fps.mp4 is unnecessary.
It's seems I was wrong so I ask you repeat test with FX6_Sample.mp4 and upload HEVC UHD HDR 10Bit 444 50fps.mov for our future testing.
Btw saying about CPU load in top left corner I meant just (name of playing file and H/W also important):

but you've done better (but some harder to do).
If I understand right FX6_Sample.mp4 and HEVC UHD HDR 10Bit 444 50fps.mov are not hardware accelerated in JRiver Media Center with LAV Video Decoder (CUVID) and madVR - right?
I ask you try with latest MPC-HCx64 (LAV CUVID) https://github.com/clsid2/mpc-hc/rel....8.148.x64.zip and ordinary EVR to watch H/W in bottom left corner

[jmone]

HEVC 4:4:4 is not HW Accelerated in either JRiver Media Center or MPC-HCx64 (from your zip file) with LAV set to CUVID.

[VictorLS]

jmone
Thanks but I don't know until now have you tried FX6_Sample.mp4 or just yours HEVC UHD HDR 10Bit 444 50fps.mov?