LAV Filters - DirectShow Media Splitter and Decoders

[VictorLS]

Originally Posted by richardpl

FFmpeg have decoder for Dolby-E.

Thanks - I hope you can prove that because MediaInfo in Sample Eurovision 2019 Tel Aviv.ts sees 4 audio tracks - third and fourth of them are DolbyE:

Audio #3
ID                                       : 4144 (0x1030)-1
Menu ID                                  : 1 (0x1)
Format                                   : Dolby E
Format settings                          : Little
Muxing mode                              : SMPTE ST 302 / SMPTE ST 337
Codec ID                                 : 6
Duration                                 : 31 s 680 ms
Bit rate mode                            : Constant
Channel(s)                               : 6 channels
Channel layout                           : L C Ls X R LFE Rs X
Sampling rate                            : 48.0 kHz
Frame rate                               : 25.000 FPS (1920 SPF)
Bit depth                                : 20 bits
Delay relative to video                  : 39 ms
Title                                    : ESC 2019 

Audio #4
ID                                       : 4144 (0x1030)-2
Menu ID                                  : 1 (0x1)
Format                                   : Dolby E
Format settings                          : Little
Muxing mode                              : SMPTE ST 302 / SMPTE ST 337
Codec ID                                 : 6
Duration                                 : 31 s 680 ms
Bit rate mode                            : Constant
Channel(s)                               : 2 channels
Channel layout                           : X X X L X X X R
Sampling rate                            : 48.0 kHz
Frame rate                               : 25.000 FPS (1920 SPF)
Bit depth                                : 20 bits
Delay relative to video                  : 39 ms
Title                                    : Program 2

but ffmpeg lastest (less than half day since it was compiled so must include DolbyE parser) version n4.3.1-29-g89daac5fe2 Copyright (c) 2000-2021 the FFmpeg developers built with gcc 9.3-win32 (GCC) 20200320 from https://github.com/BtbN/FFmpeg-Builds/releases shows (as much older versions of ffmpeg and LAV Splitter too) only three audio track - third (and last) of them is:
Stream #0:3[0x1030]: Audio: s302m (BSSD / 0x44535342), stereo, s32 (20 bit), 2304 kb/s so where's DolbyE stream with 6 audio channels (namely fourth audio stream)? Or MediaInfo shows wrong information and audio streams 3 and 4 are not DolbyE at all?
So main question is:

[s302m @ 0000000000486980] S302 non PCM mode with data type 28 not supported
    Last message repeated 13 times
[mpegts @ 00000000005aa680] decoding for stream 3 failed
[mpegts @ 00000000005aa680] Could not find codec parameters for stream 3 (Audio:  s302m (BSSD / 0x44535342), stereo, s32 (20 bit), 2304 kb/s): unspecified sample rate

PS. I'm not power user of ffmpeg so show correct and working command line to extract only DolbyE stream from Sample Eurovision 2019 Tel Aviv.ts, please.

[richardpl]

Here is decoder:

http://git.videolan.org/?p=ffmpeg.gi...by_e.c;hb=HEAD

Note that DolbyE is muxed in various strange ways in different containers.
I'm not providing advanced ffmpeg usage for free, sorry.

[jmone]

Originally Posted by VictorLS

jmone
That's better - thanks but I've asked about ffmpeg -benchmark... test with FX6_Sample.mp4 and (if hardware decoding not work with 50fps but due test with HEVC UHD HDR 10Bit 444 50fps.mov I'm sure Ampere can - may be Turing can't) FX6_Sample_25fps.mp4 - it was at http://forum.doom9.org/showthread.ph...08#post1934308

ffmpeg: Yes HW acceleration (decode) works on both FX6_Sample_25fps.mp4 & HEVC UHD 10 Bit 4:4:4 50fps sample when adding "-hwaccel cuda"

I've added the info from the log to the previous one - https://behome.dyndns.info/index.php/s/yZwPLBD8zPoyRsY

[VictorLS]

richardpl
I see
jmone
Many thanks but add FX6_Sample.mp4 (which is 50fps as HEVC UHD HDR 10Bit 444 50fps.mov too) in same way, please.

[jmone]

Originally Posted by VictorLS

Many thanks but add FX6_Sample.mp4 (which is 50fps as HEVC UHD HDR 10Bit 444 50fps.mov too) in same way, please.

Done - same thing - HW Accel works. Log file updated.

[VictorLS]

jmone
Thanks again - now I have two h265 4:4:4 4K test files: FX6_Sample_25fps.mp4 and FX6_Sample.mp4 for nVIDIA's Turing and Ampere videocards to test hardware acceleration with nVIDIA CUVID (now it's calling NVDEC) in LAV Video Decoder if nevcairiel will forget "CUVID is deprecated" (clsid, btw can you explain why shaders in your MPC-HC with MPC-VR worked in both pre-resize and post-resize while author of MPC-VR says shaders must work only in post-resize and that is so in MPC-BE and SmartDVB?)

[huhn]

you know they just repacked CUVID and named it NVDEC. but CUIVD which is still the same is deprecated...
i'm sure he forgot.

[clsid]

Originally Posted by nevcairiel

CUVID is not currently being developed further.

Originally Posted by VictorLS

can you explain why shaders in your MPC-HC with MPC-VR worked in both pre-resize and post-resize while author of MPC-VR says shaders must work only in post-resize and that is so in MPC-BE and SmartDVB?

The answer is written literally as a note on the Shaders page in MPC-HC settings. Pre-resize is done as post-resize when using MPCVR.

[jmone]

NVDEC is not going anywhere from nvidia's perspective (or all the apps that use it). Who knows if they ever add it 4:4:4 to D3D11 however.

It's up to nev regarding what to do with NVDEC support in LAV, and while "CUVID is not currently being developed further" is certianly his latest post, it was not that long ago that:

Originally Posted by nevcairiel

I've been thinking about replacing CUVID with NVDEC in LAV, with built-in deinterlacing and either copy-back like today or interop with D3D11, so that it could be efficient like D3D11 native, just with deinterlacing, and potential 12-bit and maybe 4:4:4 support (the latter would likely need renderer support first)

I for one would certainly support this.

[jmone]

Originally Posted by jmone

I for one would certainly support this.

I know that HW acceleration for UHD HDR HEVC 10-BIT 4:4:4 support is a pretty niche requirement, but it looks like it would be the best format for rendering out my "master" FX6 footage ... so I'm happy to "put my money where my mouth is", that is....

...if Nevcairiel is open to a bounty for this to be supported in LAV, I'll pledge US$250.

[VictorLS]

Originally Posted by clsid

CUVID is not currently being developed further

By nVIDIA or by nevcairiel himself?

Originally Posted by clsid

The answer is written literally as a note on the Shaders page in MPC-HC settings. Pre-resize is done as post-resize when using MPCVR.

Thanks.

[clsid]

The implementation in LAV.

[jmone]

Oh well. The other idea of upgrading my HTPC from a i5-7600k to a i7-7000 to get more cores did not help for using SW decoding on 500mbit AVC-I UHD 10-Bit 4:2:2 PQ @ 50fps. Still can't keep the Render Queues full with all 8 threads running at 4ghz (and they all peak over 90%). My OC I9-9900KF running at 4.9ghz can do it (all 16 threads are at about 50%), but it turns it into a space heater. Also, the idea of pushing 500Mbit content over the LAN smells like it is asking for trouble anyway. I could also use a 150mbit AVC LGOP UHD 10-Bit 4:2:2 PQ Profile but that is even more taxing than all I .... and my I9-9900-KF will still drop the odd frame.

So I really am going to need 4:4:4 HEVC HW acceleration or much more powerful (maybe AMD) HTPCs if I want to keep anything better than 4:2:0 for playback.

[VictorLS]

jmone
Hardware acceleration is great (but not universal) thing - even my weakest possible nVIDIA GTX750v2 on GM206 1 GB videomemory easily plays without drop and video&audio synced my powerful processor test file Men.in.Black.1997.2160p.WEB-DL.mkv (2,3 GB) https://yadi.sk/i/I8FFU8PdzNRpt - you can try play it with and without hardware acceleration with every your processors.

[jmone]

No Need. My existing CPU/GPU combinations (with madVR tuning) has no issues with commercially available content that I buy (up to and including the two UHD HDR HFR HEVC titles - Billy Lynn, and Gemini Man - both of which are 4:2:0). What we are now exploring is taking UHD HDR HFR decoding from 4:2:0 to 4:2:2 or 4:4:4.
- 4:2:2 = There is no GPU HW acceleration option for 4:2:2 in any codec on any consumer GPU. It can be done in SW, but needs one of the latest gen powerful CPU to be done in real time, and even then it consumes a lot of power (and that is for AVC all I).
- 4:4:4 = This can be done by GPU acceleration for HEVC (not in AVC or AV1 etc) and has been supported for the last two nvidia GPU generations. It can not be done in SW even with a modern powerful CPU (well at least not even close with my i9-9900KF for HEVC 4:4:4 HDR HFR UHD samples).

[VictorLS]

jmone
I agree with all you've written in last post but very interesting to get results of MenInBlack (it's not commercially) test (with average CPU load) namely on your three processors without hardware acceleration. I guess "OC I9-9900KF running at 4.9ghz" can fluent play with ~40% load of each physical/logical core, may be i7-7000 with ~80% load but i5-7600k with 100% will can't fluent and video/audio synced play.

[jmone]

Victor, I'm not going to download a pirated copy and you should remove the link. I am happy to test on any of the over 1,000 movies (of which 250 are UHD BDs) I have purchased ... & I don't really see the point of this in the LAV thread.

[jmone]

Victor, Thank you for removing the link.

For your interest, here is a screen shot of play Gemini Man (BD UHD 59.94fps HDR 4:2:0) using just SW decoding on my i9-9900KF. I had to increase my queue sizes in madVR to stop the occasional dropped frame when the CPU spiked to 100%. I have no idea why anyone would want to use SW decoding when you could use HW acceleration. The only difference was I generated a lot of heat and fan noise.
https://behome.dyndns.info/index.php/s/xPjsaw3nXQG4Ws5

[VictorLS]

Originally Posted by jmone

Victor, I'm not going to download a pirated copy

I see now and respect your point of view like "for all in our lives must be paid" and you'd be right if Men.in.Black.1997.2160p.WEB-DL.mkv is full movie - but it's just 1min33s (so about 200 Mbit/s) fragment for testing purpose only

[VictorLS]

Originally Posted by jmone

Victor, Thank you for removing the link.

I'll not going to remove link (see above)

Originally Posted by jmone

I have no idea why anyone would want to use SW decoding when you could use HW acceleration

My videocard can but there's many people with old but powerful enough processors with old integrated videocard can't accelerate h265 at all

Originally Posted by jmone

For your interest, here is a screen shot of play Gemini Man (BD UHD 59.94fps HDR 4:2:0) using just SW decoding on my i9-9900KF. I had to increase my queue sizes in madVR

Thanks for test and screenshot. Which value of "queue sizes" was and present in madVR now?