[DDVT Tool] Dolby Vision RPU Demuxing / Injecting / Editing.

[puremind]

Originally Posted by -QfG-

DDVT Tool Download Folder on MEGA.
(The tool based on quietvoids tools)

-Demuxing DV Metadata from MKVs/MP4s.
-Convert HDR10+ Metadata to DoVi Metadata (Experimental).
-Convert Profile 7/5 Metadata to Profile 8.1.
-Inject DoVi Metadata in Streams.
-Easy Delay Adjustment in Injector.
-Complete Open Source Batch Scripts!

Credits to quietvoid for his awesome tools.
Credits to Atak_Snajpera for the BorderDetect tool.

>> DOWNLOAD via MEGA Folder <<[/CENTER]

A while ago, I had shared a mass convert script adapted from yours so that it would do all files in a given folder sequentially. I had commented that it would be nice to also extract and convert subtitle tracks to MP4.

In case anyone is interested, I am sharing the updated script.



The use is very simple just type MP4all C:\YourFolder\ from where the file is script and it will translate all of your files. You can specify preferred audio and subtitle track you want and it will mux it all together for each file in the folder.

MP4all.zip

Be careful that sometimes there are up to 3 subtitle tracks with the same language (e.g, forced, SDH and standard) and you want to extract the standard one, so if you don't see subtitles you probably extracted the wrong one. If I have time later, I will append the title information to help with the choice but those loops inside command files are killing me.

Edit: Fixed an issue whereby it would not detect subtitle tracks if there is only 1 subtitle track or the file name contained spaces.

[asarian]

I have a HDR video (Push), with a Dolby Vision layer (see below). Muxing the 2 into a single MKV doesn't trigger DV, though (on my new LG G4).

Can I use these tools to make that work? Or do I have to somehow re-encode the main stream with DV data? As the confusing part is, that I have a Star Trek blu-ray which also appears DV-enabled, but apparently there it's all in 1 single stream.

Thanks.

M2TS, 2 video tracks, 3 audio tracks, 2 subtitle tracks, 1:51:27, 11.988p
1: h265/HEVC, 2160p24 /1.001 (16:9), 10 bits
2: h265/HEVC, 1080p24 /1.001 (16:9), 10 bits - Dolby Vision Enhancement Layer
3: TrueHD/AC3 (Atmos), 7.1 channels, 48kHz
   (embedded: AC3 EX, 5.1 channels, 448kbps, 48kHz)

[puremind]

Originally Posted by asarian

I have a HDR video (Push), with a Dolby Vision layer (see below). Muxing the 2 into a single MKV doesn't trigger DV, though (on my new LG G4).

Can I use these tools to make that work? Or do I have to somehow re-encode the main stream with DV data? As the confusing part is, that I have a Star Trek blu-ray which also appears DV-enabled, but apparently there it's all in 1 single stream.

Thanks.

M2TS, 2 video tracks, 3 audio tracks, 2 subtitle tracks, 1:51:27, 11.988p
1: h265/HEVC, 2160p24 /1.001 (16:9), 10 bits
2: h265/HEVC, 1080p24 /1.001 (16:9), 10 bits - Dolby Vision Enhancement Layer
3: TrueHD/AC3 (Atmos), 7.1 channels, 48kHz
   (embedded: AC3 EX, 5.1 channels, 448kbps, 48kHz)

You can use the tool in posted above, very simple instructions. You don't need to do much for the file you have. It is more complicated to transform HDR layer into DV readable, but here you already have the DV layer baked into.

Originally Posted by asarian

I have a HDR video (Push), with a Dolby Vision layer (see below). Muxing the 2 into a single MKV doesn't trigger DV, though (on my new LG G4).

Can I use these tools to make that work? Or do I have to somehow re-encode the main stream with DV data? As the confusing part is, that I have a Star Trek blu-ray which also appears DV-enabled, but apparently there it's all in 1 single stream.

Thanks.

M2TS, 2 video tracks, 3 audio tracks, 2 subtitle tracks, 1:51:27, 11.988p
1: h265/HEVC, 2160p24 /1.001 (16:9), 10 bits
2: h265/HEVC, 1080p24 /1.001 (16:9), 10 bits - Dolby Vision Enhancement Layer
3: TrueHD/AC3 (Atmos), 7.1 channels, 48kHz
   (embedded: AC3 EX, 5.1 channels, 448kbps, 48kHz)

LG's require the video to be an .mp4 for DV to be displayed !!!

I have an LG C4, but I don't use DDVT.

[asarian]

Originally Posted by puremind

You can use the tool in posted above, very simple instructions. You don't need to do much for the file you have. It is more complicated to transform HDR layer into DV readable, but here you already have the DV layer baked into.

Awesome! Thx. Yes, I rather not re-encode, if possible.

[asarian]

Originally Posted by TDS

LG's require the video to be an .mp4 for DV to be displayed !!!

You'd think so; but on my LG G4, my remuxed Strange New Worlds Blu-Rays trigger Dolby Vision, with just the single layer (via Kodi)

X:\Star Trek\Star Trek Strange New Worlds>eac3to "Star Trek Strange New Worlds - S01E01.mkv"
MKV, 1 video track, 1 audio track, 0:52:51, 24p /1.001
1: h265/HEVC, English, 2160p24 /1.001 (16:9), 10 bits
2: RAW/PCM, English, 5.1 channels, 24 bits, 48kHz

I took a look at the original again, to make sure I hadn't perhaps forgotten to mux the DV layer, but nope, it's just the 1 STREAM (And it looks absoutely spectacular with DV, btw! My old Q90 couldn't do DV).

[puremind]

Originally Posted by asarian

Awesome! Thx. Yes, I rather not re-encode, if possible.

This one just let's you choose video quality and your preferred srt subtitle track, and it will transform it into MP4 DV that plays anywhere.

But with DDVT_Hybrid tool it is actually very easy to reencode, you just drag and drop the same HDR file twice and it will create the DV layer and final file. It just takes longer.

[asarian]

Originally Posted by puremind

You can use the tool in posted above, very simple instructions. You don't need to do much for the file you have. It is more complicated to transform HDR layer into DV readable, but here you already have the DV layer baked into.

I tried the DDVT_DEMUXER.cm tool, but it keeps saying no Dolby Vision profile found on any of the files with the extra DV Layer in it.

[asarian]

Originally Posted by puremind

This one just let's you choose video quality and your preferred srt subtitle track, and it will transform it into MP4 DV that plays anywhere.

But with DDVT_Hybrif tool it is actually very easy to reencode, you just drag and drop the same HDR file twice and it will create the DV layer and final file. It just takes longer.

Okay, will try this DDVT_Hybrid tool too.

[LaFirma]

Originally Posted by TDS

LG's require the video to be an .mp4 for DV to be displayed !!!

I have an LG C4, but I don't use DDVT.

Originally Posted by asarian

You'd think so; but on my LG G4, my remuxed Strange New Worlds Blu-Rays trigger Dolby Vision, with just the single layer (via Kodi)

X:\Star Trek\Star Trek Strange New Worlds>eac3to "Star Trek Strange New Worlds - S01E01.mkv"
MKV, 1 video track, 1 audio track, 0:52:51, 24p /1.001
1: h265/HEVC, English, 2160p24 /1.001 (16:9), 10 bits
2: RAW/PCM, English, 5.1 channels, 24 bits, 48kHz

I took a look at the original again, to make sure I hadn't perhaps forgotten to mux the DV layer, but nope, it's just the 1 STREAM (And it looks absoutely spectacular with DV, btw! My old Q90 couldn't do DV).

LG OLED cx/c1/c2/c3/c4 will only work on DV in PROFILE 5 or 8... in PLEX/KODI they will only work if they are MP4/M2TS.
On Jellifyn it plays MKV.
I use DDVT TOOL to convert PROFILE 7 to 8 and it works perfectly.

NOT WORK:
HDR format : Dolby Vision, Version 1.0, dvhe.07.06, BL+EL+RPU, Blu-ray compatible / SMPTE ST 2086, HDR10 compatible

WORK:
HDR format : Dolby Vision, Version 1.0, dvhe.08.06, BL+RPU, HDR10 compatible / SMPTE ST 2086, HDR10 compatible

[asarian]

Originally Posted by LaFirma

LG OLED cx/c1/c2/c3/c4 will only work on DV in PROFILE 5 or 8... in PLEX/KODI they will only work if they are MP4/M2TS.
On Jellifyn it plays MKV.
I use DDVT TOOL to convert PROFILE 7 to 8 and it works perfectly.

NOT WORK:
HDR format : Dolby Vision, Version 1.0, dvhe.07.06, BL+EL+RPU, Blu-ray compatible / SMPTE ST 2086, HDR10 compatible

WORK:
HDR format : Dolby Vision, Version 1.0, dvhe.08.06, BL+RPU, HDR10 compatible / SMPTE ST 2086, HDR10 compatible

Let's look at this MKV again:

X:\Star Trek\Star Trek Strange New Worlds>eac3to "Star Trek Strange New Worlds - S01E01.mkv"
MKV, 1 video track, 1 audio track, 0:52:51, 24p /1.001
1: h265/HEVC, English, 2160p24 /1.001 (16:9), 10 bits
2: RAW/PCM, English, 5.1 channels, 24 bits, 48kHz

MediaInfo says the following about the video:

Dolby Vision, Version 1.0, Profile 7.6, dvhe.07.06, BL+EL+RPU, no metadata compression, Blu-ray compatible / SMPTE ST 2086, Version HDR10, HDR10 compatible

This WORKS, and yields a playable MKV, with DV, on my LG G4. (Played with Kodi 21.0)

This, however, is what I'm struggling with:

M2TS, 2 video tracks, 3 audio tracks, 2 subtitle tracks, 1:51:27, 11.988p
1: h265/HEVC, 2160p24 /1.001 (16:9), 10 bits
2: h265/HEVC, 1080p24 /1.001 (16:9), 10 bits - Dolby Vision Enhancement Layer
3: TrueHD/AC3 (Atmos), 7.1 channels, 48kHz
   (embedded: AC3 EX, 5.1 channels, 448kbps, 48kHz)

I can't, for the life of me, get any of the DDVT TOOLS to even find Dolby Vision data in the file, though. The DV layer is clearly there, but I get no tool to recognize it.

[SeeMoreDigital]

Originally Posted by asarian

Let's look at this MKV again:
This, however, is what I'm struggling with:

M2TS, 2 video tracks, 3 audio tracks, 2 subtitle tracks, 1:51:27, 11.988p
1: h265/HEVC, 2160p24 /1.001 (16:9), 10 bits
2: h265/HEVC, 1080p24 /1.001 (16:9), 10 bits - Dolby Vision Enhancement Layer
3: TrueHD/AC3 (Atmos), 7.1 channels, 48kHz
   (embedded: AC3 EX, 5.1 channels, 448kbps, 48kHz)

I can't, for the life of me, get any of the DDVT TOOLS to even find Dolby Vision data in the file, though. The DV layer is clearly there, but I get no tool to recognize it.

Out of interest... What happens if you try and play the .m2ts file using the LG G4's built-in 'video' player?

[asarian]

Originally Posted by SeeMoreDigital

Out of interest... What happens if you try and play the .m2ts file using the LG G4's built-in 'video' player?

Not even sure I can attach an SMB to the LG G4. But I can try.

P.S. That Push DV blu-ray was remuxed at some point (I removed all stuff I didn't need). Could DV metadata have been removed in the process?

I also ripped the entire blu-ray folder structure to disk, but MediaInfo still does not acknowledge DV presence in the alleged DV stream; just sees it as a regular 1080p hevc stream.

[SeeMoreDigital]

Originally Posted by asarian

Not even sure I can attach an SMB to the LG G4. But I can try.

How about an NTFS formatted USB powered HDD or thumb drive?

Personally, I currently use an old SATA 120GB solid state drive (within a USB caddy) for such testing. Which works fine with my 2016 LG television...

[GodzilaAvenger]

Originally Posted by asarian

Let's look at this MKV again:

X:\Star Trek\Star Trek Strange New Worlds>eac3to "Star Trek Strange New Worlds - S01E01.mkv"
MKV, 1 video track, 1 audio track, 0:52:51, 24p /1.001
1: h265/HEVC, English, 2160p24 /1.001 (16:9), 10 bits
2: RAW/PCM, English, 5.1 channels, 24 bits, 48kHz

MediaInfo says the following about the video:

Dolby Vision, Version 1.0, Profile 7.6, dvhe.07.06, BL+EL+RPU, no metadata compression, Blu-ray compatible / SMPTE ST 2086, Version HDR10, HDR10 compatible

This WORKS, and yields a playable MKV, with DV, on my LG G4. (Played with Kodi 21.0)

This, however, is what I'm struggling with:

M2TS, 2 video tracks, 3 audio tracks, 2 subtitle tracks, 1:51:27, 11.988p
1: h265/HEVC, 2160p24 /1.001 (16:9), 10 bits
2: h265/HEVC, 1080p24 /1.001 (16:9), 10 bits - Dolby Vision Enhancement Layer
3: TrueHD/AC3 (Atmos), 7.1 channels, 48kHz
   (embedded: AC3 EX, 5.1 channels, 448kbps, 48kHz)

I can't, for the life of me, get any of the DDVT TOOLS to even find Dolby Vision data in the file, though. The DV layer is clearly there, but I get no tool to recognize it.

The first one is single-layer DV (i.e. DV data baked as an Enhancement Layer (EL) into the video stream), the second one is dual-layer DV (DV data a separate 1080p stream). DDVT only works with the first one, mediainfo will also show DV only for the first one, showing the second one as having a 4k stream and a 1080p stream. You can use MKVToolNix to remux the .m2ts file into .mkv and then use DDVT.

[asarian]

Originally Posted by GodzilaAvenger

The first one is single-layer DV (i.e. DV data baked as an Enhancement Layer (EL) into the video stream),

If I understood things correctly, I should be able to extract the EL from the main stream, and reapply it later, right? (So I can denoise movies first).

the second one is dual-layer DV (DV data a separate 1080p stream). DDVT only works with the first one, mediainfo will also show DV only for the first one, showing the second one as having a 4k stream and a 1080p stream. You can use MKVToolNix to remux the .m2ts file into .mkv and then use DDVT.

Tried that already; but if I drop the dual layer mkv on DDVT, it still says it cannot find DV data. Ideally, by the looks of it, I am looking for a way, in case of dual layer, to re-encode the EL into the main stream somehow.

[GodzilaAvenger]

Originally Posted by asarian

If I understood things correctly, I should be able to extract the EL from the main stream, and reapply it later, right? (So I can denoise movies first).

I believe so, yes. DDVT_DEMUXER should give you a base layer HDR.hevc file, an EL.hevc file, and a RPU.bin file.

I think denoising the base layer could get tricky. If the DV is MEL, it should be fine. If it's FEL though (see here for the difference) denoising the base layer may screw things up when it's put together with the EL, as the EL's purpose in FEL is to add up to the base layer to recreate the original 12-bit stream. Of course you can just add the RPU to the base layer and get a Profile 8 DV. Quite a while ago (documented in some of the conversation early in this thread) I tried adding EL to an encoded BL but the result wouldn't even trigger DV on any display (I think because encoding messed up frame orders as well).

Originally Posted by asarian

Tried that already; but if I drop the dual layer mkv on DDVT, it still says it cannot find DV data. Ideally, by the looks of it, I am looking for a way, in case of dual layer, to re-encode the EL into the main stream somehow.

MKVToolNix (at least some of the later versions that I've tried) should give you a single-layer .mkv from a dual-layer .m2ts file (or playlist if the Blu-ray does branching). DDVT can't work with your .mkv if it is dual-layer.

[asarian]

Originally Posted by GodzilaAvenger

I believe so, yes. DDVT_DEMUXER should give you a base layer HDR.hevc file, an EL.hevc file, and a RPU.bin file.

I think denoising the base layer could get tricky. If the DV is MEL, it should be fine. If it's FEL though (see here for the difference) denoising the base layer may screw things up when it's put together with the EL, as the EL's purpose in FEL is to add up to the base layer to recreate the original 12-bit stream. Of course you can just add the RPU to the base layer and get a Profile 8 DV. Quite a while ago (documented in some of the conversation early in this thread) I tried adding EL to an encoded BL but the result wouldn't even trigger DV on any display (I think because encoding messed up frame orders as well).

Yeah, you cannot change framerate, of course, or resize the base layer; it's kind of a 1:1 deal. But I really hope denoising will work. Way I understood it (and my understanding is clearly minimal), the EL consists essentiallly of location-based nits information, per frame. Hoping no precise 1:1 pixel overlap is required, or denoising will indeed be a bust.

MKVToolNix (at least some of the later versions that I've tried) should give you a single-layer .mkv from a dual-layer .m2ts file (or playlist if the Blu-ray does branching). DDVT can't work with your .mkv if it is dual-layer.

Holy crap! I had no idea MKVtoolnix could do this! I thought it was just ignoring the DV layer, but, indeed, it mixes the two somehow, and MediaInfo suddenly reports DV data on the now single stream!

Thank you kindly! This will help me tremendously.


EDIT: The MKVToolNix route was a great success! Reason I never saw it mix the DV main with EL before, is that MKVToolNix only does this on pure m2ts files (whereas I generally mux everything to mkv, as that plays so much nicer with Kodi and such). So, I first used tsMuxer to convert my denoised Push UHD mkv to m2ts again. Then used MKVToolNix to use the main (denoised) stream of the new m2ts, and added the original m2ts from disc (sans the main stream, of course, but with the EL), and muxed them together with MKVToolNix.The result is a totally wonderfully playing, single-layer, DV edition, in MKV, of my denoised Push UHD disc. Worked flawlessly. (I guess my 'gut' was right about the EL only containing positional nits info, and not requiring a bit-for-bit matching main stream). And it didn't even require re-encoding (at least not the x265 kind, that takes 12 hours).

[GodzilaAvenger]

You are very welcome!

You can tell by looking at the DV layer's bitrate if it is MEL (Minimum Enhancement Layer), faux FEL (Full Enhancement Layer), or actual FEL (here's a good explainer on DV).

(My information is from this post in particular, click on the three Show Spoilers to read the full post) If the DV layer bitrate is on the order of ~100 kbps, then it is MEL, i.e. it only contains the RPU, i.e. the scene-by-scene brightness and tonemapping metadata.

If the DV layer bitrate is a little over 2 Mbps, it is faux FEL. The EL contains the RPU along with a uniform 1080p stream. If the bitrate is more than that (generally anything above 2.2 Mbps), it is actual FEL, and the EL contains both the RPU and the stream data that, when added to the base 10-bit HDR layer, recreates the film's original 12-bit stream.

I looked at Push's disk info and it looks like this:

Disc Title    : PUSH
Disc Size     : 61,837,342,720 bytes
Protection    : AACS2
BD-Java       : Yes
Playlist      : 00802.MPLS
Size          : 56,903,645,184 bytes
Length        : 15127.180
Total Bitrate : 68.07 Mbps
Video         : MPEG-H HEVC Video / 49719 kbps / 2160p / 23.976 fps / 169 / Main 10 Profile 5.1 High / 420 / 10 bits / HDR / BT.2020 /
Video         : * MPEG-H HEVC Video / 7836 kbps / 1080p / 23.976 fps / 169 / Main 10 Profile 5.1 High / 420 / 10 bits / Dolby Vision / BT.2020 /
Audio         : English / Dolby Atmos/TrueHD Audio / 7.1-Atmos / 48 kHz / 5847 kbps / 24-bit (AC3 Core5.1-EX / 48 kHz / 448 kbps)
Audio         : English / Dolby Digital Audio / 2.0 / 48 kHz / 192 kbps / Dolby Surround
Audio         : Spanish / Dolby Digital Audio / 5.1 / 48 kHz / 448 kbps
Subtitle      : English / 27.089 kbps
Subtitle      : Spanish / 22.159 kbps

Based on the discussion above, this is actual FEL. So why didn't you encounter any issues when denoising the base layer? I think the most likely reason is that your player, like almost all players out there, discards the video stream on the EL and only uses the RPU, so what you see is the base 10-bit HDR stream. It is also true that most TVs (even the likes of G4) don't get bright enough for you to notice the difference FEL makes, as it seems to be geared toward movie theatre projectors.

[asarian]

Originally Posted by GodzilaAvenger

You are very welcome!

...

Based on the discussion above, this is actual FEL. So why didn't you encounter any issues when denoising the base layer? I think the most likely reason is that your player, like almost all players out there, discards the video stream on the EL and only uses the RPU, so what you see is the base 10-bit HDR stream. It is also true that most TVs (even the likes of G4) don't get bright enough for you to notice the difference FEL makes, as it seems to be geared toward movie theatre projectors.

That would be disappointing. I do notice a huge difference between regular HDR and DV, though. The latter is far more vibrant, more accentuated, as it were.

If the player is ignoring FEL, at least the TV detects the 'Dolby Vision' signal.

As to why I didn't encounter any issues when denoising the base layer? I dunno. Why would I? (no sarcasm). I mean, I denoised the movie years ago (before I had a DV capable TV), and only used the main stream for the process. Is there something wrong with my assumption that the EL just adds locational info to the screen? All denoising does, is re-arrange the pixels a bit, in essence.