[DDVT Tool] Dolby Vision RPU Demuxing / Injecting / Editing.

[GodzilaAvenger]

FEL is made up of two elements: a 1080p video stream that is essentially "(movie studio 12-bit stream - 10-bit base layer stream)", and metadata that gives your TV information about how to adjust the brightness and colors for each scene, i.e. the RPU.

Your player isn't completely discarding the FEL, it is keeping the RPU from the FEL that lets your TV detect the DV signal and leads to those vibrant colors you mentioned.

[asarian]

Originally Posted by GodzilaAvenger

FEL is made up of two elements: a 1080p video stream that is essentially "(movie studio 12-bit stream - 10-bit base layer stream)", and metadata that gives your TV information about how to adjust the brightness and colors for each scene, i.e. the RPU.

Your player isn't completely discarding the FEL, it is keeping the RPU from the FEL that lets your TV detect the DV signal and leads to those vibrant colors you mentioned.

Again, that's disappointing to hear. How can you tell, though? I mean, MKVToolNix turned it all into a single layer now. Is there a way to tell what the TV is using? (or disgarding).

[GodzilaAvenger]

https://docs.google.com/spreadsheets...U9n1f_S74/edit

Since the last time I checked this a few years ago more players have become capable of playing full fat DV, so perhaps I'm wrong and your player does play the FEL along the RPU, check the list to see if it does. I think it would be hard to say visaully if the FEL is being used, it is supposed to help remove banding introduced by x265 and to retain film grain, but personally I can't tell the difference.

Also, I misspoke earlier. Your original Push file is dual-track dual-layer Profile 7 DV, when you use MKVToolNix it becomes single-track dual-layer Profile 7 DV. I confused tracks and layers

[AgentXXL]

Originally Posted by asarian

Holy crap! I had no idea MKVtoolnix could do this! I thought it was just ignoring the DV layer, but, indeed, it mixes the two somehow, and MediaInfo suddenly reports DV data on the now single stream!

Thank you kindly! This will help me tremendously.


EDIT: The MKVToolNix route was a great success! Reason I never saw it mix the DV main with EL before, is that MKVToolNix only does this on pure m2ts files (whereas I generally mux everything to mkv, as that plays so much nicer with Kodi and such). So, I first used tsMuxer to convert my denoised Push UHD mkv to m2ts again. Then used MKVToolNix to use the main (denoised) stream of the new m2ts, and added the original m2ts from disc (sans the main stream, of course, but with the EL), and muxed them together with MKVToolNix.The result is a totally wonderfully playing, single-layer, DV edition, in MKV, of my denoised Push UHD disc. Worked flawlessly. (I guess my 'gut' was right about the EL only containing positional nits info, and not requiring a bit-for-bit matching main stream). And it didn't even require re-encoding (at least not the x265 kind, that takes 12 hours).

You can also use MakeMKV to convert the dual layer files to single layer. Just open the dual layer file, choose a destination folder and click the Make MKV button.

[asarian]

Originally Posted by GodzilaAvenger

https://docs.google.com/spreadsheets...U9n1f_S74/edit

Since the last time I checked this a few years ago more players have become capable of playing full fat DV, so perhaps I'm wrong and your player does play the FEL along the RPU, check the list to see if it does. I think it would be hard to say visaully if the FEL is being used, it is supposed to help remove banding introduced by x265 and to retain film grain, but personally I can't tell the difference.

Your knowledge of players is impressive. I have a Dune Solo 8K, and, indeed, this is what your sheet says:

M2TS & TS & MP4 & MKV 
*EL is ignored and only the dynamic
 metadata in the RPU is processed
*colors are accurate

Also, I misspoke earlier. Your original Push file is dual-track dual-layer Profile 7 DV, when you use MKVToolNix it becomes single-track dual-layer Profile 7 DV. I confused tracks and layers

Also, if indeed grain is retained in the EL, then clearly FEL gets ignored, as the denoised movie didn't re-introduce new noise.

[Z2697]

Originally Posted by GodzilaAvenger

https://docs.google.com/spreadsheets...U9n1f_S74/edit

Since the last time I checked this a few years ago more players have become capable of playing full fat DV, so perhaps I'm wrong and your player does play the FEL along the RPU, check the list to see if it does. I think it would be hard to say visaully if the FEL is being used, it is supposed to help remove banding introduced by x265 and to retain film grain, but personally I can't tell the difference.

Also, I misspoke earlier. Your original Push file is dual-track dual-layer Profile 7 DV, when you use MKVToolNix it becomes single-track dual-layer Profile 7 DV. I confused tracks and layers

It actually meant to brought the 10-bits BL into 12-bits but...
FEL is usually a complete mess (a lot of noise-like pixels) in 1/4 resolution and less than 1/5 bitrate of the BL, I highly doubt the benefit if not harm it has.
Just see how many blocking and other compression artifacts they ususlly has. I'm not sure if I really feel comfortable to put that back into the main video.
With that being said, 10-bits surely isn't super enough for HDR and applying FEL surely does *something* (whether it's good or not).

P.S. "Difference of bit depths" often looks like noise/grain especially when there's actual noise/grain present in the original image.

[lemaireus]

I seem to have run into a bug in DDVT tools. Each time I try to extract a Dolby Vision Profile 8 RPU, the option to enter a '4. Crop RPU' goes blank. Instead, the 'Crop RPU' option moves to '3. Convert *':



When I enter '4' to set the 'Crop RPU' option to 'Yes', it is the 'Convert' option that changes to 'Yes' but the 'Crop RPU' option remains unavailable:



Thereafter, DDVT duly extracts the RPU, but when it's time to inject that RPU back, it gives a 'RPU does not match video' and 'video does not match RPU' message.

This problem occurs every time when the RPU is of Dolby Vision Profile 8. I've never run into this error in DDVT when the RPU is of Dolby Vision Profile 7.

Any ideas whether this is a bug in DDVT tool or might it be an issue with Dolby Vision profile 8?

[DarkRepaer]

Originally Posted by GodzilaAvenger

You are very welcome! I have not tried this personally yet, but based on what @quietvoid and @-QfG have said and dovi_tool's documentation, I think this is how things work:

Let's say you have a file where most scenes have a standard AR (3840x1608), two have IMAX AR (3840x2076), and one is something in between (3840x1960). Then your "custom.json" file which is located next to your "RPU.bin" would look something like this:

{
  "mode": 0,
  "active_area": {
    "presets": [
      {
        "id": 0,
        "left": 0,
        "right": 0,
        "top": 276,
        "bottom": 276
      }
      {
        "id": 1,
        "left": 0,
        "right": 0,
        "top": 42,
        "bottom": 42
      }
      {
        "id": 2,
        "left": 0,
        "right": 0,
        "top": 100,
        "bottom": 100
      }
    ],
    "edits": {
      "all": 0,
      "1000-1234": 1,
      "2400-2468": 2,
      "4800-4848": 1
    }
  }
}

You can then use the following command to edit your RPU:

dovi_tool editor -i RPU.bin -j custom.json -o Edited_RPU.bin

What this essentially does is to first assign the default AR L5 borders to all frames, then overwrite it for the frames specified. From what @-QfG- has said, I think if you have a "custom.json" file directly next to the "RPU.bin" file, when using DDVT_INJECTOR the tool first edits the RPU (using the dovi_tool command above) and then injects it into the mkv.

Hi GodzilaAvenger, thanks for the explanation on how to set the DV Aspect Ratio change.
I have two questions for you.
How can I find the crop values ​​to set for the various AR changes?
And after injecting the RPU, how do I check if everything is correct?

[GodzilaAvenger]

Hi,
For the first question, I do it by hand. I have a 4K display and I use Microsoft PowerToys' Screen Ruler to measure the borders. It's pretty tedious. Hopefully someone else knows of a more automated way of doing it (I think you can detect borders with FFmpeg but I've never tried it).
As for the second one, I think you just have to watch it and see if there are any weird brightness issues or frame cropping. Again, I'd welcome those with more experience to share their method if they have a better one.

[DarkRepaer]

Originally Posted by GodzilaAvenger

Hi,
For the first question, I do it by hand. I have a 4K display and I use Microsoft PowerToys' Screen Ruler to measure the borders. It's pretty tedious. Hopefully someone else knows of a more automated way of doing it (I think you can detect borders with FFmpeg but I've never tried it).
As for the second one, I think you just have to watch it and see if there are any weird brightness issues or frame cropping. Again, I'd welcome those with more experience to share their method if they have a better one.

For the first question ok, but for the second question, is it possible to see perhaps from the info tool, such as the "all" scenecut file, the various crop values ​​applied to individual frames or in some other technical way?

[GodzilaAvenger]

Yes, if you use the FILEINFO tool with the default settings it'll give you a massive .json file that has the frame-by-frame info, you can look at the L5 data for each frame to verify your work.

[DarkRepaer]

Originally Posted by GodzilaAvenger

Yes, if you use the FILEINFO tool with the default settings it'll give you a massive .json file that has the frame-by-frame info, you can look at the L5 data for each frame to verify your work.

So to know the exact AR and therefore the top and bottom values ​​I use the crop function of StaxRip (the software I use for the encodes), obviously in manual. Bringing a concrete example of a film, one of the most difficult complicated examples (25 different ARs), can you tell me if the custom json prepared can be corrected?
Just for confirmation before proceeding with the injection.

Aspect Ratio Film

0-3259        - 0,0,0,0      |id0
3260-16248    - 0,0,204,204  |id1
16249-17426   - 0,0,0,0      |id0
17427-35823   - 0,0,204,204  |id1
35824-38205   - 0,0,0,0      |id0
38206-39001   - 0,0,204,204  |id1
39002         - 0,0,138,138  |id2
39003         - 0,0,70,70    |id3
39004         - 0,0,4,4      |id4
39005-40639   - 0,0,0,0      |id0
40640-60260   - 0,0,204,204  |id1
60261-61591   - 0,0,0,0      |id0
61592-95714   - 0,0,204,204  |id1
95715-96263   - 0,0,0,0      |id0
96264-112299  - 0,0,204,204  |id1
112300        - 0,0,194,194  |id5
112301        - 0,0,184,184  |id6
112302        - 0,0,176,176  |id7
112303        - 0,0,168,168  |id8
112304        - 0,0,158,158  |id9
112305        - 0,0,150,150  |id10
112306        - 0,0,140,140  |id11
112307        - 0,0,130,130  |id12
112308        - 0,0,122,122  |id13
112309        - 0,0,114,114  |id14
112310        - 0,0,104,104  |id15
112311        - 0,0,94,94    |id16
112312        - 0,0,86,86    |id17
112313        - 0,0,76,76    |id18
112314        - 0,0,68,68    |id19
112315        - 0,0,58,58    |id20
112316        - 0,0,50,50    |id21
112317        - 0,0,40,40    |id22
112318        - 0,0,30,30    |id23
112319        - 0,0,22,22    |id24
112320        - 0,0,14,14    |id25
112321        - 0,0,4,4      |id4
112322-141753 - 0,0,0,0      |id0
141754-158601 - 0,0,204,204  |id1
158602-159671 - 0,0,0,0      |id0
159672-169886 - 0,0,204,204  |id1

Custom.json

{
    "mode": 0,
    "active_area": {
      "crop": false,
      "presets": [
        {
          "id": 0,
          "left": 0,
          "right": 0,
          "top": 0,
          "bottom": 0
        },
        {
          "id": 1,
          "left": 0,
          "right": 0,
          "top": 204,
          "bottom": 204
        },
        {
          "id": 2,
          "left": 0,
          "right": 0,
          "top": 138,
          "bottom": 138
        },
        {
          "id": 3,
          "left": 0,
          "right": 0,
          "top": 70,
          "bottom": 70
        },
        {
          "id": 4,
          "left": 0,
          "right": 0,
          "top": 4,
          "bottom": 4
        },
        {
          "id": 5,
          "left": 0,
          "right": 0,
          "top": 194,
          "bottom": 194
        },
        {
          "id": 6,
          "left": 0,
          "right": 0,
          "top": 184,
          "bottom": 184
        },
        {
          "id": 7,
          "left": 0,
          "right": 0,
          "top": 176,
          "bottom": 176
        },
        {
          "id": 8,
          "left": 0,
          "right": 0,
          "top": 168,
          "bottom": 168
        },
        {
          "id": 9,
          "left": 0,
          "right": 0,
          "top": 158,
          "bottom": 158
        },
        {
          "id": 10,
          "left": 0,
          "right": 0,
          "top": 150,
          "bottom": 150
        },
        {
          "id": 11,
          "left": 0,
          "right": 0,
          "top": 140,
          "bottom": 140
        },
        {
          "id": 12,
          "left": 0,
          "right": 0,
          "top": 130,
          "bottom": 130
        },
        {
          "id": 13,
          "left": 0,
          "right": 0,
          "top": 122,
          "bottom": 122
        },
        {
          "id": 14,
          "left": 0,
          "right": 0,
          "top": 114,
          "bottom": 114
        },
        {
          "id": 15,
          "left": 0,
          "right": 0,
          "top": 104,
          "bottom": 104
        },
        {
          "id": 16,
          "left": 0,
          "right": 0,
          "top": 94,
          "bottom": 94
        },
        {
          "id": 17,
          "left": 0,
          "right": 0,
          "top": 86,
          "bottom": 86
        },
        {
          "id": 18,
          "left": 0,
          "right": 0,
          "top": 76,
          "bottom": 76
        },
        {
          "id": 19,
          "left": 0,
          "right": 0,
          "top": 68,
          "bottom": 68
        },
        {
          "id": 20,
          "left": 0,
          "right": 0,
          "top": 58,
          "bottom": 58
        },
        {
          "id": 21,
          "left": 0,
          "right": 0,
          "top": 50,
          "bottom": 50
        },
        {
          "id": 22,
          "left": 0,
          "right": 0,
          "top": 40,
          "bottom": 40
        },
        {
          "id": 23,
          "left": 0,
          "right": 0,
          "top": 30,
          "bottom": 30
        },
        {
          "id": 24,
          "left": 0,
          "right": 0,
          "top": 22,
          "bottom": 22
        },
        {
          "id": 25,
          "left": 0,
          "right": 0,
          "top": 14,
          "bottom": 14
        }
        ],
        "edits": {
          "all": 0,
          "3260-16248": 1,
          "17427-35823": 1,
          "38206-39001": 1,
          "39002-39002": 2,
          "39003-39003": 3,
          "39004-39004": 4,
          "40640-60260": 1,
          "61592-95714": 1,
          "96264-112299": 1,
          "112300-112300": 5,
          "112301-112301": 6,
          "112302-112302": 7,
          "112303-112303": 8,
          "112304-112304": 9,
          "112305-112305": 10,
          "112306-112306": 11,
          "112307-112307": 12,
          "112308-112308": 13,
          "112309-112309": 14,
          "112310-112310": 15,
          "112311-112311": 16,
          "112312-112312": 17,
          "112313-112313": 18,
          "112314-112314": 19,
          "112315-112315": 20,
          "112316-112316": 21,
          "112317-112317": 22,
          "112318-112318": 23,
          "112319-112319": 24,
          "112320-112320": 25,
          "112321-112321": 4,
          "141754-158601": 1,
          "159672-169839": 1
        }
    }
}

[GodzilaAvenger]

I didn't check every value but overall looks good to me, you can try it out and then verify with the FILEINFO tool, then adjust values if needed.

[DarkRepaer]

Originally Posted by GodzilaAvenger

I didn't check every value but overall looks good to me, you can try it out and then verify with the FILEINFO tool, then adjust values if needed.

Everything went as expected! The injection was successful (I'll post the log file). Now all that's missing is playback verification.
Thanks for the help!

powered by quietvoids tools                                                                  Copyright (c) 2021-2024 QfG

                                        ====================================
                                             Dolby Vision Tool INJECTOR
                                        ====================================



 == LOGFILE START =======================================================================================================

23/11/2024  21:41:20,72

 == CUSTOM JSON =========================================================================================================

EditConfig {
  "mode": 0,
  "remove_cmv4": false,
  "remove_mapping": false,
  "active_area": {
    "crop": false,
    "presets": [
      {
        "id": 0,
        "left": 0,
        "right": 0,
        "top": 0,
        "bottom": 0
      },
      {
        "id": 1,
        "left": 0,
        "right": 0,
        "top": 204,
        "bottom": 204
      },
      {
        "id": 2,
        "left": 0,
        "right": 0,
        "top": 138,
        "bottom": 138
      },
      {
        "id": 3,
        "left": 0,
        "right": 0,
        "top": 70,
        "bottom": 70
      },
      {
        "id": 4,
        "left": 0,
        "right": 0,
        "top": 4,
        "bottom": 4
      },
      {
        "id": 5,
        "left": 0,
        "right": 0,
        "top": 194,
        "bottom": 194
      },
      {
        "id": 6,
        "left": 0,
        "right": 0,
        "top": 184,
        "bottom": 184
      },
      {
        "id": 7,
        "left": 0,
        "right": 0,
        "top": 176,
        "bottom": 176
      },
      {
        "id": 8,
        "left": 0,
        "right": 0,
        "top": 168,
        "bottom": 168
      },
      {
        "id": 9,
        "left": 0,
        "right": 0,
        "top": 158,
        "bottom": 158
      },
      {
        "id": 10,
        "left": 0,
        "right": 0,
        "top": 150,
        "bottom": 150
      },
      {
        "id": 11,
        "left": 0,
        "right": 0,
        "top": 140,
        "bottom": 140
      },
      {
        "id": 12,
        "left": 0,
        "right": 0,
        "top": 130,
        "bottom": 130
      },
      {
        "id": 13,
        "left": 0,
        "right": 0,
        "top": 122,
        "bottom": 122
      },
      {
        "id": 14,
        "left": 0,
        "right": 0,
        "top": 114,
        "bottom": 114
      },
      {
        "id": 15,
        "left": 0,
        "right": 0,
        "top": 104,
        "bottom": 104
      },
      {
        "id": 16,
        "left": 0,
        "right": 0,
        "top": 94,
        "bottom": 94
      },
      {
        "id": 17,
        "left": 0,
        "right": 0,
        "top": 86,
        "bottom": 86
      },
      {
        "id": 18,
        "left": 0,
        "right": 0,
        "top": 76,
        "bottom": 76
      },
      {
        "id": 19,
        "left": 0,
        "right": 0,
        "top": 68,
        "bottom": 68
      },
      {
        "id": 20,
        "left": 0,
        "right": 0,
        "top": 58,
        "bottom": 58
      },
      {
        "id": 21,
        "left": 0,
        "right": 0,
        "top": 50,
        "bottom": 50
      },
      {
        "id": 22,
        "left": 0,
        "right": 0,
        "top": 40,
        "bottom": 40
      },
      {
        "id": 23,
        "left": 0,
        "right": 0,
        "top": 30,
        "bottom": 30
      },
      {
        "id": 24,
        "left": 0,
        "right": 0,
        "top": 22,
        "bottom": 22
      },
      {
        "id": 25,
        "left": 0,
        "right": 0,
        "top": 14,
        "bottom": 14
      }
    ],
    "edits": {
      "112309-112309": 14,
      "112321-112321": 4,
      "112310-112310": 15,
      "112314-112314": 19,
      "39004-39004": 4,
      "112301-112301": 6,
      "17427-35823": 1,
      "39002-39002": 2,
      "112305-112305": 10,
      "112306-112306": 11,
      "112313-112313": 18,
      "40640-60260": 1,
      "112312-112312": 17,
      "38206-39001": 1,
      "112308-112308": 13,
      "112315-112315": 20,
      "112320-112320": 25,
      "96264-112299": 1,
      "3260-16248": 1,
      "112303-112303": 8,
      "112311-112311": 16,
      "112317-112317": 22,
      "112319-112319": 24,
      "112304-112304": 9,
      "112316-112316": 21,
      "39003-39003": 3,
      "112300-112300": 5,
      "112302-112302": 7,
      "159672-169839": 1,
      "112307-112307": 12,
      "61592-95714": 1,
      "112318-112318": 23,
      "all": 0,
      "141754-158601": 1
    }
  }
}
Parsing RPU file...
Editing active area offsets...
Final metadata length: 169886
Writing RPU file...

 == LOGFILE END =========================================================================================================

[GodzilaAvenger]

You're welcome

[hidef_rec]

Possible to use HDR info from a 1080p video into making a hybrid 2160p output also using a 2160p DV P5 only video? When I use DDVT_HYBRID, I get a 1080p output, not 2160p. Thanks.

[matey]

Originally Posted by Fuso

I'm currently mux them to Profile 5 with Base HDR/HDR10+, with Codec ID hev1. For many people is not "the way", but for me it does the job for my tv sets.

hi fuso

can you please give me step by step instructions to do this to convert mkv to mp4 to play it on lg c8, i tried but it doesn't work. also please let me know which version of the software you use?

thanks

[-QfG-]

-v0.64
*Minor Bugfixes.
*ADDED MEDIAINFO script (also quick video check for DV levels, included MEL/FEL analyse).
*ADDED SYNCCHECK (check frames and cropping borders between video and rpu).
*UPDATED dovi_tool to v2.1.3.
*UPDATED hdr10plus_tool to v1.6.1.
*UPDATED mkvtoolnix to v 88.0.0.0.
*UPDATED FFMPEG to 7.1

[-QfG-]

-v0.64.1
*Minor Bugfixes.
*ADDED Custom JSON file directly Support (Injector) (also bin files).
*ADDED RPU Extracting via Demuxer Script. (bin files)
*FIXED Wrong L9 detection with MediaInfo.

[Fuso]

Originally Posted by matey

hi fuso

can you please give me step by step instructions to do this to convert mkv to mp4 to play it on lg c8, i tried but it doesn't work. also please let me know which version of the software you use?

thanks

Sure...

1. I use the latest tsmuxer (Nightly build from 2024-06-06-02-00-53) to extract the video and audio from MKV source.

2. Mux the .hevc and .ec3/.ac3 to profile 5 mp4

this is the script that I use

mp4muxer --dv-profile 5 --input-file 1.hevc --input-video-frame-rate 24000/1001 --input-file 1.ec3 --media-lang eng --output-file MOVIE.mp4
pause

you can change the framerate depending on the source, also the audio file extension to ac3.
I can't remember which version of the mp4muxer I use.

3. Then I rename the output file from .mp4 to .mkv. The output file is profile 5 with codec ID dvhe which will not play on non-DoVi TV like Samsung.

4. I use the DDVT_MKVTOMP4 script to convert the renamed file again to mp4, but this time it will have codec ID hev1.

I'm sure this not the perfect or correct way to do this, but for my needs it's enough.
Maybe someone can tell me a way of directly muxing the video and audio to Profile 5 mp4 with codec ID hev1.