Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion.

Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules.

 

Go Back   Doom9's Forum > (HD) DVD, Blu-ray & (S)VCD > DVD & BD Rebuilder

Reply
 
Thread Tools Search this Thread Display Modes
Old 29th July 2020, 07:43   #29761  |  Link
meadrocks
Registered User
 
Join Date: Dec 2006
Location: Long Beach, Ca USA
Posts: 97
Quote:
Originally Posted by jdobbs View Post
That is a really weird one. The only explanation I can see is that somehow either: 1) The PGS files have something off within them (either in the original or created by TSMUXER during demux). or 2) MKVMERGE is somehow misreading the timestamps in the PGS file when it is creating the MKV.
What can I do to help you with this?
meadrocks is offline   Reply With Quote
Old 29th July 2020, 07:51   #29762  |  Link
Lathe
Registered User
 
Lathe's Avatar
 
Join Date: Aug 2005
Posts: 1,014
Quote:
Originally Posted by MrVideo View Post
Normal is in the eye of the beholder.


You got that right, just ask @gonca...




Lathe is offline   Reply With Quote
Old 29th July 2020, 09:02   #29763  |  Link
cartman0208
Registered User
 
Join Date: Jun 2010
Location: Germany
Posts: 131
FOUND IT!

There is a similar problem here which put me to the right direction.
The commandline states "--threads auto" ... that might do for 99% of the systems. But I build that machine mainly for encoding, with 2 Xeon 2699v3, that sum up (with hyperthreading) to 72 threads total.
Every thread of x264 uses a certain amount of RAM, which breaks the memory limitation of 32bit apps

I guess disabling hyperthreading ("--threads 36" is working with 2.8 GB RAM used) will solve the problem for me, but if someone builds a similar system or uses one of the mean AMD Threadrippers, they will also run into that Problem.
[edit] Read a little more: "--threads auto" creates 1.5 times CPU cores threads for encoding... So even with Hyperthreading switched off the encode would fail on my machine

Last edited by cartman0208; 29th July 2020 at 15:17.
cartman0208 is offline   Reply With Quote
Old 29th July 2020, 10:31   #29764  |  Link
Lathe
Registered User
 
Lathe's Avatar
 
Join Date: Aug 2005
Posts: 1,014
Uh, I kinda feel bad asking this amongst the more serious cutting edge stuff that you've been working on here (which I've just been catching up on and is truly amazing guys!) But, it's been a while since I used BDRB and I THOUGHT that I remembered that if you input a file that was not BR compliant, say an MKV file with the dimensions of 1920x800, that BDRB would automatically see that and using AVS would add borders to bring it up to compliance. BUT... maybe once you take that MKV file and put it through TSMuxer to put it into a BDMV folder format and THEN input that into BDRB, apparently it does not seem to do that but even setting the output size slightly smaller (to force re-encoding) the dimensions of the resulting m2ts file are unchanged...???

So, is that the deal then, whatever is INSIDE the BDMV folder is left untouched when inputted into BDRB, and borders are not automatically added?

I'm doing it over now and I simply added the AVS script to add borders, and of course in checking the processing .264 file it is now going to be compliant when it is done. I guess I had always thought that BDRB did that automatically with anything out of specification.
Lathe is offline   Reply With Quote
Old 29th July 2020, 11:05   #29765  |  Link
BuddTX
Registered User
 
Join Date: Mar 2006
Posts: 71
Quote:
Originally Posted by cartman0208 View Post
What preset(s) do you use?
And are your sources UHDs or *normal* BDs?
I cant recall if any DVD's imported into BD-RBD ever failed the "auto crop black borders", I think, from memory, maybe there were a few.

However, I mainly do 1080P Blu-ray sources, using X265 to process the encode.

I rough guess would be about 1 in 10 Blu-ray sources fail when "auto crop black borders" is selected.

Again, "from memory" I think I tested one encode with X264 when one encode failed using X265, and I believe it also failed, so both X265 and X264 failed with "auto crop black borders" selected for that encode.

Next encode that fails, I will try both x264 and x265.
BuddTX is offline   Reply With Quote
Old 29th July 2020, 17:03   #29766  |  Link
jdobbs
Moderator
 
Join Date: Oct 2001
Posts: 20,664
Quote:
Originally Posted by cartman0208 View Post
FOUND IT!

There is a similar problem here which put me to the right direction.
The commandline states "--threads auto" ... that might do for 99% of the systems. But I build that machine mainly for encoding, with 2 Xeon 2699v3, that sum up (with hyperthreading) to 72 threads total.
Every thread of x264 uses a certain amount of RAM, which breaks the memory limitation of 32bit apps

I guess disabling hyperthreading ("--threads 36" is working with 2.8 GB RAM used) will solve the problem for me, but if someone builds a similar system or uses one of the mean AMD Threadrippers, they will also run into that Problem.
[edit] Read a little more: "--threads auto" creates 1.5 times CPU cores threads for encoding... So even with Hyperthreading switched off the encode would fail on my machine
I'll recheck and see if that option is actually necessary. If not I'll remove it, otherwise I'll create a hidden option to remove it.

[Edit] Actually that won't work because the default value is "auto". But... there is a HIDDEN option in BD-RB that will set the number of threads you want to use:

THREADS=n

n is the number of threads to use. The limit is 16. I may have to look at increasing that limit. X264 has a limit of 128, but they say "realistically you should never set it this high".
__________________
Help with development of new apps: Donations.
Website: www.jdobbs.net

Last edited by jdobbs; 29th July 2020 at 17:16.
jdobbs is offline   Reply With Quote
Old 29th July 2020, 17:41   #29767  |  Link
jdobbs
Moderator
 
Join Date: Oct 2001
Posts: 20,664
Quote:
Originally Posted by Lathe View Post
Uh, I kinda feel bad asking this amongst the more serious cutting edge stuff that you've been working on here (which I've just been catching up on and is truly amazing guys!) But, it's been a while since I used BDRB and I THOUGHT that I remembered that if you input a file that was not BR compliant, say an MKV file with the dimensions of 1920x800, that BDRB would automatically see that and using AVS would add borders to bring it up to compliance. BUT... maybe once you take that MKV file and put it through TSMuxer to put it into a BDMV folder format and THEN input that into BDRB, apparently it does not seem to do that but even setting the output size slightly smaller (to force re-encoding) the dimensions of the resulting m2ts file are unchanged...???

So, is that the deal then, whatever is INSIDE the BDMV folder is left untouched when inputted into BDRB, and borders are not automatically added?

I'm doing it over now and I simply added the AVS script to add borders, and of course in checking the processing .264 file it is now going to be compliant when it is done. I guess I had always thought that BDRB did that automatically with anything out of specification.
It is not automatically resized or padded during import. So you can have a pseudo-BD structure (thus the name) that contains a video stream that is not resized to be compliant.

But... when you run a job against that structure, the resizing occurs during reencoding and the output is compliant.
__________________
Help with development of new apps: Donations.
Website: www.jdobbs.net
jdobbs is offline   Reply With Quote
Old 29th July 2020, 21:35   #29768  |  Link
jedihyte
Registered User
 
Join Date: Mar 2010
Posts: 10
Quote:
Originally Posted by Sharc View Post
There is no '3D MVC mkv' option AFAIK. However, the Alternate Movie-only output includes a few options for SBS 3D mkv.
Ok thanks for the info.

Does anyone know how to get around the issue when making BD-25 Full backups of 3D movies without the pixelization/artifacts that show up every second of the playback using software players? (I have not seen the issue using a hardware player). But searching the forum I can see it happens to others, but not sure if there ever was a workaround found?
jedihyte is offline   Reply With Quote
Old 29th July 2020, 22:03   #29769  |  Link
gonca
Registered User
 
Join Date: Jul 2012
Posts: 1,022
Quote:
Originally Posted by Lathe View Post

@AmigaFuture It is really a no-brainer )
It is about your speed
gonca is offline   Reply With Quote
Old 29th July 2020, 22:05   #29770  |  Link
gonca
Registered User
 
Join Date: Jul 2012
Posts: 1,022
Quote:
Originally Posted by Lathe View Post
You got that right, just ask @gonca...
This from a guy that plays with dolls
gonca is offline   Reply With Quote
Old 29th July 2020, 22:19   #29771  |  Link
jdobbs
Moderator
 
Join Date: Oct 2001
Posts: 20,664
Quote:
Originally Posted by jedihyte View Post
Ok thanks for the info.

Does anyone know how to get around the issue when making BD-25 Full backups of 3D movies without the pixelization/artifacts that show up every second of the playback using software players? (I have not seen the issue using a hardware player). But searching the forum I can see it happens to others, but not sure if there ever was a workaround found?
If it only happens on a software player and never on a hardware player, it would lead to to believe that the software player is at fault, not the encode.
__________________
Help with development of new apps: Donations.
Website: www.jdobbs.net
jdobbs is offline   Reply With Quote
Old 29th July 2020, 23:37   #29772  |  Link
meadrocks
Registered User
 
Join Date: Dec 2006
Location: Long Beach, Ca USA
Posts: 97
Howls Moving Castle

Quote:
Originally Posted by meadrocks View Post
What can I do to help you with this?
I also have the same issue with Porco Rosso, Princess Mononoke, and The Iron Giant.

Code:
$ mediainfo  IRON_GIANT.mkv
General
Unique ID                                : 249929721907896038595676073595108680533 (0xBC06B6AAA7854E4A9BA9125D1FA56355)
Complete name                            : IRON_GIANT.mkv
Format                                   : Matroska
Format version                           : Version 2
File size                                : 1.76 GiB
Duration                                 : 2 h 55 min
Overall bit rate                         : 1 438 kb/s
Encoded date                             : UTC 2019-08-01 09:29:38
Writing application                      : mkvmerge v9.7.1 ('Pandemonium') 32bit
Writing library                          : libebml v1.3.4 + libmatroska v1.4.5

Video
ID                                       : 1
Format                                   : HEVC
Format/Info                              : High Efficiency Video Coding
Format profile                           : Main 10@L4@Main
Codec ID                                 : V_MPEGH/ISO/HEVC
Duration                                 : 1 h 26 min
Bit rate                                 : 2 608 kb/s
Width                                    : 1 920 pixels
Height                                   : 1 080 pixels
Display aspect ratio                     : 16:9
Frame rate mode                          : Constant
Frame rate                               : 23.976 (23976/1000) FPS
Original frame rate                      : 23.976 (24000/1001) FPS
Color space                              : YUV
Chroma subsampling                       : 4:2:0
Bit depth                                : 10 bits
Bits/(Pixel*Frame)                       : 0.052
Stream size                              : 1.58 GiB (90%)
Writing library                          : x265 2.8+69-856f056d392e:[Windows][GCC 8.2.0][64 bit] 10bit
Encoding settings                        : cpuid=1111039 / frame-threads=3 / numa-pools=8 / 
wpp / no-pmode / no-pme / no-psnr / no-ssim / log-level=2 / input-csp=1 / input-res=1920x1080 / interlace=0 / 
total-frames=0 / level-idc=0 / 
high-tier=1 / uhd-bd=0 / ref=3 / no-allow-non-conformance / no-repeat-headers / annexb / no-aud / no-hrd / 
info / hash=0 / no-temporal-layers / open-gop / min-keyint=23 / keyint=240 / gop-lookahead=0 / bframes=4 / 
b-adapt=2 / b-pyramid / bframe-bias=0 / rc-lookahead=20 / lookahead-slices=6 / scenecut=40 / radl=0 / 
no-intra-refresh / ctu=64 / min-cu-size=8 / no-rect / no-amp / max-tu-size=32 / tu-inter-depth=1 / tu-intra-depth=1 / 
imit-tu=0 / rdoq-level=0 / dynamic-rd=0.00 / no-ssim-rd / signhide / no-tskip / nr-intra=0 / nr-inter=0 / 
no-constrained-intra / strong-intra-smoothing / max-merge=2 / limit-refs=3 / no-limit-modes / me=1 / subme=2 / 
merange=57 / temporal-mvp / weightp / no-weightb / no-analyze-src-pics / deblock=0:0 / sao / no-sao-non-deblock / 
rd=3 / no-early-skip / rskip / no-fast-intra / no-tskip-fast / no-cu-lossless / no-b-intra / no-splitrd-skip / rdpenalty=0 / psy-rd=2.00 / 
psy-rdoq=0.00 / no-rd-refine / no-lossless / cbqpoffs=0 / crqpoffs=0 / rc=crf / crf=20.0 / qcomp=0.60 / qpstep=4 / stats-write=0 / 
stats-read=0 / ipratio=1.40 / pbratio=1.30 / aq-mode=1 / aq-strength=1.00 / cutree / zone-count=0 / no-strict-cbr / qg-size=32 / 
no-rc-grain / qpmax=69 / qpmin=0 / no-const-vbv / sar=0 / overscan=0 / videoformat=5 / range=0 / colorprim=2 / 
transfer=2 / colormatrix=2 / chromaloc=0 / display-window=0 / max-cll=0,0 / min-luma=0 / max-luma=1023 / log2-max-poc-lsb=8 / 
vui-timing-info / vui-hrd-info / slices=1 / no-opt-qp-pps / no-opt-ref-list-length-pps / no-multi-pass-opt-rps / scenecut-bias=0.05 / n
o-opt-cu-delta-qp / no-aq-motion / no-hdr / no-hdr-opt / no-dhdr10-opt / no-idr-recovery-sei / analysis-reuse-level=5 / 
scale-factor=0 / refine-intra=0 / refine-inter=0 / refine-mv=0 / no-limit-sao / ctu-info=0 / no-lowpass-dct / refine-mv-type=0 / c
opy-pic=1 / max-ausize-factor=1.0 / no-dynamic-refine / no-single-sei
Default                                  : Yes
Forced                                   : No

Audio
ID                                       : 2
Format                                   : AAC LC
Format/Info                              : Advanced Audio Codec Low Complexity
Codec ID                                 : A_AAC-2
Duration                                 : 1 h 26 min
Bit rate                                 : 288 kb/s
Channel(s)                               : 6 channels
Channel layout                           : C L R Ls Rs LFE
Sampling rate                            : 48.0 kHz
Frame rate                               : 46.875 FPS (1024 SPF)
Compression mode                         : Lossy
Stream size                              : 176 MiB (10%)
Language                                 : English
Default                                  : Yes
Forced                                   : No

Text
ID                                       : 3
Format                                   : PGS
Muxing mode                              : zlib
Codec ID                                 : S_HDMV/PGS
Codec ID/Info                            : Picture based subtitle format used on BDs/HD-DVDs
Duration                                 : 2 h 54 min
Bit rate                                 : 5 781 b/s
Count of elements                        : 2448
Stream size                              : 7.22 MiB (0%)
Language                                 : English
Default                                  : No
Forced                                   : No

Menu
00:00:00.000                             : en:00:00:00.000
00:02:26.896                             : en:00:02:26.896
00:06:11.537                             : en:00:06:11.537
00:08:58.454                             : en:00:08:58.454
00:10:31.339                             : en:00:10:31.339
00:12:47.558                             : en:00:12:47.558
00:14:53.934                             : en:00:14:53.934
00:16:23.899                             : en:00:16:23.899
00:18:17.054                             : en:00:18:17.054
00:20:36.401                             : en:00:20:36.401
00:23:53.682                             : en:00:23:53.682
00:25:47.504                             : en:00:25:47.504
00:27:55.465                             : en:00:27:55.465
00:29:57.045                             : en:00:29:57.045
00:32:19.979                             : en:00:32:19.979
00:33:42.395                             : en:00:33:42.395
00:36:11.711                             : en:00:36:11.711
00:37:54.188                             : en:00:37:54.188
00:40:22.711                             : en:00:40:22.711
00:44:04.808                             : en:00:44:04.808
00:45:51.415                             : en:00:45:51.415
00:48:07.968                             : en:00:48:07.968
00:50:33.405                             : en:00:50:33.405
00:52:33.108                             : en:00:52:33.108
00:54:04.366                             : en:00:54:04.366
00:58:31.132                             : en:00:58:31.132
01:01:27.517                             : en:01:01:27.517
01:03:42.443                             : en:01:03:42.443
01:05:36.140                             : en:01:05:36.140
01:09:03.347                             : en:01:09:03.347
01:10:19.256                             : en:01:10:19.256
01:14:00.394                             : en:01:14:00.394
01:16:40.762                             : en:01:16:40.762
01:19:28.513                             : en:01:19:28.513
01:26:38.818                             : en:01:26:38.818
meadrocks is offline   Reply With Quote
Old 30th July 2020, 00:23   #29773  |  Link
gonca
Registered User
 
Join Date: Jul 2012
Posts: 1,022
Can you retry without the subtitles
and if possible post a before and after subtitle file
gonca is offline   Reply With Quote
Old 30th July 2020, 10:09   #29774  |  Link
cartman0208
Registered User
 
Join Date: Jun 2010
Location: Germany
Posts: 131
Quote:
Originally Posted by jdobbs View Post
I'll recheck and see if that option is actually necessary. If not I'll remove it, otherwise I'll create a hidden option to remove it.

[Edit] Actually that won't work because the default value is "auto". But... there is a HIDDEN option in BD-RB that will set the number of threads you want to use:

THREADS=n

n is the number of threads to use. The limit is 16. I may have to look at increasing that limit. X264 has a limit of 128, but they say "realistically you should never set it this high".
I set it to 16, but the CPU utilization is now around 20% at the most.
Changing values of MULTIPROCESS doesn't make it faster.
Even 36 threads don't use more CPU

Guess I'll have to go with that
cartman0208 is offline   Reply With Quote
Old 30th July 2020, 15:55   #29775  |  Link
BuddTX
Registered User
 
Join Date: Mar 2006
Posts: 71
Quote:
Originally Posted by BuddTX View Post
I cant recall if any DVD's imported into BD-RBD ever failed the "auto crop black borders", I think, from memory, maybe there were a few.

However, I mainly do 1080P Blu-ray sources, using X265 to process the encode.

I rough guess would be about 1 in 10 Blu-ray sources fail when "auto crop black borders" is selected.

Again, "from memory" I think I tested one encode with X264 when one encode failed using X265, and I believe it also failed, so both X265 and X264 failed with "auto crop black borders" selected for that encode.

Next encode that fails, I will try both x264 and x265.
Forgot to add, that I create, almost exclusively, MKV Files.
BuddTX is offline   Reply With Quote
Old 31st July 2020, 04:35   #29776  |  Link
Lathe
Registered User
 
Lathe's Avatar
 
Join Date: Aug 2005
Posts: 1,014
Quote:
Originally Posted by jdobbs View Post
It is not automatically resized or padded during import. So you can have a pseudo-BD structure (thus the name) that contains a video stream that is not resized to be compliant.

But... when you run a job against that structure, the resizing occurs during reencoding and the output is compliant.
Thanks kindly for the answer JD, but I must not be understanding you correctly because I THOUGHT that is exactly what I just did. I used the non-compliant BDMV folder (containing the TSMuxer muxed MKV file still at 1920x800) and BDRB did re-encode it, but the resulting BDMV folder and thus the m2ts file inside it STILL was the non-compliant AR of 1920x800, nothing changed.

What am I missing here...?
Lathe is offline   Reply With Quote
Old 31st July 2020, 04:36   #29777  |  Link
Lathe
Registered User
 
Lathe's Avatar
 
Join Date: Aug 2005
Posts: 1,014
Quote:
Originally Posted by gonca View Post
This from a guy that plays with dolls
Well, at least I am procreating within my species...
Lathe is offline   Reply With Quote
Old 31st July 2020, 04:40   #29778  |  Link
Lathe
Registered User
 
Lathe's Avatar
 
Join Date: Aug 2005
Posts: 1,014
Just in addition...

So, what I ended up doing was re-running the exact same job with BDRB, but this time adding the AVS code for 'add borders', so yes this time the borders were added to the re-encode just fine. BUT... I had thought that BDRB detected that automatically and that you didn't need to add the AVS code.
Lathe is offline   Reply With Quote
Old 31st July 2020, 05:15   #29779  |  Link
meadrocks
Registered User
 
Join Date: Dec 2006
Location: Long Beach, Ca USA
Posts: 97
Howls Moving Castle

Quote:
Originally Posted by meadrocks View Post
What can I do to help you with this?
In alternate.txt I copied my MKV entry to the end, 00041, changed ctype from 1 to 5,
ran it, but it still created a mkv file and mediainfo reports the General->Format to be Matroska. I was curious to see if the mp4 container fixed the Duration problems that the mkv seems to have.
meadrocks is offline   Reply With Quote
Old 31st July 2020, 21:05   #29780  |  Link
cartman0208
Registered User
 
Join Date: Jun 2010
Location: Germany
Posts: 131
Quote:
Originally Posted by meadrocks View Post
In alternate.txt I copied my MKV entry to the end, 00041, changed ctype from 1 to 5,
ran it, but it still created a mkv file and mediainfo reports the General->Format to be Matroska. I was curious to see if the mp4 container fixed the Duration problems that the mkv seems to have.
Did you try Subtitle Edit to check out the Subtitles?

I can confirm that x265 only results in MKVs, even if MP4 is requested as container.
x264 seems to output the correct container.
cartman0208 is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 06:47.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2020, vBulletin Solutions Inc.