Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion. Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules. |
|
|
Thread Tools | Search this Thread | Display Modes |
13th October 2019, 19:08 | #17522 | Link |
Registered User
Join Date: Nov 2013
Posts: 577
|
Sometimes I have problems with dtsma sources.
Sometimes they recognized with faulty channel numbers, sometimes they are demuxed and after being chosen from the list relevant parameters and even profiles are not loaded at all. So I have to ignore them as a source stream. Is there a solution for this yet? |
13th October 2019, 21:42 | #17523 | Link | ||
Registered User
Join Date: Jun 2018
Posts: 34
|
Quote:
Quote:
|
||
16th October 2019, 01:27 | #17524 | Link |
Grumpy Old Man.
Join Date: Jul 2019
Location: Out There....
Posts: 692
|
I noticed another small auto update today (just core.exe). A change to the command script, cmd features/control.
A lot of time seems to be getting spent on this script for when a job is completed...I for one don't really get the idea behind this, I think someone requested a feature for deleting completed jobs..... If that's basically what it's for, I would prefer to do it manually !! And what of my simple feature request, on RB gui's main window, the current core version/build is displayed (for quick reference)
__________________
Not poorly done, just doin' it my way !!! Live every day like it's your last, because one day, it will be !! (M$B) |
16th October 2019, 04:58 | #17525 | Link | ||
Grumpy Old Man.
Join Date: Jul 2019
Location: Out There....
Posts: 692
|
Quote:
Quote:
I was only about an hour from it starting the muxing process, and the SSD I was using for the Temp files, ran out of space. It was "only" 120Gb, and with the ONE movie to process, filled it up So will have to re-think the setup, and start all over again Regardless of that problem, I noticed that earlier on during the chunks being processed, that randomly a chunk would just "reset", and start again from 0%, so all it had processed up to that point, was lost. So I turned off the re connect option, and it seemed to be OK, so something in the workings of that, seems to create a problem, unless there's a brief hiccup in the network connection.
__________________
Not poorly done, just doin' it my way !!! Live every day like it's your last, because one day, it will be !! (M$B) |
||
16th October 2019, 05:07 | #17526 | Link |
Grumpy Old Man.
Join Date: Jul 2019
Location: Out There....
Posts: 692
|
Remote Server shut down option from main client..
Would it be too much to ask if you could implement an option where you could send a shut down/kill command thru to an individual server's IP address, when ever you wanted or needed to ??
Preferably within the Encoding Client window/screen. Very handy when the servers are elsewhere !! Separate to the shut down options at the end of an encode.
__________________
Not poorly done, just doin' it my way !!! Live every day like it's your last, because one day, it will be !! (M$B) |
16th October 2019, 19:37 | #17527 | Link | ||
ByteShare
Join Date: Sep 2014
Location: On the Internet
Posts: 560
|
Quote:
Personally I go for looks 95% precieved quality, so I don't have any good settings for you to start with. That said, if you are using filters like MDGrain2, IMO you shouldn't worry about the bitrate because you're going to be chopping out a lot with that so you should just use CRF12 or so from what it I'm guessing you like. If you are using constant bitrate with MDegrain2 and it is set higher/same as source you're wasting bits. If you're going to use constant bitrate without filters I'd set it a little lower than source at least and do 2pass and you'll likely get something 99.9999% the same if you can even see a difference (depending on your settings). Some HEVC settings do bluring, slight denoise/dehalo type stuff so if it isn't looking close to the source your settings are the issue. From the sounds of it you need a bigger SSD, guessing at least 500GB or more. As for upscaling the way you want to do it isn't a problem since you'd do the filters either before or after the upscale and upscale all in one job, then encode. Quote:
You can do a lot with it besides deleting source files. Also, made sure when a lot of jobs fail my drives won't fill up. Settings > [uncheck] Keep jobs after successful conversion |
||
16th October 2019, 19:41 | #17528 | Link |
Registered User
Join Date: Jan 2018
Posts: 16
|
Okay, so today Ripbot updated core (2019.10.15), tried an encode of an MP4 file via adding to batch, but all it does is show "Waiting for file..." in the main window and nothing happens after that. Usually this is the point at which it demuxes etc. I tried it on multiple mp4s, always the same. Looking at the temp folder, the job1 folder is created but no work files are added to it.
|
16th October 2019, 20:01 | #17529 | Link | |
RipBot264 author
Join Date: May 2006
Location: Poland
Posts: 7,815
|
Quote:
__________________
Windows 7 Image Updater - SkyLake\KabyLake\CoffeLake\Ryzen Threadripper |
|
16th October 2019, 22:00 | #17530 | Link |
Registered User
Join Date: Jan 2018
Posts: 16
|
Definitely not. I thought the same thing as well, and used Unlocker on each file to make certain that something had not blocked access to them. They were not opened for reading or writing by anything. I'll reboot my machine in a little while and will try again. Cheers!
|
16th October 2019, 22:53 | #17531 | Link | |
ByteShare
Join Date: Sep 2014
Location: On the Internet
Posts: 560
|
Quote:
If before try deleting the job and remaking it. After the reboot, if you're still having issues try posting the media info. |
|
17th October 2019, 06:53 | #17532 | Link | |
Registered User
Join Date: Jan 2018
Posts: 16
|
Quote:
General Complete name : K:\test.mp4 Format : MPEG-4 Format profile : Base Media Codec ID : isom (isom/iso2/avc1/mp41) File size : 28.7 MiB Duration : 39 s 0 ms Overall bit rate mode : Variable Overall bit rate : 6 166 kb/s Encoded date : UTC 2018-08-04 00:02:07 Tagged date : UTC 2018-08-04 00:02:07 Video ID : 1 Format : AVC Format/Info : Advanced Video Codec Format profile : High@L4.1 Format settings : CABAC / 1 Ref Frames Format settings, CABAC : Yes Format settings, Reference frames : 1 frame Format settings, GOP : M=1, N=30 Codec ID : avc1 Codec ID/Info : Advanced Video Coding Duration : 39 s 0 ms Bit rate mode : Variable Bit rate : 6 162 kb/s Maximum bit rate : 30.7 Mb/s Width : 1 920 pixels Height : 1 080 pixels Display aspect ratio : 16:9 Frame rate mode : Constant Frame rate : 30.000 FPS Color space : YUV Chroma subsampling : 4:2:0 Bit depth : 8 bits Scan type : Progressive Bits/(Pixel*Frame) : 0.099 Stream size : 28.6 MiB (100%) Encoded date : UTC 2018-08-04 00:02:07 Tagged date : UTC 2018-08-04 00:02:07 Color range : Full Color primaries : BT.709 Transfer characteristics : BT.709 Matrix coefficients : BT.709 Codec configuration box : avcC Screenshot of my batch settings attached. EDIT: I added this file as normal (ie not through the Batch mode) and it worked. Normal add probes, demuxes, indexes etc as normal. Distributed encoding works great. Problem seems to be within the batch functionality. Last edited by Dhry; 17th October 2019 at 06:59. |
|
17th October 2019, 12:57 | #17533 | Link | |
Grumpy Old Man.
Join Date: Jul 2019
Location: Out There....
Posts: 692
|
Quote:
Now I know a lot here cannot understand why I'm doing this the way I'm doing, (but that's my choice) so with that aside, what I have documented could impact nearly anyone that is doing 4K HEVC encodes, using Distributed Encoding. So first things, I had an approx 65Gb, @ approx 65Mb/s bitrate movie (John Wick 3). I queued it up, the initial demuxing & indexing of the file, took 27 minutes, using Lsmash. Then the next day, when I started the job, it took a further 15 minutes, before it started encoding, and initiating the DE Servers, and I am ONLY doing the video. So over the next 3 days (3 different encoding session's), probably turned out to be around 12 - 14 hour's using varying different server's in the "encoding farm". Just a foot note, I have a lot of Solar Panels on the roof, and I won't do any long term processing jobs unless I can get it for "free", so that can change from day to day. So, finally, late today, the chunks were all done. So I got the phone out, and started the stop watch, and the combining of the chunks took 10 minutes 30, then the muxing process took a further 15 minutes 30, using SSD's for the Temp folder & where the encode is compiled. I would suggest that this time would be shorter if the bitrate wasn't as high as I had it (1 Pass @ 60,000kb/s), ended up being 59.6Mb/s (Mediainfo). I am yet to mux back in the audio (which I have changed from TrueHD to DTS-MA), and a subtitle track (.srt) So, getting back to a question raised a week or so ago, to have RB to start the next job in the queue, whilst it is combining the chunks, and the final muxing. (Is muxing a single threaded process ?) So observations of "my" process, there is approx 45 minutes where NONE of the DE Server's are being used, when starting a new 4K job, from scratch....then of course the DE Server's are going flat out 'til all the chunks have been completed. Then, hopefully the Client PC is the one left doing the final combining & muxing, which leaves ALL the DE Servers doing nothing for a further 25 or so minutes. So they could be turned off until the next job has actually start encoding, for just over an hour. (Between jobs) So as great as DE is, there can be a LOT of time that the servers aren't doing anything..so if there was a way to have RB to at least start the next job, once the chunks of the previous job were completed, that could save a reasonable amount of time, and power. OR, if there was someway for RB to start the DE servers once the job is about to start encoding, (when the chunks are being created) and maybe shutdown the DE servers once the chunks are done, instead of once the full encode was completed. OR, some option to manually turn the remote DE servers on & off from the Client pc.
__________________
Not poorly done, just doin' it my way !!! Live every day like it's your last, because one day, it will be !! (M$B) |
|
17th October 2019, 13:25 | #17534 | Link | |
RipBot264 author
Join Date: May 2006
Location: Poland
Posts: 7,815
|
Quote:
__________________
Windows 7 Image Updater - SkyLake\KabyLake\CoffeLake\Ryzen Threadripper |
|
17th October 2019, 14:00 | #17535 | Link | |
Grumpy Old Man.
Join Date: Jul 2019
Location: Out There....
Posts: 692
|
Quote:
That's all I had, spare.
__________________
Not poorly done, just doin' it my way !!! Live every day like it's your last, because one day, it will be !! (M$B) Last edited by Pauly Dunne; 17th October 2019 at 14:09. |
|
17th October 2019, 14:18 | #17536 | Link |
Registered User
Join Date: Mar 2011
Posts: 432
|
Use MakeMKV?
Why not just use MakeMKV. Make a MKV with just the video and the audio you want. Then extract the subtitles out, OCR and convert them to SRT/ASS/etc, mux them back in, and your done. Your video quality will be exactly the same as the source. Most smaller than 60Mb/s and some a bit larger. Your finished file will done quicker than ever having to encode. From what I understand, unless you need to degrain, there is no need to re-encode the source.
When I encode, I use CRF18 for x265 and I cannot tell the difference between the original source and my output. Some 4K sources that have a huge amount of grain such as Blade Runner, come out looking far better than the original when using MDegrain2/3. |
17th October 2019, 15:49 | #17537 | Link | |
RipBot264 author
Join Date: May 2006
Location: Poland
Posts: 7,815
|
Quote:
http://www.mediafire.com/file/i630b6...Tester.7z/file Results on my 5 years old 120GB SSD (MLC) It is a command line tool. Use these switches Code:
IOSpeedTester.exe --test-location "X:\" --transfer-size 120GIB --log-file "C:\users\%username%\Desktop\MyLog.csv" Upload MyLog.csv somewhere. full help Code:
IOSpeedTester v1.0 by Atak_Snajpera Syntax: IOSpeedTester [options] Options: --help Show this help text and exit --test-location <string> Folder where test files will be stored --threads <1..64> Number of working threads. [1] --buffer-size <1KiB..64MiB> Write/Read buffer size. [16MiB] --transfer-size <integer> Amount of bytes to transfer. [1GiB] --buffered-io Enables IO buffering in RAM. [Unbuffered] --log-file <string> Log information to specific file. [None] --write-only Performs write test only. [Write+Read] Example usage: Sequential Test with logging to a file IOSpeedTester --test-location "%temp%" --log-file "MyLog.csv" MIN IOPS Test IOSpeedTester --test-location "%temp%" --buffer-size 4KiB MAX IOPS Test IOSpeedTester --test-location "%temp%" --buffer-size 4KiB --threads 64
__________________
Windows 7 Image Updater - SkyLake\KabyLake\CoffeLake\Ryzen Threadripper Last edited by Atak_Snajpera; 17th October 2019 at 15:56. |
|
17th October 2019, 19:08 | #17539 | Link |
ByteShare
Join Date: Sep 2014
Location: On the Internet
Posts: 560
|
I was trying to encode some HDR and I normally don't define the colorprim, transfer, or colormatrix. I also don't use the tone mapping.
I'm getting the error: Code:
x265 [error]: invalid argument: transfer = bt.2020 I tried defining the colorprim, transfer, and colormatrix: Code:
--colorprim bt2020 --transfer bt2020-12 --colormatrix bt2020c Code:
--colorprim bt2020 --transfer bt.2020 constant --colormatrix bt2020c Code:
Encoding started... ""\\SERVER\Ripbot264temp\Tools\ffmpeg\bin\ffmpeg.exe" -loglevel panic -i "\\SERVER\RipBot264temp\job36\Chunks\1.avs" -strict -1 -f yuv4mpegpipe - | "\\SERVER\Ripbot264temp\tools\x265\x265_x64.exe" --seek 0 --colorprim bt2020 --transfer bt.2020 constant --colormatrix bt2020c --crf 22 --fps 24000/1001 --min-keyint 24 --keyint 240 --frames 1405 --sar 1:1 --profile main10 --output-depth 10 --colorprim bt2020 --transfer bt2020-12 --colormatrix bt2020c --aq-mode 3 --ctu 64 --y4m --pools "+" --output "\\SERVER\RipBot264temp\job36\Chunks\1.265" -" x265 [error]: invalid argument: transfer = bt.2020 Media Info: Code:
Video ID : 1 Format : HEVC Format/Info : High Efficiency Video Coding Format profile : Main 10@L6@Main Codec ID : V_MPEGH/ISO/HEVC Duration : 48 min 21 s Bit rate : 64.5 Mb/s Width : 4 096 pixels Height : 2 304 pixels Display aspect ratio : 16:9 Frame rate mode : Constant Frame rate : 23.976 (24000/1001) FPS Color space : YUV Chroma subsampling : 4:2:0 Bit depth : 10 bits Bits/(Pixel*Frame) : 0.285 Stream size : 21.8 GiB (100%) Writing library : x265 2.4+27-e9e574bbed93:[Windows][GCC 6.3.0][64 bit] 10bit Encoding settings : cpuid=1173503 / frame-threads=2 / numa-pools=4 / wpp / no-pmode / no-pme / no-psnr / no-ssim / log-level=2 / input-csp=1 / input-res=4096x2304 / interlace=0 / total-frames=69568 / level-idc=0 / high-tier=1 / uhd-bd=0 / ref=4 / no-allow-non-conformance / no-repeat-headers / annexb / no-aud / no-hrd / info / hash=0 / no-temporal-layers / open-gop / min-keyint=23 / keyint=250 / bframes=8 / b-adapt=2 / b-pyramid / bframe-bias=0 / rc-lookahead=25 / lookahead-slices=4 / scenecut=40 / no-intra-refresh / ctu=64 / min-cu-size=8 / rect / no-amp / max-tu-size=32 / tu-inter-depth=1 / tu-intra-depth=1 / limit-tu=0 / rdoq-level=2 / dynamic-rd=0.00 / no-ssim-rd / signhide / no-tskip / nr-intra=0 / nr-inter=0 / no-constrained-intra / no-strong-intra-smoothing / max-merge=3 / limit-refs=3 / limit-modes / me=3 / subme=3 / merange=57 / temporal-mvp / weightp / no-weightb / no-analyze-src-pics / deblock=-3:-3 / no-sao / no-sao-non-deblock / rd=4 / no-early-skip / rskip / no-fast-intra / no-tskip-fast / no-cu-lossless / no-b-intra / rdpenalty=0 / psy-rd=0.30 / psy-rdoq=2.50 / no-rd-refine / analysis-mode=0 / no-lossless / cbqpoffs=0 / crqpoffs=0 / rc=crf / crf=16.0 / qcomp=0.60 / qpstep=4 / stats-write=0 / stats-read=0 / ipratio=1.40 / pbratio=1.30 / aq-mode=3 / aq-strength=1.00 / cutree / zone-count=0 / no-strict-cbr / qg-size=32 / no-rc-grain / qpmax=69 / qpmin=0 / sar=0 / overscan=0 / videoformat=5 / range=0 / colorprim=9 / transfer=15 / colormatrix=10 / chromaloc=0 / display-window=0 / max-cll=0,0 / min-luma=0 / max-luma=1023 / log2-max-poc-lsb=8 / vui-timing-info / vui-hrd-info / slices=1 / opt-qp-pps / opt-ref-list-length-pps / no-multi-pass-opt-rps / scenecut-bias=0.05 / no-opt-cu-delta-qp / no-aq-motion / hdr / no-hdr-opt / no-dhdr10-opt / refine-level=5 / no-limit-sao / ctu-info=0 Default : Yes Forced : No Color range : Limited Color primaries : BT.2020 Transfer characteristics : BT.2020 (12-bit) Matrix coefficients : BT.2020 constant Last edited by byteshare; 17th October 2019 at 19:13. |
17th October 2019, 19:13 | #17540 | Link |
RipBot264 author
Join Date: May 2006
Location: Poland
Posts: 7,815
|
Send me 100MiB sample with that BT.2020 (12-bit) transfer characteristics.
__________________
Windows 7 Image Updater - SkyLake\KabyLake\CoffeLake\Ryzen Threadripper |
Tags |
264, 265, appletv, avchd, bluray, gui, iphone, ipod, ps3, psp, ripbot264, x264 2-pass, x264 gui, x264_64, x265, xbox360 |
Thread Tools | Search this Thread |
Display Modes | |
|
|