x264 presets, profiles, and tuning system

[Kurtnoise]

ok...

Here is a 1st attempt to create several tunings for some devices.

Any comments ?

[Dark Shikari]

Devices should not be under --tune. There's no reason I can't use --tune film --device ipod.

[MatMaul]

and you seem to override speed settings like --me which has nothing to do with devices compatibility.

[Kurtnoise]

Originally Posted by Dark Shikari

Devices should not be under --tune. There's no reason I can't use --tune film --device ipod.

mmmh...right.

Originally Posted by MatMaul

and you seem to override speed settings like --me which has nothing to do with devices compatibility.

it's because I would like override some default settings...but you can tweak this.

[ACoolie]

Originally Posted by Kurtnoise

mmmh...right.

it's because I would like override some default settings...but you can tweak this.

At most --device settings should perform like --profile. Disable certain options (like b-pyramid, cabac, etc) and limit other options like bframes and references to a certain maximum number.

[Dark Shikari]

Originally Posted by ACoolie

At most --device settings should perform like --profile. Disable certain options (like b-pyramid, cabac, etc) and limit other options like bframes and references to a certain maximum number.

Exactly; device settings should, like profile, guarantee a certain output by overriding all other settings.

[Chengbin]

x264.nl finally updated.

I can't encode anymore. What was different with this build than before? I don't think a change in defaults change the format of the command line.

[kemuri-_9]

the change in defaults also affected some of the command line options to take reverse forms of what they were previously...
i.e.:

--weightb (-w) replaced with --no-weightb    (default is now on)
--8x8dct  (-8) replaced with --no-8x8dct     (default is now on)
--no-psnr      replaced with --psnr          (default is now off)
--no-ssim      replaced with --ssim          (default is now off)
--mixed-refs   replaced with --no-mixed-refs (default is now on)
--progress     replaced with --no-progress   (default is now on)

so if you were using any of the options on the left, you need to remove them from your new command line

[lcx]

^^Also notice the slow-firstpass parameter.
It wasn't clear to me why my 'ref' and some other settings were being ignored in 1st pass until I check looked at x264.c changes

[juGGaKNot]

The refs and level are now automated/resolution right ?

start "encode" /b /low /wait "%mypath%\bin\x264n.exe" --preset slower --tune animation --pass 1 --level %mylevel% --keyint %kint% --min-keyint %mint% --stats "%mypath%\%mpath%\T1\%mymovie%.stats" --bitrate %btratex264% --sar 1:1 --aud --nal-hrd --vbv-bufsize 24000 --vbv-maxrate 24000 --output NUL %myavs%
start "encode" /b /low /wait "%mypath%\bin\x264n.exe" --preset slower --tune animation --pass 2 --level %mylevel% --keyint %kint% --min-keyint %mint% --stats "%mypath%\%mpath%\T1\%mymovie%.stats" --bitrate %btratex264% --sar 1:1 --aud --nal-hrd --vbv-bufsize 24000 --vbv-maxrate 24000 --output "%mypath%\%mpath%\T1\%mymovie%.264" %myavs%

Questions :

The profile is MAIN and not high, how do i force high ?
Is --keyint and --min-keyint needed ? there rounder at fps x 10 / fps in my script

[J_Darnley]

juGGaKNot: The default settings give you a high profile video. If you don't disable the 8x8dct or set main or baseline profiles then it will remain as high profile. If you want a slow first pass then you had better set --slow-firstpass

Chengbin: If you still have problems and want help then you will have to post your command line.

[juGGaKNot]

Originally Posted by J_Darnley

juGGaKNot: The default settings give you a high profile video. If you don't disable the 8x8dct or set main or baseline profiles then it will remain as high profile. If you want a slow first pass then you had better set --slow-firstpass

Chengbin: If you still have problems and want help then you will have to post your command line.

File encoded with those settings :

Format profile : High@L4.0
Format settings, CABAC : Yes
Format settings, ReFrames : 16 frames
Duration : 25s 200ms
Bit rate mode : Variable
Bit rate : 4 406 Kbps
Nominal bit rate : 4 500 Kbps
Maximum bit rate : 7 507 Kbps
Width : 1 148 pixels
Height : 666 pixels
Frame rate : 30.000 fps
Writing library : x264 core 68 r1179M 96e2229
Encoding settings : cabac=1 / ref=16 / deblock=1:1:1 / analyse=0x3:0x133 / me=umh / subme=9 / psy_rd=0.4:0.0 / mixed_ref=1 / me_range=16 / chroma_me=1 / trellis=2 / 8x8dct=1 / cqm=0 / deadzone=21,11 / chroma_qp_offset=-2 / threads=3 / nr=0 / decimate=1 / mbaff=0 / bframes=5 / b_pyramid=0 / b_adapt=2 / b_bias=0 / direct=3 / wpredb=1 / keyint=300 / keyint_min=30 / scenecut=40 / rc=2pass / bitrate=4500 / ratetol=1.0 / qcomp=0.60 / qpmin=10 / qpmax=51 / qpstep=4 / cplxblur=20.0 / qblur=0.5 / vbv_maxrate=20000 / vbv_bufsize=20000 / ip_ratio=1.40 / pb_ratio=1.30 / aq=1:0.60

Encoding X264 First Pass :

avis [info]: 1148x666 @ 30.00 fps (756 frames)
x264 [warning]: width or height not divisible by 16 (1148x666), compression will
suffer.
x264 [info]: using SAR=1/1
x264 [info]: using cpu capabilities: MMX2 SSE2Slow
x264 [info]: profile Main, level 4.0
x264 [info]: slice I:13 Avg QP:19.67 size: 32273
x264 [info]: slice P:293 Avg QP:22.62 size: 28497
x264 [info]: slice B:450 Avg QP:26.24 size: 15198
x264 [info]: consecutive B-frames: 4.6% 40.1% 23.8% 16.2% 8.1% 7.3%
x264 [info]: mb I I16..4: 58.9% 0.0% 41.1%
x264 [info]: mb P I16..4: 36.6% 0.0% 0.0% P16..4: 51.8% 0.0% 0.0% 0.0% 0
.0% skip:11.6%
x264 [info]: mb B I16..4: 13.1% 0.0% 0.0% B16..8: 43.0% 0.0% 0.0% direct:
17.9% skip:26.1% L0:36.8% L1:45.9% BI:17.3%
x264 [info]: final ratefactor: 22.81
x264 [info]: direct mvs spatial:99.6% temporal:0.4%
x264 [info]: coded y,uvDC,uvAC intra:56.1% 57.5% 21.8% inter:32.0% 28.1% 1.5%
x264 [info]: kb/s:4954.9

encoded 756 frames, 6.42 fps, 4955.04 kb/s

Encoding X264 Second Pass :

avis [info]: 1148x666 @ 30.00 fps (756 frames)
x264 [warning]: width or height not divisible by 16 (1148x666), compression will
suffer.
x264 [info]: using SAR=1/1
x264 [warning]: DPB size (16 frames, 18579456 bytes) > level limit (10 frames, 1
2582912 bytes)
x264 [info]: using cpu capabilities: MMX2 SSE2Slow
x264 [info]: profile High, level 4.0
[12.7%] 96/756 frames, 1.67 fps, 1583.70 kb/s, eta 0:06:36

So first pass is main fast, k.

What about the ref ? it did not work

Originally Posted by Dark Shikari

For all encodes, if you don't set your own --ref option and instead use the default or a preset, x264 will automatically lower --ref if the --level you set conflicts with it. If you set --ref explicitly, it will not override what you set.

If i remove --level

Encoding X264 Second Pass :

avis [info]: 1148x666 @ 30.00 fps (756 frames)
x264 [warning]: width or height not divisible by 16 (1148x666), compression will
suffer.
x264 [info]: using SAR=1/1
x264 [info]: using cpu capabilities: MMX2 SSE2Slow
x264 [info]: profile High, level 5.0
[27.0%] 204/756 frames, 1.17 fps, 2143.48 kb/s, eta 0:07:50

LE :

--tune film works fine, animations does not

Encoding X264 First Pass :

avis [info]: 1148x666 @ 30.00 fps (756 frames)
x264 [warning]: width or height not divisible by 16 (1148x666), compression will
suffer.
x264 [info]: using SAR=1/1
x264 [info]: using cpu capabilities: MMX2 SSE2Slow
x264 [info]: profile Main, level 3.2
x264 [info]: slice I:13 Avg QP:18.35 size: 33820
x264 [info]: slice P:310 Avg QP:22.61 size: 27635
x264 [info]: slice B:433 Avg QP:25.91 size: 14609
x264 [info]: consecutive B-frames: 5.1% 42.3% 27.9% 24.8%
x264 [info]: mb I I16..4: 55.0% 0.0% 45.0%
x264 [info]: mb P I16..4: 37.0% 0.0% 0.0% P16..4: 53.1% 0.0% 0.0% 0.0% 0
.0% skip:10.0%
x264 [info]: mb B I16..4: 14.4% 0.0% 0.0% B16..8: 42.8% 0.0% 0.0% direct:
19.1% skip:23.6% L0:35.5% L1:44.7% BI:19.9%
x264 [info]: final ratefactor: 23.09
x264 [info]: direct mvs spatial:99.5% temporal:0.5%
x264 [info]: coded y,uvDC,uvAC intra:59.9% 60.3% 23.1% inter:31.6% 28.8% 1.2%
x264 [info]: kb/s:4867.3

encoded 756 frames, 8.79 fps, 4867.43 kb/s

Encoding X264 Second Pass :

avis [info]: 1148x666 @ 30.00 fps (756 frames)
x264 [warning]: width or height not divisible by 16 (1148x666), compression will
suffer.
x264 [info]: using SAR=1/1
x264 [info]: using cpu capabilities: MMX2 SSE2Slow
x264 [info]: profile High, level 4.0
x264 [info]: slice I:13 Avg QP:18.66 size: 34852
x264 [info]: slice P:310 Avg QP:23.90 size: 23569
x264 [info]: slice B:433 Avg QP:27.19 size: 14211
x264 [info]: consecutive B-frames: 5.1% 42.3% 27.9% 24.8%
x264 [info]: mb I I16..4: 24.4% 70.0% 5.6%
x264 [info]: mb P I16..4: 3.7% 20.3% 1.2% P16..4: 40.4% 13.8% 6.9% 0.1% 0
.0% skip:13.6%
x264 [info]: mb B I16..4: 0.9% 3.9% 0.2% B16..8: 49.5% 2.4% 2.8% direct:
13.4% skip:26.9% L0:47.7% L1:45.8% BI: 6.5%
x264 [info]: 8x8 transform intra:78.9% inter:83.9%
x264 [info]: direct mvs spatial:99.3% temporal:0.7%
x264 [info]: coded y,uvDC,uvAC intra:69.8% 69.9% 25.4% inter:36.4% 35.3% 1.5%
x264 [info]: ref P L0 65.1% 13.7% 7.8% 4.0% 3.3% 2.9% 2.0% 1.3%
x264 [info]: ref B L0 67.1% 13.5% 7.4% 4.3% 3.1% 2.6% 1.9%
x264 [info]: kb/s:4416.8

Writing library : x264 core 68 r1179M 96e2229
Encoding settings : cabac=1 / ref=8 / deblock=1:-1:-1 / analyse=0x3:0x133 / me=umh / subme=9 / psy_rd=1.0:0.2 / mixed_ref=1 / me_range=16 / chroma_me=1 / trellis=2 / 8x8dct=1 / cqm=0 / deadzone=21,11 / chroma_qp_offset=-3 / threads=3 / nr=0 / decimate=1 / mbaff=0 / bframes=3 / b_pyramid=0 / b_adapt=2 / b_bias=0 / direct=3 / wpredb=1 / keyint=300 / keyint_min=30 / scenecut=40 / rc=2pass / bitrate=4500 / ratetol=1.0 / qcomp=0.60 / qpmin=10 / qpmax=51 / qpstep=4 / cplxblur=20.0 / qblur=0.5 / vbv_maxrate=20000 / vbv_bufsize=20000 / ip_ratio=1.40 / pb_ratio=1.30 / aq=1:1.00

echo Encoding X264 First Pass :
echo.
start "encode" /b /low /wait "%mypath%\bin\x264n.exe" --preset slower --tune film --pass 1 --keyint %kint% --min-keyint %mint% --stats "%mypath%\%mpath%\T1\%mymovie%.stats" --bitrate %btratex264% --sar 1:1 --aud --nal-hrd --vbv-bufsize 20000 --vbv-maxrate 20000 --output NUL %myavs%
echo.
echo Encoding X264 Second Pass :
echo.
start "encode" /b /low /wait "%mypath%\bin\x264n.exe" --preset slower --tune film --pass 2 --keyint %kint% --min-keyint %mint% --stats "%mypath%\%mpath%\T1\%mymovie%.stats" --bitrate %btratex264% --sar 1:1 --aud --nal-hrd --vbv-bufsize 20000 --vbv-maxrate 20000 --output "%mypath%\%mpath%\T1\%mymovie%.264" %myavs%

[nurbs]

You didn't bother to post your command line so I can't say for sure, but from the Mediainfo text it looks to me as if you used your own settings and not one of the presets or defaults. Your first pass only works because the refs are automatically lowered there anyway, and of course it's main profile since 8x8dct is on of the settings that gets dropped in first pass.

[juGGaKNot]

i did, see 70 and 72

start "encode" /b /low /wait "%mypath%\bin\x264n.exe" --preset slower --tune animation --pass 1 --keyint %kint% --min-keyint %mint% --stats "%mypath%\%mpath%\T1\%mymovie%.stats" --bitrate %btratex264% --sar 1:1 --aud --nal-hrd --vbv-bufsize 24000 --vbv-maxrate 24000 --output NUL %myavs%
start "encode" /b /low /wait "%mypath%\bin\x264n.exe" --preset slower --tune animation --pass 2 --keyint %kint% --min-keyint %mint% --stats "%mypath%\%mpath%\T1\%mymovie%.stats" --bitrate %btratex264% --sar 1:1 --aud --nal-hrd --vbv-bufsize 24000 --vbv-maxrate 24000 --output "%mypath%\%mpath%\T1\%mymovie%.264" %myavs%

And refs are 16, x264 [warning]: DPB size (16 frames, 18579456 bytes) > level limit (10 frames, 12582912 bytes)

echo Encoding X264 First Pass :
echo.
start "encode" /b /low /wait "%mypath%\bin\x264n.exe" --preset slower --tune film --pass 1 --keyint %kint% --min-keyint %mint% --stats "%mypath%\%mpath%\T1\%mymovie%.stats" --bitrate %btratex264% --sar 1:1 --aud --nal-hrd --vbv-bufsize 20000 --vbv-maxrate 20000 --output NUL %myavs%
echo.
echo Encoding X264 Second Pass :
echo.
start "encode" /b /low /wait "%mypath%\bin\x264n.exe" --preset slower --tune film --pass 2 --keyint %kint% --min-keyint %mint% --stats "%mypath%\%mpath%\T1\%mymovie%.stats" --bitrate %btratex264% --sar 1:1 --aud --nal-hrd --vbv-bufsize 20000 --vbv-maxrate 20000 --output "%mypath%\%mpath%\T1\%mymovie%.264" %myavs%

tune film and it is k

[nurbs]

You shouldn't have 16 refs then because --preset slower only uses 8. Also the mediainfo of your first encode shows plenty of settings different from --preset slower and different from the command line you posted.

[MasterNobody]

Originally Posted by nurbs

You shouldn't have 16 refs then because --preset slower only uses 8. Also the mediainfo of your first encode shows plenty of settings different from --preset slower and different from the command line you posted.

He should because --tune animation:

            else if( !strcasecmp( optarg, "animation" ) )
            {
                param->i_frame_reference = param->i_frame_reference > 1 ? param->i_frame_reference*2 : 1;
                param->i_deblocking_filter_alphac0 = 1;
                param->i_deblocking_filter_beta = 1;
                param->analyse.f_psy_rd = 0.4;
                param->rc.f_aq_strength = 0.6;
                param->i_bframe += 2;
            }

P.S. But it should be reduced if he doesn't specify --ref manualy.

[J_Darnley]

Originally Posted by MasterNobody

P.S. But it should be reduced if he doesn't specify --ref manualy.

But it isn't. I think there is a problem with the automatic ref reduction. The code block enters but doesn't run the reduction because mbs = 0 for the videos I've tried.
[EDIT] This is because the input file has not been opened yet so the width and height are 0.
[EDIT2] Quick patch: http://pastebin.com/d5259ba1a Moves the code block to after the files are opened.

[juGGaKNot]

From the top, new encodes :

film :

--preset slower --tune film --pass 1 --keyint %kint% --min-keyint %mint% --stats "%mypath%\%mpath%\T1\%mymovie%.stats" --bitrate %btratex264% --sar 1:1 --aud --nal-hrd --vbv-bufsize 20000 --vbv-maxrate 20000
--preset slower --tune film --pass 2 --keyint %kint% --min-keyint %mint% --stats "%mypath%\%mpath%\T1\%mymovie%.stats" --bitrate %btratex264% --sar 1:1 --aud --nal-hrd --vbv-bufsize 20000 --vbv-maxrate 20000

CMD :

Encoding X264 Second Pass :

avis [info]: 1148x666 @ 30.00 fps (756 frames)
x264 [warning]: width or height not divisible by 16 (1148x666), compression will
suffer.
x264 [info]: using SAR=1/1
x264 [info]: using cpu capabilities: MMX2 SSE2Slow
x264 [info]: profile High, level 4.0
[51.5%] 389/756 frames, 1.75 fps, 3339.88 kb/s, eta 0:03:29

Output :

Writing library : x264 core 68 r1179M 96e2229
Encoding settings : cabac=1 / ref=8 / deblock=1:-1:-1 / analyse=0x3:0x133 / me=umh / subme=9 / psy_rd=1.0:0.2 / mixed_ref=1 / me_range=16 / chroma_me=1 / trellis=2 / 8x8dct=1 / cqm=0 / deadzone=21,11 / chroma_qp_offset=-3 / threads=3 / nr=0 / decimate=1 / mbaff=0 / bframes=3 / b_pyramid=0 / b_adapt=2 / b_bias=0 / direct=3 / wpredb=1 / keyint=300 / keyint_min=30 / scenecut=40 / rc=2pass / bitrate=4500 / ratetol=1.0 / qcomp=0.60 / qpmin=10 / qpmax=51 / qpstep=4 / cplxblur=20.0 / qblur=0.5 / vbv_maxrate=20000 / vbv_bufsize=20000 / ip_ratio=1.40 / pb_ratio=1.30 / aq=1:1.00

Animation :

--preset slower --tune animation --pass 1 --keyint %kint% --min-keyint %mint% --stats "%mypath%\%mpath%\T1\%mymovie%.stats" --bitrate %btratex264% --sar 1:1 --aud --nal-hrd --vbv-bufsize 20000 --vbv-maxrate 20000
--preset slower --tune animation --pass 2 --keyint %kint% --min-keyint %mint% --stats "%mypath%\%mpath%\T1\%mymovie%.stats" --bitrate %btratex264% --sar 1:1 --aud --nal-hrd --vbv-bufsize 20000 --vbv-maxrate 20000

CMD :

Encoding X264 Second Pass :

avis [info]: 1148x666 @ 30.00 fps (756 frames)
x264 [warning]: width or height not divisible by 16 (1148x666), compression will
suffer.
x264 [info]: using SAR=1/1
x264 [info]: using cpu capabilities: MMX2 SSE2Slow
x264 [info]: profile High, level 5.0
[31.7%] 240/756 frames, 1.04 fps, 2234.92 kb/s, eta 0:08:15

Output :

Writing library : x264 core 68 r1179M 96e2229
Encoding settings : cabac=1 / ref=16 / deblock=1:1:1 / analyse=0x3:0x133 / me=umh / subme=9 / psy_rd=0.4:0.0 / mixed_ref=1 / me_range=16 / chroma_me=1 / trellis=2 / 8x8dct=1 / cqm=0 / deadzone=21,11 / chroma_qp_offset=-2 / threads=3 / nr=0 / decimate=1 / mbaff=0 / bframes=5 / b_pyramid=0 / b_adapt=2 / b_bias=0 / direct=3 / wpredb=1 / keyint=300 / keyint_min=30 / scenecut=40 / rc=2pass / bitrate=4500 / ratetol=1.0 / qcomp=0.60 / qpmin=10 / qpmax=51 / qpstep=4 / cplxblur=20.0 / qblur=0.5 / vbv_maxrate=20000 / vbv_bufsize=20000 / ip_ratio=1.40 / pb_ratio=1.30 / aq=1:0.60

LE :

Originally Posted by J_Darnley

But it isn't. I think there is a problem with the automatic ref reduction. The code block enters but doesn't run the reduction because mbs = 0 for the videos I've tried.
[EDIT] This is because the input file has not been opened yet so the width and height are 0.
[EDIT2] Quick patch: http://pastebin.com/d5259ba1a Moves the code block to after the files are opened.

So when i force level 4.0 it will adjust the refs auto now not to break the level limit right ?

[Dark Shikari]

Originally Posted by J_Darnley

But it isn't. I think there is a problem with the automatic ref reduction. The code block enters but doesn't run the reduction because mbs = 0 for the videos I've tried.
[EDIT] This is because the input file has not been opened yet so the width and height are 0.
[EDIT2] Quick patch: http://pastebin.com/d5259ba1a Moves the code block to after the files are opened.

Ah, good point. Will fix.

[me7]

Originally Posted by Dark Shikari

slower:

--me umh --subme 9 --ref 8 --b-adapt 2 --direct auto --partitions all --trellis 2

placebo:

--me tesa --subme 9 --merange 24 --ref 16 --b-adapt 2 --direct auto --partitions all --no-fast-pskip --trellis 2 --bframes 16

You suggest to keep 3 B-frames up to the 'slower' setting and raise the number only for 'placebo'. Are more then 3 B-frames really that useless?