Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion.

Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules.

 

Go Back   Doom9's Forum > Video Encoding > New and alternative video codecs

Reply
 
Thread Tools Search this Thread Display Modes
Old 4th July 2019, 18:07   #1781  |  Link
Ilya87
Registered User
 
Join Date: Feb 2019
Posts: 3
Hi guys, I've desided to make a comparison of x264, rav1e and x265 encoders with 500, 600, 700, 800, 900, 1000 kbit/s with the following settings:

rav1e -b $g --tiles 6 -s 5 --matrix BT470BG /D/sintel/sintel720.y4m --output sintel720_rav1e_s5_$g.ivf
rav1e -b $g --tiles 6 -s 3 --matrix BT470BG /D/sintel/sintel720.y4m --output sintel720_rav1e_s5_$g.ivf
x264 -t 2 -m 11 --me umh --weightp 2 --direct spatial --aq-mode 2 --b-adapt 2 -B $g -b 4 -r 6 -I 240 --b-pyramid normal --no-dct-decimate --no-fast-pskip -A all -o sintel720_x264_$g.264
x265 /D/sintel/sintel720.y4m --y4m -o "Sintel720_x265_$g.h265" --rd 3 -b 4 --b-adapt 2 --b-pyramid --ref 6 -I 240 --bitrate $g --aq-mode 2 --weightp --weightb -m 2 --no-early-skip --psy-rd 1 --me star
where $g stands for bitrate value

My OS is Arch Linux x86_64 and CPU Core i5 8600K, rav1e was build recently and for testing 1191 frames of sintel 1k 16bit (from 12987 to 14177) were taken and converted to 720x306 yuv420p. x265 and x264 are from the distro's repository.

To measure MS-SSIM and PSNR-HVS-M daala's tools were used. To measure VMAF score I used ffmpeg's VMAF filter.

Results:






x265 is a clear winner with 50.59-61.01 fps (lowest to highest bitrate settings)
x264 80.08-102.73 fps
rav1e s3 1.603-2.187 fps
rav1e s5 3.736-4.469 fps

Average CPU utilization of rav1e was 66%-70% (and I couldn't increase it).

Last edited by Ilya87; 4th July 2019 at 23:42.
Ilya87 is offline   Reply With Quote
Old 4th July 2019, 22:44   #1782  |  Link
marcomsousa
Registered User
 
Join Date: Jul 2018
Posts: 50
Intel SVT-AV1 0.6 Released With AV1 Decoding, SIMD Optimizations

https://www.phoronix.com/scan.php?pa...1-0.6-Released
__________________
AV1 win64 VS2017 builds
Last build here | History
I also open source the build scripts at Github: here
marcomsousa is offline   Reply With Quote
Old 4th July 2019, 23:35   #1783  |  Link
Ilya87
Registered User
 
Join Date: Feb 2019
Posts: 3
Quote:
Originally Posted by marcomsousa View Post
Intel SVT-AV1 0.6 Released With AV1 Decoding, SIMD Optimizations

https://www.phoronix.com/scan.php?pa...1-0.6-Released
Still not supported dimensions multiple 2, only 8. Still segfaults. And many other bugs.
Ilya87 is offline   Reply With Quote
Old 7th July 2019, 20:23   #1784  |  Link
benwaggoner
Moderator
 
Join Date: Jan 2006
Location: Portland, OR
Posts: 2,922
Quote:
Originally Posted by Ilya87 View Post
Still not supported dimensions multiple 2, only 8. Still segfaults. And many other bugs.
It is a 0.6 release. I'd expect a smaller set of limitations like that and other issues will still be in 0.7.
__________________
Ben Waggoner
Principal Video Specialist, Amazon Prime Video

My Compression Book
benwaggoner is offline   Reply With Quote
Old 8th July 2019, 05:39   #1785  |  Link
Nintendo Maniac 64
Registered User
 
Nintendo Maniac 64's Avatar
 
Join Date: Nov 2009
Location: Northeast Ohio
Posts: 406
While now a version old, Phoronix tested (on Linux) the encoding performance of SVT-AV1 v0.5 on the new 3rd gen AMD Ryzen 8core (3700X) and 12core (3900X) chips compared to existing Intel CPUs (primarily the 8core 9900K and 16core 7960X):

https://www.phoronix.com/scan.php?pa...0x-linux&num=4
__________________
____HTPC____  | __Desktop PC__
2.93GHz Xeon x3470 (4c/8t Nehalem) | 4.6GHz Pentium G3258 (2c/2t Haswell)
Radeon HD5870  | Intel iGPU      
2x2GB+2x1GB DDR3-1333 | 4x4GB DDR3-1600       

Win7 x64
Nintendo Maniac 64 is offline   Reply With Quote
Old 9th July 2019, 05:46   #1786  |  Link
soresu
Registered User
 
Join Date: May 2005
Location: Swansea, Wales, UK
Posts: 95
Well there goes my bank account down the tubes after seeing those Ryzen 3000 results - roll on september so I can become poor and happy with my 3950X.
soresu is online now   Reply With Quote
Old 10th July 2019, 17:38   #1787  |  Link
benwaggoner
Moderator
 
Join Date: Jan 2006
Location: Portland, OR
Posts: 2,922
Quote:
Originally Posted by Nintendo Maniac 64 View Post
While now a version old, Phoronix tested (on Linux) the encoding performance of SVT-AV1 v0.5 on the new 3rd gen AMD Ryzen 8core (3700X) and 12core (3900X) chips compared to existing Intel CPUs (primarily the 8core 9900K and 16core 7960X):

https://www.phoronix.com/scan.php?pa...0x-linux&num=4
Wow, interesting result! And no way did Intel worry about AMD optimizations when compiling SVT I wonder what the comparison between cpu-tuned x265 and libaom would be like, which should tilt more in AMD's favor.

I note that the top Intel processor used has only half the cores as the top AMD, so this difference could easily be due to multithreading more than per-core performance improvements. But that in no way invalidates the price/performance delta.

Also, and AV1 encoder that's running only ~2.5x slower than a HEVC encoder! Of course, I have no idea if the output quality is similar. As always, the key metric is quality @ bitrate @ performance.
__________________
Ben Waggoner
Principal Video Specialist, Amazon Prime Video

My Compression Book

Last edited by benwaggoner; 10th July 2019 at 17:39. Reason: Used wrong word
benwaggoner is offline   Reply With Quote
Old 10th July 2019, 17:45   #1788  |  Link
benwaggoner
Moderator
 
Join Date: Jan 2006
Location: Portland, OR
Posts: 2,922
Also, I note that the Intel processor used in comparison is from 2017. The current equivalent would probably be the i9-9980XE, which as two more cores and 7% faster clock. That would probably have similar SVT performance to the Threadripper. At more than 2x the price, though (although for an encoding workstation/instance, the CPU is typically less than half the cost).
__________________
Ben Waggoner
Principal Video Specialist, Amazon Prime Video

My Compression Book
benwaggoner is offline   Reply With Quote
Old 10th July 2019, 20:18   #1789  |  Link
SmilingWolf
I am maddo saientisto!
 
SmilingWolf's Avatar
 
Join Date: Aug 2018
Posts: 78
Status report!
"Yes I keep tweaking the params" edition

1st edition: https://forum.doom9.org/showthread.p...49#post1852449
2nd edition: https://forum.doom9.org/showthread.p...87#post1857587
3rd edition: https://forum.doom9.org/showthread.p...75#post1860475
4th edition: https://forum.doom9.org/showthread.p...39#post1871939
Whatever paragraph I don't repeat here can be assumed to be the same as in the aforementioned post

First of all: graphs!
Click to enlarge

Y axis: chosen metric
X axis: bits per pixel

720p:


1080p:


BD rates for 720p:
Code:
Codecs ladder:              |  x264 relative:
x264 -> svtav1              |  x264 -> svtav1
        RATE (%) DSNR (dB)  |          RATE (%) DSNR (dB)
 MSSSIM -10.5381 0.426713   |   MSSSIM -10.5381 0.426713
PSNRHVS -11.296  0.557542   |  PSNRHVS -11.296  0.557542
  HVMAF -19.6867 0.689824   |    HVMAF -19.6867 0.689824
----------------------------|-----------------------------
svtav1 -> vp9               |  x264 -> vp9
        RATE (%) DSNR (dB)  |          RATE (%) DSNR (dB)
 MSSSIM -12.4136 0.464516   |   MSSSIM -24.2802 1.23124
PSNRHVS -13.288  0.615572   |  PSNRHVS -25.1991 1.68477
  HVMAF -14.5152 0.598246   |    HVMAF -26.3686 2.81799
----------------------------|-----------------------------
vp9 -> x265                 |  x264 -> x265
        RATE (%) DSNR (dB)  |          RATE (%) DSNR (dB)
 MSSSIM -1.73618 0.0667664  |   MSSSIM -26.2541 1.24552
PSNRHVS -6.07444 0.298073   |  PSNRHVS -30.4815 1.87719
  HVMAF -9.04578 0.359953   |    HVMAF -31.4265 3.28152
----------------------------|-----------------------------
x265 -> av1                 |  x264 -> av1
        RATE (%) DSNR (dB)  |          RATE (%) DSNR (dB)
 MSSSIM -20.8531 0.881529   |   MSSSIM -39.9238 2.1343
PSNRHVS -16.9627 0.860883   |  PSNRHVS -40.3335 2.76154
  HVMAF -23.5865 1.00102    |    HVMAF -48.1341 3.64521
BD rates for 1080p:
Code:
Codecs ladder:              |  x264 relative:
x264 -> svtav1              |  x264 -> svtav1
        RATE (%) DSNR (dB)  |          RATE (%) DSNR (dB)
 MSSSIM -14.3136 0.452642   |   MSSSIM -14.3136 0.452642
PSNRHVS -10.1078 0.374405   |  PSNRHVS -10.1078 0.374405
  HVMAF -20.4048 0.58988    |    HVMAF -20.4048 0.58988
----------------------------|-----------------------------
svtav1 -> vp9               |  x264 -> vp9
        RATE (%) DSNR (dB)  |          RATE (%) DSNR (dB)
 MSSSIM -19.1279 0.563386   |   MSSSIM -34.6951 1.70828
PSNRHVS -21.5428 0.778635   |  PSNRHVS -33.6391 2.16168
  HVMAF -21.4399 0.750138   |    HVMAF -34.3162 3.93015
----------------------------|-----------------------------
vp9 -> x265                 |  x264 -> x265
        RATE (%) DSNR (dB)  |          RATE (%) DSNR (dB)
 MSSSIM 8.56339 -0.282927   |   MSSSIM -30.5146 1.24699
PSNRHVS 3.02814 -0.139956   |  PSNRHVS -32.9536 1.71646
  HVMAF -3.70741 0.0299945  |    HVMAF -35.6727 3.2304
----------------------------|-----------------------------
x265 -> av1                 |  x264 -> av1
        RATE (%) DSNR (dB)  |          RATE (%) DSNR (dB)
 MSSSIM -28.044  1.00637    |   MSSSIM -47.6676 2.30149
PSNRHVS -23.4583 0.991831   |  PSNRHVS -45.8303 2.79923
  HVMAF -26.6387 0.978822   |    HVMAF -51.9814 3.88658
Encoders:
x264 157-2970-5493be8
x265 3.1-4-4f6dde51a5db
libvpx-vp9 1.8.0-591-g19bda215d
SVT-AV1 0.6.0-1424-8977f443
libaom 1.0.0-2036-ge2c1d5ef8

Cmdlines:
x264 --preset veryslow --tune ssim --crf 16 -o test.x264.crf16.264 orig.i420.y4m
x265 --preset veryslow --tune ssim --crf 16 -o test.x265.crf16.hevc orig.i420.y4m
vpxenc --codec=vp9 --frame-parallel=0 --tile-columns=0 --auto-alt-ref=6 --good --cpu-used=0 --tune=psnr --passes=2 --threads=1 --end-usage=q --cq-level=20 --test-decode=fatal --ivf -o test.vp9.cq20.ivf orig.i420.y4m
SvtAv1EncApp.exe -i orig.i420.yuv -b test.svtav1.cq20.ivf -w 1280 -h 720 -q 20 -enc-mode 3 -fps-num 24000 -fps-denom 1001 -intra-period 23
aomenc --frame-parallel=0 --tile-columns=0 --auto-alt-ref=1 --cpu-used=4 --tune=psnr --passes=2 --threads=2 --row-mt=1 --end-usage=q --cq-level=20 --test-decode=fatal -o test.av1.cq20.webm orig.i420.y4m
VMAF: model used: vmaf_b_v0.6.3, pooling: harmonic_mean, bagging score (arithmetic mean of 21 models' scores)

Notes:
TearsOfSteel720 and TheFifthElement, two clips in the 720p category, had a vertical resolution incompatible with SvtAv1EncApp (not divisible by 8).
They have been padded to 1280x536, so they have been included in this round of measurements again.
Meanwhile, rav1e still has got a nasty bug that makes it bloat encodes, which brings up to 25% BD rate regression, so it has been excluded from this edition.
Again, no time infos because I use the PC while it encodes etc. etc.
If somebody REALLY wants some encoding time infos I can run a battery of encodes under ideal conditions on my favourite 1080p clip (PresageFlowerFight) and report the stats in a followup post (ping @benwaggoner)

This concludes this report.
As always, I'm open to any kind of feedback to improve my comparisons and my encodes.

Last edited by SmilingWolf; 10th July 2019 at 20:25.
SmilingWolf is offline   Reply With Quote
Old 10th July 2019, 20:41   #1790  |  Link
Nintendo Maniac 64
Registered User
 
Nintendo Maniac 64's Avatar
 
Join Date: Nov 2009
Location: Northeast Ohio
Posts: 406
Quote:
Originally Posted by benwaggoner View Post
I note that the top Intel processor used has only half the cores as the top AMD, so this difference could easily be due to multithreading more than per-core performance improvements.
Keep in mind that the 2990WX uses a very nontraditional CPU die topology that makes it more akin to something like a dual-socket system with two full CPUs. It's so nontraditional that you basically need to use Linux to get any semblance of good performance at all (Wendell from level1techs did a good analysis on the subject in this video here).

You can also see from the results that even normal Threadripper like the 12core 2920X (which still uses a somewhat nonstandard die configuration) is getting beaten by the 9900K and 3700X which both use a very traditional CPU core configuration by comparison (one could even argue that the separate I/O die on the 3700X is actually more traditional and is akin to the days of northbridges and external memory controllers ala Athlon XP and Core 2 Duo).


Nevertheless, there could very well be a point of diminishing returns in terms of multicore scalabilty for SVT-AV1 that 32c/64t just isn't seeing the utilization that it could otherwise, and even more-so with such the nontraditional core arrangement of the 2990WX.


Quote:
Originally Posted by benwaggoner View Post
Also, I note that the Intel processor used in comparison is from 2017.
While true, keep in mind that the per-GHz performance on Intel has not changed at all and won't change until their 10nm parts.

Quote:
Originally Posted by benwaggoner View Post
The current equivalent would probably be the i9-9980XE, which as two more cores and 7% faster clock.
The i9-7960X was not the flagship part of its generation - there was in fact an 18core 7980XE during that gen as well (albeit with a bit lower base clock).

This tells me that Phoronix wasn't actually trying to use the highest-end Intel CPU parts that are available, even within a given CPU generation.
__________________
____HTPC____  | __Desktop PC__
2.93GHz Xeon x3470 (4c/8t Nehalem) | 4.6GHz Pentium G3258 (2c/2t Haswell)
Radeon HD5870  | Intel iGPU      
2x2GB+2x1GB DDR3-1333 | 4x4GB DDR3-1600       

Win7 x64
Nintendo Maniac 64 is offline   Reply With Quote
Old 12th July 2019, 23:11   #1791  |  Link
mandarinka
Registered User
 
mandarinka's Avatar
 
Join Date: Jan 2007
Posts: 732
Quote:
Originally Posted by dapperdan View Post
When you say they "declined to participate" did they respond and say they didn't want to take part or did you just not hear from them after making a broad request in a forum post?

I believe the comment above yours saying ("Have you asked?") Is written by a developer of EVE, which suggests they didn't know they'd been asked, so possibly an email has got lost in a spam trap.
I suspect that offer is for Amazon, not for the puproses of this open forum/us plain end users.

Recently somebody asked on AOM IRC whether it would be possible for the Parkjoy encode that Two Orioles showed on the recent conference presentation to be shared/uploaded. They were rejected - by their words the encodes are not actually"classified", but it is "too much work". Take it as you will but it AFAIK there is not a signle public stream or file encoded by their software, out in the open (or am I missing something?), so it might not be a coincidence or something that is gonna change. I don't want this to sound like bashing, but perhaps NDAing all that is the business policy that they want/need/are forced to use by the nature of the field. Few years have passed and I can't see how there was no way some more transparent comparison test couldn't have been arranged one way or another, so I assume they just don't wish to do that. Sharing samples like what Beamr guys did is one way they could brag about their quality without the encoder leaving their hands...

You would probably have to get such sample from streaming/video services who are using the software, when content encoded with Eve appears via them.

Last edited by mandarinka; 12th July 2019 at 23:16.
mandarinka is offline   Reply With Quote
Old 15th July 2019, 23:37   #1792  |  Link
Blue_MiSfit
Derek Prestegard IRL
 
Blue_MiSfit's Avatar
 
Join Date: Nov 2003
Location: Los Angeles
Posts: 5,518
Yeah what the heck, guys! Why can't they release some sample bitstreams of open source content? The pros among us are totally interested in commercial encoders, but only if they can compete honestly.
Blue_MiSfit is offline   Reply With Quote
Old 17th July 2019, 02:31   #1793  |  Link
benwaggoner
Moderator
 
Join Date: Jan 2006
Location: Portland, OR
Posts: 2,922
Quote:
Originally Posted by mandarinka View Post
I suspect that offer is for Amazon, not for the puproses of this open forum/us plain end users.
The shootout is a personal effort of mine, unrelated to my day job. And a direct request for an Eve sample. was made and declined by someone personally familiar with us both.

Quote:
Recently somebody asked on AOM IRC whether it would be possible for the Parkjoy encode that Two Orioles showed on the recent conference presentation to be shared/uploaded. They were rejected - by their words the encodes are not actually"classified", but it is "too much work". Take it as you will but it AFAIK there is not a signle public stream or file encoded by their software, out in the open (or am I missing something?), so it might not be a coincidence or something that is gonna change. I don't want this to sound like bashing, but perhaps NDAing all that is the business policy that they want/need/are forced to use by the nature of the field. Few years have passed and I can't see how there was no way some more transparent comparison test couldn't have been arranged one way or another, so I assume they just don't wish to do that. Sharing samples like what Beamr guys did is one way they could brag about their quality without the encoder leaving their hands...
And Beamr has seen a lot of success. I'm not sure of anyone using Eve in production.

Quote:
You would probably have to get such sample from streaming/video services who are using the software, when content encoded with Eve appears via them.
Do we know of any that have confirmed they are using Eve in production?
__________________
Ben Waggoner
Principal Video Specialist, Amazon Prime Video

My Compression Book
benwaggoner is offline   Reply With Quote
Old 18th July 2019, 09:25   #1794  |  Link
LigH
German doom9/Gleitz SuMo
 
LigH's Avatar
 
Join Date: Oct 2001
Location: Germany, rural Altmark
Posts: 5,896
New uploads: (MSYS2; MinGW32 / MinGW64: GCC 9.1.0)

AOM v1.0.0-2084-g42451f74e

rav1e 0.1.0 (20190430-207-g6ac87d8) built 2019-07-17; new verbose version numbering

dav1d 0.3.1 (2019-07-17, g15a9386)
__________________

New German Gleitz board
MediaFire: x264 | x265 | VPx | AOM | Xvid
LigH is offline   Reply With Quote
Old 24th July 2019, 15:20   #1795  |  Link
IgorC
Registered User
 
Join Date: Apr 2004
Posts: 1,308
AV1 Ecosystem Update: June 2019
https://www.singhkays.com/blog/av1-e...ate-june-2019/
IgorC is offline   Reply With Quote
Old 6th August 2019, 23:13   #1796  |  Link
Spyros
Registered User
 
Join Date: Jun 2019
Posts: 2
dav1d 0.4.0 + FFmpeg 4.2

  • dav1d 0.4.0 'Cheetah' released
    Quote:
    It supports all the AV1 features and all bitdepths.

    0.4.0 brings large improvements in speed on ARM64 (up to 25% speedup) and minor improvements on SSE and ARM. It also improves the RAM usage quite significantly, sometimes more than halving the RAM used.
Spyros is offline   Reply With Quote
Old 8th August 2019, 08:06   #1797  |  Link
LigH
German doom9/Gleitz SuMo
 
LigH's Avatar
 
Join Date: Oct 2001
Location: Germany, rural Altmark
Posts: 5,896
Instead, MABS disabled ffmpeg support for librav1e because the previously working patch doesn't work anymore. I guess the two projects have to find a common and more stable API again.
__________________

New German Gleitz board
MediaFire: x264 | x265 | VPx | AOM | Xvid
LigH is offline   Reply With Quote
Old 8th August 2019, 19:10   #1798  |  Link
Nintendo Maniac 64
Registered User
 
Nintendo Maniac 64's Avatar
 
Join Date: Nov 2009
Location: Northeast Ohio
Posts: 406
Phononix has a new review including more SVT-AV1 v0.5 encoding performance metrics (located ~1/3 the way down the page) as well as dav1d v0.3 decoding performance metrics (located ~2/3 the way down the page); do note that all this testing was conducted on Ubuntu Linux:

https://www.phoronix.com/scan.php?pa...502-7742&num=4

This time they were testing the new Zen2-based AMD Epyc 32core (Epyc 7502) and 64core (Epyc 7742) chips against existing top-end Intel Xeon and AMD Epyc CPUs in both single-socket and dual-socket configurations.




dav1d v0.3 decoding was also included on the performance-per-dollar page, though oddly enough SVT-AV1 was not (scroll down to around half way down the page):

https://www.phoronix.com/scan.php?pa...502-7742&num=9




And in the according forum thread for that review, there's a post containing information for dav1d's decoding performance in fps at both 1080p and 4k as well as frames-per-dollar at 4k:

https://www.phoronix.com/forums/foru...ks#post1118526
__________________
____HTPC____  | __Desktop PC__
2.93GHz Xeon x3470 (4c/8t Nehalem) | 4.6GHz Pentium G3258 (2c/2t Haswell)
Radeon HD5870  | Intel iGPU      
2x2GB+2x1GB DDR3-1333 | 4x4GB DDR3-1600       

Win7 x64
Nintendo Maniac 64 is offline   Reply With Quote
Old 24th August 2019, 12:57   #1799  |  Link
soresu
Registered User
 
Join Date: May 2005
Location: Swansea, Wales, UK
Posts: 95
Github commits on rav1e have been fairly busy recently, any chance we can get a comparative improvement since the last result on this thread?
soresu is online now   Reply With Quote
Old 26th August 2019, 14:11   #1800  |  Link
soresu
Registered User
 
Join Date: May 2005
Location: Swansea, Wales, UK
Posts: 95
I found a gitlab repo for the dav1d GPU acceleration GSoC, seems like SGR and CDEF have been implemented in Vulkan, and the same repo even has a GLES branch.

Link here.

It will be interesting to see if they can get weaker non ASIC SoC's running well by taking advantage of the previously untapped GPU.
soresu is online now   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 04:14.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2019, vBulletin Solutions Inc.