Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion.

Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules.

 

Go Back   Doom9's Forum > Video Encoding > High Efficiency Video Coding (HEVC)

Reply
 
Thread Tools Search this Thread Display Modes
Old 11th November 2019, 16:48   #1  |  Link
Dyomich
Codec Analysis Expert
 
Join Date: Feb 2006
Location: Moscow
Posts: 36
MSU HEVC/AV1 Video Codecs Comparison 2019

MSU Video-Codec Comparison 2019 FullHD and Subjective reports are released http://compression.ru/video/codec_comparison/hevc_2019/

Free versions of the reports are available from direct links (FullHD and Subjective).
If someone is interested in the enterprise version, you can get it with 20% discount before 30/11/19 (use this link or a promo HEVC-NOVEMBER-2019-DN)

This year we used 100 videos for our tests (list of videos and descriptions: http://compression.ru/video/codec_co...19/videos.html)

The winners in objective comparison are:
HW265 (Huawei) by SSIM
Tencent V265 Encoder by VMAF
Best bitrate handling: x264 in fast encoding use-case, HW265 in universal and ripping encoding use-cases
Most often was Pareto-optimal: HW265 in fast encoding use-case, Tencent V265 Encoder in universal, SIF and x264 in ripping use-case.

Results of subjective comparison:


Soon the comparison of cloud transcoding services will be released, and also we will perform 4K and high-quality (including AV1) comparisons this year.
Any feedback is very welcome!
Dyomich is offline   Reply With Quote
Old 11th November 2019, 17:08   #2  |  Link
Tadanobu
Registered User
 
Join Date: Sep 2019
Posts: 36
These reports are always very interesting. Thank you.

I can't wait to see another study with the whole SVT family, libaom, rav1e and all the recent newcomers.
Tadanobu is offline   Reply With Quote
Old 11th November 2019, 17:13   #3  |  Link
Atak_Snajpera
RipBot264 author
 
Atak_Snajpera's Avatar
 
Join Date: May 2006
Location: Poland
Posts: 7,429
I just love when y Axis does not start from 0...

Fixed

Last edited by Atak_Snajpera; 11th November 2019 at 17:59.
Atak_Snajpera is offline   Reply With Quote
Old 11th November 2019, 22:48   #4  |  Link
benwaggoner
Moderator
 
Join Date: Jan 2006
Location: Portland, OR
Posts: 3,280
Is there a detailed description anywhere of the subjective testing methodology?
__________________
Ben Waggoner
Principal Video Specialist, Amazon Prime Video

My Compression Book
benwaggoner is offline   Reply With Quote
Old 12th November 2019, 02:11   #5  |  Link
Emulgator
Big Bit Savings Now !
 
Emulgator's Avatar
 
Join Date: Feb 2007
Location: close to the wall
Posts: 826
Quote:
I just love when y Axis does not start from 0...
Hits me too. I always want to see where zero is.
__________________
"To bypass shortcuts and find suffering...is called QUALity" (Die toten Augen von Friedrichshain)
"Data reduction ? Yep, Sir. We're working on that issue. Synce invntoin uf lingöage..."
Emulgator is offline   Reply With Quote
Old 12th November 2019, 13:40   #6  |  Link
Dyomich
Codec Analysis Expert
 
Join Date: Feb 2006
Location: Moscow
Posts: 36
You can find the description in the PDF of Subjective report 2019

Also, last year we described study method in a separate PDF (2018 subjective study method). This year the methodology was the same, with one difference that the participants of FullHD comparison could use another codec binary and presets for subjective comparison.

Some questions are considered on subjectify.us website. If there are other questions, we can discuss them here
Dyomich is offline   Reply With Quote
Old 13th November 2019, 10:47   #7  |  Link
TEB
Registered User
 
Join Date: Feb 2003
Location: Palmcoast of Norway
Posts: 348
Im curious about the HW and Tencent encoders, are they available for purchase, testing etc?
TEB is offline   Reply With Quote
Old 13th November 2019, 12:00   #8  |  Link
birdie
.
 
birdie's Avatar
 
Join Date: Dec 2006
Posts: 158
WZAurora AV1 codec in case anyone wonders is from https://www.visionular.com
birdie is offline   Reply With Quote
Old 13th November 2019, 12:08   #9  |  Link
birdie
.
 
birdie's Avatar
 
Join Date: Dec 2006
Posts: 158
Their AV1 codec marketing presentation.
birdie is offline   Reply With Quote
Old 14th November 2019, 21:55   #10  |  Link
Capella Systems
Registered User
 
Join Date: Feb 2018
Posts: 2
I couldn't find out from the PDF since it doesn't have the command lines used. But, x264/x265 need different 'tune' for optimizing for PSNR, SSIM or for subjective tests. Were different versions created for the metrics-based tests and for the subjective tests? And if not, what were the settings tuned for?
Capella Systems is offline   Reply With Quote
Old 14th November 2019, 22:41   #11  |  Link
RanmaCanada
Registered User
 
Join Date: May 2009
Posts: 157
I do love how it appears that almost none of these "encoders" are available to the general public.
RanmaCanada is offline   Reply With Quote
Old 21st November 2019, 17:19   #12  |  Link
Dyomich
Codec Analysis Expert
 
Join Date: Feb 2006
Location: Moscow
Posts: 36
Quote:
Originally Posted by Capella Systems View Post
I couldn't find out from the PDF since it doesn't have the command lines used. But, x264/x265 need different 'tune' for optimizing for PSNR, SSIM or for subjective tests. Were different versions created for the metrics-based tests and for the subjective tests? And if not, what were the settings tuned for?
Participants had the ability to send different binaries and preset for objective and subjective comparisons. Regarding x264 and x265, this year they used the same preset for subjective and objective tests. But, our 2017 subjective comparison (http://compression.ru/video/codec_co...subjective.pdf) showed, that '--tune ssim' increases visual quality, so using this option in subjective tests makes sense.
Dyomich is offline   Reply With Quote
Reply

Tags
av1, codec comparison, codec testing, codecs comparison, hevc. h.265

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 03:55.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2020, vBulletin Solutions Inc.