Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion.

Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules.

 

Go Back   Doom9's Forum > Video Encoding > VP9 and AV1

Reply
 
Thread Tools Search this Thread Display Modes
Old 25th September 2018, 21:18   #1021  |  Link
savage747
Registered User
 
Join Date: Mar 2004
Posts: 42
I dusted off my own automated codec testing setup so I can track AV1-development. Of course, objective metrics do not replace subjective testing, but this should still be okay to get some very rough estimates.

The following graph takes about 45 minutes to generate on my Ryzen 2700 (8 cores, 16 threads). To keep things sane, I'm using --cpu-used=4, which is a somwhat "fast" setting.

The modern codecs may perform even better on HD resolutions.
Attached Images
 
savage747 is offline   Reply With Quote
Old 26th September 2018, 00:56   #1022  |  Link
benwaggoner
Moderator
 
Join Date: Jan 2006
Location: Portland, OR
Posts: 4,738
Quote:
Originally Posted by savage747 View Post
I dusted off my own automated codec testing setup so I can track AV1-development. Of course, objective metrics do not replace subjective testing, but this should still be okay to get some very rough estimates.
It can be VERY rough. It would be pretty typical for a new psychovisual feature to result in improved quality AND reduced scores with objective metrics. That is pretty much the defining feature of a psychovisual optimization .

The following graph takes about 45 minutes to generate on my Ryzen 2700 (8 cores, 16 threads). To keep things sane, I'm using --cpu-used=4, which is a somwhat "fast" setting.

Quote:
The modern codecs may perform even better on HD resolutions.
HEVC certainly has a bigger advantage over H.264 at UHD resolutions.

It's hard to say with AV1 since the encoders are so slow that there isn't a substantial corpus of high-quality HD AV1 encodes to evaluate yet. In theory it should also scale well, but today's encoders obviously haven't been able to get a lot of resolution-tuned psychovisual optimization yet.

A whole lot of AV1's discussed capabilities are more informed speculation than anything based on real-world demonstrations of real-world scenarios.
__________________
Ben Waggoner
Principal Video Specialist, Amazon Prime Video

My Compression Book
benwaggoner is offline   Reply With Quote
Old 26th September 2018, 01:36   #1023  |  Link
IgorC
Registered User
 
Join Date: Apr 2004
Posts: 1,315
Would it make sense just drop a bitdepth of 8 bits already? Especially now when AV1 was just realesed. All right, decoder optimizations and hardware support will come anyway.
Yes, 8 bits is faster to encode/decode but banding ruins a major part of quality gains at quite large range of bitrates.

VP9 8-bits vs 10 bits is a day and night difference.
https://sonnati.files.wordpress.com/2016/06/10bit2.png
https://sonnati.wordpress.com/2016/0...ntion-part-ii/

Even VP9/HEVC 10-12bit are already so advanced to produce block-free video even at quite low bitrates.
I wouldn't be surprised if AV1 8 bits would look worse than VP9/HEVC 10-12 bits (or just comparable)
IgorC is offline   Reply With Quote
Old 26th September 2018, 03:28   #1024  |  Link
olduser217
Registered User
 
Join Date: Jun 2015
Posts: 21
Quote:
Originally Posted by marcomsousa View Post
At NAB Conference:

ATEME: Video
Other AOMedia: Video1 Video2 Video3 Video4
Thanks for the video link.
Just curious whether the Ateme demo was done with existing TV hardware (assuming software decoding with ARM based SOC), or the TV was just been used as a display for decoding done with PC.
olduser217 is offline   Reply With Quote
Old 26th September 2018, 08:01   #1025  |  Link
Blue_MiSfit
Derek Prestegard IRL
 
Blue_MiSfit's Avatar
 
Join Date: Nov 2003
Location: Los Angeles
Posts: 5,986
Well, they were using the player in the TV (at least, it looks like the standard LG player UI) - so my guess is a special engineering prototype TV with an FPGA or something in it
Blue_MiSfit is offline   Reply With Quote
Old 26th September 2018, 16:57   #1026  |  Link
benwaggoner
Moderator
 
Join Date: Jan 2006
Location: Portland, OR
Posts: 4,738
Quote:
Originally Posted by IgorC View Post
Would it make sense just drop a bitdepth of 8 bits already? Especially now when AV1 was just realesed. All right, decoder optimizations and hardware support will come anyway.
Yes, 8 bits is faster to encode/decode but banding ruins a major part of quality gains at quite large range of bitrates.

VP9 8-bits vs 10 bits is a day and night difference.
https://sonnati.files.wordpress.com/2016/06/10bit2.png
https://sonnati.wordpress.com/2016/0...ntion-part-ii/

Even VP9/HEVC 10-12bit are already so advanced to produce block-free video even at quite low bitrates.
I wouldn't be surprised if AV1 8 bits would look worse than VP9/HEVC 10-12 bits (or just comparable)
HEVC eliminates most of the 10-bit advantage over 8-bit that H.264 had. If the source doesn’t have banding, you don’t get much new banding even at lower bitrates. I think AV1 should have ballpark similar improvements.

But yeah, it would be great if the “Main” profile for future codecs always supported at least 10-bit. That’s required for HDR, which is quickly becoming mainstream. It’s not like the SoC or GOU vendors are developing 8-bit only decoders anymore, even if some display pipelines are 8-bit RGB. But 10-bit 64-960 4:2:0 Y’CbCr makes for better 0-255 RGB 4:4:4 anyway.
__________________
Ben Waggoner
Principal Video Specialist, Amazon Prime Video

My Compression Book
benwaggoner is offline   Reply With Quote
Old 26th September 2018, 17:01   #1027  |  Link
benwaggoner
Moderator
 
Join Date: Jan 2006
Location: Portland, OR
Posts: 4,738
Quote:
Originally Posted by Blue_MiSfit View Post
Well, they were using the player in the TV (at least, it looks like the standard LG player UI) - so my guess is a special engineering prototype TV with an FPGA or something in it

If it’s a fast 8-core ARM or something, software decode should be feasible, especially if the GPU was leveraged for some operations. Decoder optimization is a LOT easier and faster than encoder optimization, since there is only one right answer for decoding. We’ll have a good idea of the potential performance of AV1 decoders way before we will for encoders.
__________________
Ben Waggoner
Principal Video Specialist, Amazon Prime Video

My Compression Book
benwaggoner is offline   Reply With Quote
Old 28th September 2018, 09:52   #1028  |  Link
blurred
Registered User
 
Join Date: Jul 2016
Posts: 14
Interesting discussion: https://www.reddit.com/r/linux/comme...utube_netflix/

It points some FSF licensing issues from 2010:
- https://www.fsf.org/blogs/community/...p8-for-youtube :"Until we move to free formats, the threat of patent lawsuits and licensing fees hangs over every software developer, video creator, hardware maker, web site and corporation -- including you."

- https://www.fsf.org/blogs/licensing/...d-webm-license : "Unfortunately, the interaction between the copyright license and the patent license made the result GPL-incompatible. Based on the concerns of developers writing GPL-covered software, Google publicly stated that they would take some time to review the WebM license and try to address the community's concerns. Today, they released a revised license, and it is GPL-compatible."
"The most important part of the change is that Google has separated the patent license from the copyright license. Now the copyright license on the software is a totally standard three-clause BSD license, which is clearly compatible with the GPL. The patent license, in turn, provides distributors with permission to exercise all the rights, and meet all the conditions, in the GPL, as required by GPLv2 section 7; and those permissions are consistent with the ones provided by the patent grant in GPLv3 section 11. All this means that developers distributing GPL-covered software can take advantage of the patent license without running afoul of the GPL's conditions, whether they're using GPLv2 or GPLv3."

Does it still apply to AV1?
blurred is offline   Reply With Quote
Old 29th September 2018, 06:43   #1029  |  Link
SmilingWolf
I am maddo saientisto!
 
SmilingWolf's Avatar
 
Join Date: Aug 2018
Posts: 95
MSYS2/GCC 8.2 builds:
av1-1.0.0-692-g16c9affcb: https://mega.nz/#!U1AVFI5R!jPhrtngqf...l8p05ACp9Fn4Ok
dav1d-0.0.1-103-deab253: https://mega.nz/#!xpAHSYwB!hA4Unc81j...3oODqiV3cs3ZP8

dav1d builds are also available here: https://code.videolan.org/videolan/dav1d/pipelines
Cloud button on the right

The first ASM routines for dav1d have been checked in! Time to benchmark again

Last edited by SmilingWolf; 29th September 2018 at 07:05.
SmilingWolf is offline   Reply With Quote
Old 29th September 2018, 19:11   #1030  |  Link
TEB
Registered User
 
Join Date: Feb 2003
Location: Palmcoast of Norway
Posts: 363
Quote:
Originally Posted by olduser217 View Post
I heard that Ateme demonstrated 4k60 AV1 decoding on TV (seems like LG TV) during the recent IBC Show.
Anybody attended the show and saw it?
Yupp saw it, but infact it was a HEVC encoded output from a AV1 source (high bitrate) as far as i know..
TEB is offline   Reply With Quote
Old 30th September 2018, 00:32   #1031  |  Link
Mr_Khyron
Member
 
Mr_Khyron's Avatar
 
Join Date: Nov 2002
Posts: 203
https://www.twoorioles.com/
Quote:
Offering unprecedented compression gains, high video quality and broad industry support, AV1 promises to be the next universal video compression standard. With 20 to 30 percent better quality than VP9 and HEVC, AV1 has buy-in from such technology leaders as Google, Apple, Microsoft, Netflix, Amazon, Intel, Cisco, Facebook and Mozilla. We’re helping to lead the charge with the industry's first commercial encoder for AV1. As part of our EVE (Efficient Video Encoder) family, EVE for AV1 is in beta testing with several industry partners. With our 16 years of video compression innovation, we’re making the promise of AV1 a reality.
https://www.twoorioles.com/eve-for-av1/
Mr_Khyron is offline   Reply With Quote
Old 30th September 2018, 19:28   #1032  |  Link
Mr_Khyron
Member
 
Mr_Khyron's Avatar
 
Join Date: Nov 2002
Posts: 203
Alibaba Cloud Joins the Alliance for Open Media

Quote:
Alibaba Cloud, the cloud computing arm of Alibaba Group, has joined the Alliance for Open Media (AOMedia) as a Promoter member. Alibaba Cloud will collaborate with AOMedia and other industry leaders in pursuit of an open and royalty-free AOMedia video codec, AV1.
https://aomedia.org/alibaba-cloud-jo...or-open-media/
Mr_Khyron is offline   Reply With Quote
Old 1st October 2018, 00:01   #1033  |  Link
benwaggoner
Moderator
 
Join Date: Jan 2006
Location: Portland, OR
Posts: 4,738
I really wish PR and such would stop throwing around this "20-30% better than HEVC and VP9" stuff. There is no way to know if that's achievable or not yet, without mature AV1 encoders. And we know that the best HEVC encoders can outperform the best VP9 encoders by easily 20-30% for real-world scenarios, so a quote assuming VP9 and HEVC are equivalent just invalidates the AV1 comparison.

Honestly, finding real-world scenarios where libvpx can deliver better quality @ bitrate @ perf than x264 is a challenge, although I suspect that's primarily due to x264's massively greater psychovisual tuning and perf optimization efforts, not differences in the bitstream standards.
__________________
Ben Waggoner
Principal Video Specialist, Amazon Prime Video

My Compression Book
benwaggoner is offline   Reply With Quote
Old 1st October 2018, 06:56   #1034  |  Link
NikosD
Registered User
 
Join Date: Aug 2010
Location: Athens, Greece
Posts: 2,901
Quote:
Originally Posted by benwaggoner View Post
I really wish PR and such would stop throwing around this "20-30% better than HEVC and VP9" stuff. There is no way to know if that's achievable or not yet, without mature AV1 encoders...
Honestly, finding real-world scenarios where libvpx can deliver better quality @ bitrate @ perf than x264 is a challenge, although I suspect that's primarily due to x264's massively greater psychovisual tuning and perf optimization efforts, not differences in the bitstream standards.
I think the same could be said for HEVC too compared to AVC.

I remember the days when x265 was claiming 50% more compression for the same quality compared to x264, but you have to dig too much to find such a case, if any.
__________________
Win 10 x64 (19042.572) - Core i5-2400 - Radeon RX 470 (20.10.1)
HEVC decoding benchmarks
H.264 DXVA Benchmarks for all
NikosD is offline   Reply With Quote
Old 1st October 2018, 07:41   #1035  |  Link
olduser217
Registered User
 
Join Date: Jun 2015
Posts: 21
Quote:
Originally Posted by TEB View Post
Yupp saw it, but infact it was a HEVC encoded output from a AV1 source (high bitrate) as far as i know..
Do you mean that the AV1 bitstream was actually transcoded to HEVC stream and then playback using the LG TV?
If this is the case, it seems like the purpose was to showcase the AV1 encoding/transcoding capability rather than decoding of AV1 on existing SOC hardware.

Last edited by olduser217; 1st October 2018 at 07:43.
olduser217 is offline   Reply With Quote
Old 1st October 2018, 07:47   #1036  |  Link
LigH
German doom9/Gleitz SuMo
 
LigH's Avatar
 
Join Date: Oct 2001
Location: Germany, rural Altmark
Posts: 6,746
@olduser217: I understood that the same way...
__________________

New German Gleitz board
MediaFire: x264 | x265 | VPx | AOM | Xvid
LigH is offline   Reply With Quote
Old 1st October 2018, 08:35   #1037  |  Link
marcomsousa
Registered User
 
Join Date: Jul 2018
Posts: 80
Quote:
Originally Posted by olduser217 View Post
Do you mean that the AV1 bitstream was actually transcoded to HEVC stream and then playback using the LG TV?
If this is the case, it seems like the purpose was to showcase the AV1 encoding/transcoding capability rather than decoding of AV1 on existing SOC hardware.
Quote:
Originally Posted by LigH View Post
@olduser217: I understood that the same way...
They are a software company. They have a software solution that permit encoding and transcoding to BIG companies.
So, a big company can (in 2019) store in AV1 format and transcoding to ANY format LIVE.
Or encoding from ANY format to AV1.
At this moment, they are changing their solution to be Public Cloud Server friendly. Changing to microservices architecture capable to scale any number of servers automatically.

PS: They don’t have anything magically, so encoding it’s still slow and expensive.
__________________
AV1 win64 VS2019 builds
Last build here

Last edited by marcomsousa; 1st October 2018 at 11:35.
marcomsousa is offline   Reply With Quote
Old 1st October 2018, 09:38   #1038  |  Link
olduser217
Registered User
 
Join Date: Jun 2015
Posts: 21
Quote:
Originally Posted by marcomsousa View Post
They are a software company. They have a software solution that permit encoding and transcoding to BIG companies.
So, a big company can (in 2019) store in AV1 format and transcoding to ANY format LIVE.
Or encoding from ANY format to AV1.
At this moment, they are changing their solution to be Public Cloud Server friendly. Changing to microservices architecture capable to scale any number of servers automatically.

PS: They don’t have anything magically, soy encoding it’s still slow and expensive.
@marcomsousa @LigH
Thanks for the explanation.

So, for the exhibition, the AV1 bitstream (I heard during the demo, the AV1 source was from an USB thumbdrive which was plugged into the TV) was uploaded to their server and downloaded as HEVC bitstream, then playback from the TV which support HEVC decoding?
olduser217 is offline   Reply With Quote
Old 1st October 2018, 15:16   #1039  |  Link
hajj_3
Registered User
 
Join Date: Mar 2004
Posts: 1,120
Video Dev Days 2018 videos:
https://www.youtube.com/watch?v=1bSsP0Wi46E - AV1: in the end, what got in?
https://www.youtube.com/watch?v=ytsRYKQc6kQ - rav1e: the best rust AV1 encoder
https://www.youtube.com/watch?v=UhIgBdrKyNM - Dav1d: a fast new AV1 decoder

Last edited by hajj_3; 1st October 2018 at 15:48.
hajj_3 is offline   Reply With Quote
Old 1st October 2018, 15:41   #1040  |  Link
marcomsousa
Registered User
 
Join Date: Jul 2018
Posts: 80
Quote:
Originally Posted by hajj_3 View Post
...
Thanks, just add a new dav1d video and labels

Google AOM
  • Chrome (Q4 2018)
  • WebRTC Integration (2019)
  • Android Q (Q3 2019)
  • SOC Hardware (2020)
__________________
AV1 win64 VS2019 builds
Last build here

Last edited by marcomsousa; 1st October 2018 at 17:40.
marcomsousa is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 10:14.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2024, vBulletin Solutions Inc.