Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion.

Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules.

 

Go Back   Doom9's Forum > Video Encoding > VP9 and AV1

Reply
 
Thread Tools Search this Thread Display Modes
Old 13th September 2018, 07:32   #921  |  Link
SmilingWolf
I am maddo saientisto!
 
SmilingWolf's Avatar
 
Join Date: Aug 2018
Posts: 95
Quote:
Originally Posted by Aleksoid1978 View Post
cmake output - https://pastebin.com/spXmNAJS

CMakeError.log - https://pastebin.com/aPnpqnGF

CMakeOutput.log - https://pastebin.com/JpnNx4Xm

P.S. i think some message test on russian and we can't see it in CMake logs
It's the path

The "++" in "D:/Aleksoid/C++/Source/aom/" create an invalid regular expression that makes some of the cmake tests fail. The AVX2 one just happens to be the first file tested that triggers the problem.
Just rename the path to something like CPP and all the problems should go away

Quote:
Originally Posted by marcomsousa View Post
Yours two patch requests was merge in master, congrats.
Confirming that with these additions the master branch, as of commit 67645b8, compiles and works again with GCC 8.2 without adding any extra C/CXX option on the CMake command line.
Ping @LigH

EDIT:
New build, GCC 8.2 based, no extra C/CXX flags, 32/64bits, HBD/LDB, static libraries included (decoder+encoder, sorry Aleksoid1978 but this solution was simply faster than having 8 different build configs)
av1-1.0.0-566-g67645b8f5: https://mega.nz/#!BsxmTYyJ!dnoSK66uc...7QnZnFkEzEop08

Following the comments on issue 2147 I think I'll drop the CONFIG_LOWBITDEPTH=0 builds from now on
The CONFIG_LOWBITDEPTH=1 ones should work perfectly for 8/10/12 bits video and work faster for 8 bits on top, so no reason to keep the HBD-only builds around

Last edited by SmilingWolf; 14th September 2018 at 06:36.
SmilingWolf is offline   Reply With Quote
Old 13th September 2018, 08:26   #922  |  Link
LigH
German doom9/Gleitz SuMo
 
LigH's Avatar
 
Join Date: Oct 2001
Location: Germany, rural Altmark
Posts: 6,746
Thanks, I noticed via aomedia mail notification. I assume wiiaboo will revert the MABS patch soon.
__________________

New German Gleitz board
MediaFire: x264 | x265 | VPx | AOM | Xvid
LigH is offline   Reply With Quote
Old 13th September 2018, 08:48   #923  |  Link
GTPVHD
Registered User
 
Join Date: Mar 2008
Posts: 175
https://www.youtube.com/playlist?lis...eZUlNUQAVLwrZS

AV1 beta testing on Youtube.
GTPVHD is offline   Reply With Quote
Old 13th September 2018, 10:43   #924  |  Link
Pushman
Registered User
 
Join Date: Nov 2017
Posts: 7
It has very high bitrate now.
Quote:
At time of writing, these transcodes are encoded at a very high bitrate for decoder performance testing.
Pushman is offline   Reply With Quote
Old 13th September 2018, 11:16   #925  |  Link
ChaosKing
Registered User
 
Join Date: Dec 2005
Location: Germany
Posts: 1,795
I can't play the "halo infinite trailer" video (720p) lagfree with mpv. It seems that is uses gpu decoding? bcs cpu is only at max 5%
__________________
AVSRepoGUI // VSRepoGUI - Package Manager for AviSynth // VapourSynth
VapourSynth Portable FATPACK || VapourSynth Database
ChaosKing is offline   Reply With Quote
Old 13th September 2018, 11:42   #926  |  Link
nevcairiel
Registered Developer
 
Join Date: Mar 2010
Location: Hamburg/Germany
Posts: 10,336
There is no GPU decoding for AV1 anywhere yet. But maybe the decoder has a bottleneck somewhere.
__________________
LAV Filters - open source ffmpeg based media splitter and decoders
nevcairiel is offline   Reply With Quote
Old 13th September 2018, 11:43   #927  |  Link
sneaker_ger
Registered User
 
Join Date: Dec 2002
Posts: 5,565
With mpv 2018-09-02 the 720p version of the halo trailer stutters here as well. I'm not sure it is related to shere AV1 decoding performance as LAV nightly (via MPC-HC) decodes completely smooth on i5-2500K with maybe 15% - 30% CPU. (Not that you have told us anything about your hardware ...)
sneaker_ger is offline   Reply With Quote
Old 13th September 2018, 11:45   #928  |  Link
ChaosKing
Registered User
 
Join Date: Dec 2005
Location: Germany
Posts: 1,795
Ryzen 1700 @3.6ghz. gpu Rx480 8GB. I testet it in Chrome 70 now and it is very smooth.
I thought of gpu decoding bcs in the task manager you can see a "GPU 3d" if you show the gpu modules column when playing in mpv.
__________________
AVSRepoGUI // VSRepoGUI - Package Manager for AviSynth // VapourSynth
VapourSynth Portable FATPACK || VapourSynth Database

Last edited by ChaosKing; 13th September 2018 at 11:48.
ChaosKing is offline   Reply With Quote
Old 13th September 2018, 13:43   #929  |  Link
mzso
Registered User
 
Join Date: Oct 2009
Posts: 930
Quote:
Originally Posted by Pushman View Post
It has very high bitrate now.
AKA, decent bitrate.

Sadly, they play nowhere near smoothly on my R5 1600, even though 6/12 cores are utilized to around 30-40%.
mzso is offline   Reply With Quote
Old 13th September 2018, 14:52   #930  |  Link
Gravitator
Registered User
 
Join Date: May 2014
Posts: 292
Quote:
Originally Posted by mzso View Post
AKA, decent bitrate.

Sadly, they play nowhere near smoothly on my R5 1600, even though 6/12 cores are utilized to around 30-40%.
Check how it will be with the disabled SMT/HT?
Gravitator is offline   Reply With Quote
Old 13th September 2018, 15:01   #931  |  Link
clsid
*****
 
Join Date: Feb 2005
Posts: 5,640
It seems to already use only the physical cores by default. So that won't have any effect.
clsid is offline   Reply With Quote
Old 13th September 2018, 22:36   #932  |  Link
TD-Linux
Registered User
 
Join Date: Aug 2015
Posts: 34
Quote:
Originally Posted by sneaker_ger View Post
With mpv 2018-09-02 the 720p version of the halo trailer stutters here as well. I'm not sure it is related to shere AV1 decoding performance as LAV nightly (via MPC-HC) decodes completely smooth on i5-2500K with maybe 15% - 30% CPU. (Not that you have told us anything about your hardware ...)
ffmpeg bug, should be fixed in newer builds of mpv:+ffmpeg: https://git.ffmpeg.org/gitweb/ffmpeg...0015c26f4b09ba
TD-Linux is offline   Reply With Quote
Old 14th September 2018, 05:12   #933  |  Link
Clare
Registered User
 
Join Date: Apr 2016
Posts: 61
Quote:
Originally Posted by TD-Linux View Post
ffmpeg bug, should be fixed in newer builds of mpv:+ffmpeg: https://git.ffmpeg.org/gitweb/ffmpeg...0015c26f4b09ba
Still dropping many frames in 1080p with this commit.
CPU usage is around 10-13%.
Clare is offline   Reply With Quote
Old 14th September 2018, 08:23   #934  |  Link
Nintendo Maniac 64
Registered User
 
Nintendo Maniac 64's Avatar
 
Join Date: Nov 2009
Location: Northeast Ohio
Posts: 447
I just did some performance testing with the 1080p 30fps AV1 encode of the Gus Kenworthy & Tom Wallisch X Games Slopestyle GoPro Preview video in MPC-HC v1.8.1 x64 with its built-in LAVfilters; I originally tried the Halo video but I found the X Games video to be much more demanding (but also much more motion-sick inducing, especially when playing at slower than real-time).

With my 4c/8t Nehalem Xeon x3470 I was only seeing ~25% CPU utilization at maximum even though I was unable to play back the video in real-time (it was somewhere between 16fps and 20fps). Mathematically that should mean that it's only using 2 threads, but disabling SMT and setting my BIOS to only enable 2 cores resulted in noticably worse performance, yet setting the BIOS to enable 3 cores without SMT resulted in the same 16-20fps performance I was originally seeing yet at only ~67% CPU utilization.

At least with the LAVfilters bundled with MPC-HC v1.8.1 x64, it would seem that the AV1 decoder can only utilize 3 cores and no SMT, yet even then the 2 less loaded cores are only hitting around half of their according core's available utilization.


And for reference, the 720p 30fps AV1 encode of that same video played back without a hitch on my Xeon - heck it left enough headroom that I could turn on a bunch of motion interpolation which greatly helped alleviate the motion sickness I got from watching the 1080p AV1 encode playback at sub-20fps frame rates (it's times like this that I thank the devs over at Nintendo for making F-Zero X and F-Zero GX native 60fps games).



Now I'm a bit out-of-the-loop, but I couldn't help but notice that YouTube-DL was using the .MP4 extension for AV1 downloads - is that in fact correct behavior? (and no, I don't mean AVC1, otherwise my PC would have been playing back the videos easy-peasy).

Last edited by Nintendo Maniac 64; 14th September 2018 at 09:15.
Nintendo Maniac 64 is offline   Reply With Quote
Old 14th September 2018, 09:07   #935  |  Link
SmilingWolf
I am maddo saientisto!
 
SmilingWolf's Avatar
 
Join Date: Aug 2018
Posts: 95
Quote:
Originally Posted by Nintendo Maniac 64 View Post
Now I'm a bit out-of-the-loop, but I couldn't help but notice that YouTube-DL was using the .MP4 extension for AV1 downloads - is that in fact correct behavior? (and no, I don't mean AVC1, otherwise my Xeon would have been playing back the videos easy-peasy).
I can only answer to this part: the ISO-BMFF bindings for AV1 have been finalized first (just a few days ago in fact), while the Matroska/WebM ones are still WIP

So MP4-only for the time being

Also:
GCC 8.2, static builds, 32/64bits, CONFIG_LOWBITDEPTH=1
av1-1.0.0-577-g8ae39302e: https://mega.nz/#!14REmAwB!AO8Sta2C3...KVcSKPnnuyEOeI
SmilingWolf is offline   Reply With Quote
Old 14th September 2018, 09:11   #936  |  Link
marcomsousa
Registered User
 
Join Date: Jul 2018
Posts: 80
Quote:
Originally Posted by Nintendo Maniac 64 View Post
I just did some performance testing with the 1080p 30fps AV1 encode of the Gus Kenworthy & Tom Wallisch X Games Slopestyle GoPro Preview video in MPC-HC v1.8.1 x64 with its built-in LAVfilters
I was able to play 1080p with MPC-HC v1.8.1 x64 in real time, with some hitches in middle part of the video.
CPU at 62%
Intel Core i7-8550U (Kaby Lake-R U4+2)

With ffplay.exe 20180912 I play this 1080p video, realy realy slow, but play well the 720p video.


Quote:
Originally Posted by Nintendo Maniac 64 View Post
Now I'm a bit out-of-the-loop, but I couldn't help but notice that YouTube-DL was using the .MP4 extension for AV1 downloads - is that in fact correct behavior?
It's correct, since webm support for av1 isn't finalized. Also youtube-dl download what youtube give, and Youtube have av1 in mp4 container with mp4 schema (av01.0.05M.08).

Last edited by marcomsousa; 14th September 2018 at 10:43.
marcomsousa is offline   Reply With Quote
Old 14th September 2018, 10:59   #937  |  Link
SmilingWolf
I am maddo saientisto!
 
SmilingWolf's Avatar
 
Join Date: Aug 2018
Posts: 95
Quote:
Originally Posted by marcomsousa View Post
With ffplay.exe 20180912 I play this 1080p video, realy realy slow, but play well the 720p video.
ffplay 20180912 is, for whatever reason, a very poor version to test with. Don't know if it depends on the aom library revision used, on the ffmpeg revision, or something in the middle, but on my system it performs at half the perf on my own minimal ffmpeg+aom build

CPU: Intel i7-4770 @ 3.4 GHz

Zeranoe build:
Code:
# ffmpeg -threads 4 -i "Gus Kenworthy & Tom Wallisch X Games Slopestyle GoPro Preview.1080.mp4" -benchmark -f null -
ffmpeg version N-91931-gb69ea742ab Copyright (c) 2000-2018 the FFmpeg developers
  built with gcc 8.2.1 (GCC) 20180813
[libaom-av1 @ 0000000000485ac0] 1.0.0-507-g5d963cb57
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'Gus Kenworthy & Tom Wallisch X Games Slopestyle GoPro Preview.1080.mp4':
frame= 1736 fps= 18 q=-0.0 Lsize=N/A time=00:00:57.92 bitrate=N/A speed=0.602x
video:909kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
bench: utime=95.473s stime=0.187s rtime=96.195s
bench: maxrss=234036kB
My own:
Code:
# ./ffmpeg -threads 4 -i "Gus Kenworthy & Tom Wallisch X Games Slopestyle GoPro Preview.1080.mp4" -benchmark -f null -
ffmpeg version N-91943-g1b98bfb932 Copyright (c) 2000-2018 the FFmpeg developers
  built with gcc 8.2.1 (GCC) 20180913
[libaom-av1 @ 0000000000338500] 1.0.0-577-g8ae39302e
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'Gus Kenworthy & Tom Wallisch X Games Slopestyle GoPro Preview.1080.mp4':
frame= 1736 fps= 37 q=-0.0 Lsize=N/A time=00:00:57.92 bitrate=N/A speed=1.24x
video:909kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
bench: utime=98.234s stime=1.076s rtime=46.544s
bench: maxrss=272452kB
SmilingWolf is offline   Reply With Quote
Old 14th September 2018, 12:09   #938  |  Link
Mr_Khyron
Member
 
Mr_Khyron's Avatar
 
Join Date: Nov 2002
Posts: 203
http://download.opencontent.netflix.com/?prefix=AV1/
Quote:
************** Netflix AV1 Encodes Readme **************************************

This is the readme for the Netflix AV1 Encodes.

The assets covered in this readme can be browsed on the Netflix OpenContent
bucket here:
http://download.opencontent.netflix.com/?prefix=AV1/

Each asset has its license posted to its main directory in the file license.txt.

********** Downloading with AWS CLI ********************************************

You can download single files directly through your web browser on the
OpenContent page, but for large files and long frame sequence, you may wish to
use command line tools such as aws cli.
Detailled instructions are posted here:
http://download.opencontent.netflix....ets/README.txt

********** Encoding and Packaging **********************************************

The IVF files were produced using AOM aomenc (Libaom v1.0) using 2-pass, CQP,
tiles on higher resolutions, and Film Grain. Additionally, the following
parameters were used for all encodes:
--passes=2 --fpf=twopassStats --i420 --profile=0 --arnr-maxframes=7
--arnr-strength=5 --lag-in-frames=25 --aq-mode=0 --bias-pct=100
--minsection-pct=1 --maxsection-pct=10000 --end-usage=q --min-q=0 --max-q=63
--input-bit-depth=[8|10] --cpu-used=1 --auto-alt-ref=1 --max-gf-interval=12
--min-gf-interval=[4|5|6] --frame-parallel=0 --threads=8
--tile-columns=[1|2|4] --ivf

The IVF files were then packaged into (non-fragmented and non-encrypted) MP4
files conforming to https://aomediacodec.github.io/av1-isobmff/using
GPAC's MP4Box (GPAC version 0.7.2-DEV-rev654-gb6f7409ce-master) as follows:

MP4Box -add input.ivf output.mp4

********************************************************************************

Last updated: 2018 Sept 4
Copyright NETFLIX INC.
100 Winchester Circle, Los Gatos, CA 95032, USA
Mr_Khyron is offline   Reply With Quote
Old 14th September 2018, 12:34   #939  |  Link
sneaker_ger
Registered User
 
Join Date: Dec 2002
Posts: 5,565
Screenshots 8 vs 10 bit (8 bit has 40% more bitrate):
Netflix Chimera 8 bit
Netflix Chimera 10 bit

Is this an inherent problem of AV1 8 bit or just because it isn't very tuned yet (bitrate allocation, aq, psy)? Though 10 bit encode also has some problems, those "boxes" on the power lines between the two skyscrapers on the left go missing. Then again 10 bit was given much lower bitrate here ..

Last edited by sneaker_ger; 14th September 2018 at 12:39.
sneaker_ger is offline   Reply With Quote
Old 14th September 2018, 12:43   #940  |  Link
MoSal
Registered User
 
Join Date: Jun 2013
Posts: 94
Quote:
Originally Posted by TD-Linux View Post
ffmpeg bug, should be fixed in newer builds of mpv:+ffmpeg: https://git.ffmpeg.org/gitweb/ffmpeg...0015c26f4b09ba
That's not the (only) issue. Note the decoding bottleneck in this sample five seconds in, at the scene change.
__________________
saldl: a command-line downloader optimized for speed and early preview.
MoSal is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 10:12.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2024, vBulletin Solutions Inc.