Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion.

Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules.

 

Go Back   Doom9's Forum > Capturing and Editing Video > Avisynth Development

Reply
 
Thread Tools Search this Thread Display Modes
Old 19th September 2019, 15:04   #981  |  Link
Atak_Snajpera
RipBot264 author
 
Atak_Snajpera's Avatar
 
Join Date: May 2006
Location: Poland
Posts: 7,338
Quote:
Originally Posted by videoh View Post
Ah, data. Sweet.

If you make available that 10-minute source clip I'd like to try this with a high-end nVidia GPU (2080 Ti) and DGSource() under both Avisynth+ and Vapoursynth (native). Can you please do that for us? Thank you. If you need access to my FTP just send me a PM.

DJATOM says he can't duplicate your effect so it would be nice to get some other data points.
Uploading in progress... Will take probably few hours.

New test with added very useful MDegrain2 (can reduce file size in Constant Quality by factor of 1.7x). I did only 4 tests because it takes way to much time!

ScriptSW.avs
Code:
LoadPlugin("C:\Program Files (x86)\RipBot264\Tools\AviSynth plugins\lsmash\LSMASHSource.dll")
video=LWLibavVideoSource("C:\Temp\Video.mkv",cachefile="C:\Temp\Video.mkv.lwi",prefer_hw=0)
Loadplugin("C:\Program Files (x86)\RipBot264\Tools\AviSynth plugins\mvtools\mvtools2.dll")
super=MSuper(video,pel=2)
fv1=MAnalyse(super,isb=false,delta=1,overlap=4)
bv1=MAnalyse(super,isb=true,delta=1,overlap=4)
fv2=MAnalyse(super,isb=false,delta=2,overlap=4)
bv2=MAnalyse(super,isb=true,delta=2,overlap=4)
video=MDegrain2(video,super,bv1,fv1,bv2,fv2,thSAD=400)
video=Prefetch(video,4)
return video
ScriptHW.avs
Code:
LoadPlugin("C:\Program Files (x86)\RipBot264\Tools\AviSynth plugins\lsmash\LSMASHSource.dll")
video=LWLibavVideoSource("C:\Temp\Video.mkv",cachefile="C:\Temp\Video.mkv.lwi",prefer_hw=1)
Loadplugin("C:\Program Files (x86)\RipBot264\Tools\AviSynth plugins\mvtools\mvtools2.dll")
super=MSuper(video,pel=2)
fv1=MAnalyse(super,isb=false,delta=1,overlap=4)
bv1=MAnalyse(super,isb=true,delta=1,overlap=4)
fv2=MAnalyse(super,isb=false,delta=2,overlap=4)
bv2=MAnalyse(super,isb=true,delta=2,overlap=4)
video=MDegrain2(video,super,bv1,fv1,bv2,fv2,thSAD=400)
video=Prefetch(video,4)
return video

Last edited by Atak_Snajpera; 19th September 2019 at 15:10.
Atak_Snajpera is offline   Reply With Quote
Old 19th September 2019, 15:07   #982  |  Link
videoh
Registered User
 
Join Date: Jul 2014
Posts: 1,069
Atak,

Any chance you can share your stream as I requested?
videoh is offline   Reply With Quote
Old 19th September 2019, 15:13   #983  |  Link
Atak_Snajpera
RipBot264 author
 
Atak_Snajpera's Avatar
 
Join Date: May 2006
Location: Poland
Posts: 7,338
Quote:
Originally Posted by Sparktank View Post
Also, how do you make these graphs?
LibreOffice calc
Atak_Snajpera is offline   Reply With Quote
Old 19th September 2019, 15:14   #984  |  Link
Atak_Snajpera
RipBot264 author
 
Atak_Snajpera's Avatar
 
Join Date: May 2006
Location: Poland
Posts: 7,338
Quote:
Originally Posted by videoh View Post
Atak,

Any chance you can share your stream as I requested?
It is being uploaded right now to mediafire...will take few hours.
Atak_Snajpera is offline   Reply With Quote
Old 19th September 2019, 16:04   #985  |  Link
poisondeathray
Registered User
 
Join Date: Sep 2007
Posts: 4,046
What was the "proper" way to MT GPU filters ?

I remember some issue in the KNLMeans discussion, or videoh mentioning something , but I can't find the posts

If you test just the source filter alone with cuvid, it seems abnormally slow , regardless of the filter MT Mode or prefetch >1 value . Thrashing or something . But seems ok in vapoursynth with native threading
poisondeathray is offline   Reply With Quote
Old 19th September 2019, 16:27   #986  |  Link
Groucho2004
Fossil
 
Groucho2004's Avatar
 
Join Date: Mar 2006
Location: A wretched hive of scum and villainy
Posts: 4,507
Quote:
Originally Posted by poisondeathray View Post
What was the "proper" way to MT GPU filters ?
There is none. There is no speed benefit and it just eats more graphics memory. Modern cards have their own "multi-threading".
__________________
Groucho's Avisynth Stuff
Groucho2004 is offline   Reply With Quote
Old 19th September 2019, 16:38   #987  |  Link
Atak_Snajpera
RipBot264 author
 
Atak_Snajpera's Avatar
 
Join Date: May 2006
Location: Poland
Posts: 7,338
Quote:
Originally Posted by poisondeathray View Post
What was the "proper" way to MT GPU filters ?

I remember some issue in the KNLMeans discussion, or videoh mentioning something , but I can't find the posts

If you test just the source filter alone with cuvid, it seems abnormally slow , regardless of the filter MT Mode or prefetch >1 value . Thrashing or something . But seems ok in vapoursynth with native threading
I recommend putting GPU filters after Prefetch.
Atak_Snajpera is offline   Reply With Quote
Old 19th September 2019, 21:50   #988  |  Link
Atak_Snajpera
RipBot264 author
 
Atak_Snajpera's Avatar
 
Join Date: May 2006
Location: Poland
Posts: 7,338
Quote:
Originally Posted by videoh View Post
Atak,

Any chance you can share your stream as I requested?
http://www.mediafire.com/file/dh86so...video.mkv/file
Atak_Snajpera is offline   Reply With Quote
Old 20th September 2019, 05:16   #989  |  Link
videoh
Registered User
 
Join Date: Jul 2014
Posts: 1,069
Got it. Thank you, Atak.
videoh is offline   Reply With Quote
Old 20th September 2019, 08:45   #990  |  Link
hydra3333
Registered User
 
Join Date: Oct 2009
Location: crow-land
Posts: 534
Quote:
Originally Posted by Sparktank View Post
GTX 1060 3GB checking in.
Well, I have a 3900X/cheapie-2060-Super/vapoursynth-portable/DG-tools/Win10x64, if someone wants to provide a script and a couple of lines outlining how to measure the time. The 3900X is a tad crippled though, with only 2666 RAM awaiting some 3600 to arrive (hence the 3900X infinity fabric is running at 3/4 of "normal").

Last edited by hydra3333; 20th September 2019 at 08:49.
hydra3333 is offline   Reply With Quote
Old 20th September 2019, 11:32   #991  |  Link
DJATOM
Registered User
 
DJATOM's Avatar
 
Join Date: Sep 2010
Location: Ukraine, Bohuslav
Posts: 194
I also have 3900X with Asus ROG Crosshair Hero 7 mobo and 2x 16 GB RAM (OC to 3333 MHz) + RTX2070 (Gigabyte Gaming OC, 3 fans). Unfortunately I don't have much time to tinker with scripts this week, but can run some batches before I'll go to sleep.
__________________
Me on GitHub | My Telegram
PC Specs: Ryzen 3900X (no OC with 250W Air cooling), Asus ROG Crosshair Hero VII (WiFi) @ chipset x470, 32 GB RAM @ 3333MHz OC, Gigabyte RTX 2070, Kingston A1000 @ 240 GB
DJATOM is offline   Reply With Quote
Old 24th September 2019, 15:27   #992  |  Link
Selur
Registered User
 
Selur's Avatar
 
Join Date: Oct 2001
Location: Germany
Posts: 5,929
Using 20190917 I have some problem with a mkv(interlaced avc,wav) using:
Code:
core.lsmas.LWLibavSource(source="Il Silenzio (Melissa Venema) [Live in Maastricht II] (N).mkv", format="YUV420P8", cache=0, prefer_hw=1)
only one frame is returned
using:
Code:
core.lsmas.LWLibavSource(source="Il Silenzio (Melissa Venema) [Live in Maastricht II] (N).mkv", format="YUV420P8", cache=0, prefer_hw=0)
vspipe and vsviewer simply close.
DGSource and FFVideoSource (ffms2 and ffms2k) both work.
Same happens with AvsPmod and avs2yuv when using:
Code:
LWLibavVideoSource("C:\Users\Selur\Desktop\Il Silenzio (Melissa Venema) [Live in Maastricht II] (N).mkv",cache=false,format="YUV420P8", prefer_hw=1)
(only one Frame)
and
Code:
LWLibavVideoSource("C:\Users\Selur\Desktop\Il Silenzio (Melissa Venema) [Live in Maastricht II] (N).mkv",cache=false,format="YUV420P8", prefer_hw=0)
program closes.
(as expected using prefer_hw=3 also returns one frame)

Uploaded the source to my GoogleDrive.
(Using Ryzen 7 1800X, Windows 10, 32GB RAM, GeForce GTX 1070Ti in case it helps.)

Cu Selur
__________________
Hybrid here in the forum, homepage
Notice: Since email notifications do not work here any more, it might take me quite some time to notice a reply to a thread,..

Last edited by Selur; 24th September 2019 at 15:30.
Selur is offline   Reply With Quote
Old 24th September 2019, 16:02   #993  |  Link
Atak_Snajpera
RipBot264 author
 
Atak_Snajpera's Avatar
 
Join Date: May 2006
Location: Poland
Posts: 7,338
Quote:
Originally Posted by Selur View Post
Using 20190917 I have some problem with a mkv(interlaced avc,wav) using:
Code:
core.lsmas.LWLibavSource(source="Il Silenzio (Melissa Venema) [Live in Maastricht II] (N).mkv", format="YUV420P8", cache=0, prefer_hw=1)
only one frame is returned
using:
Code:
core.lsmas.LWLibavSource(source="Il Silenzio (Melissa Venema) [Live in Maastricht II] (N).mkv", format="YUV420P8", cache=0, prefer_hw=0)
vspipe and vsviewer simply close.
DGSource and FFVideoSource (ffms2 and ffms2k) both work.
Same happens with AvsPmod and avs2yuv when using:
Code:
LWLibavVideoSource("C:\Users\Selur\Desktop\Il Silenzio (Melissa Venema) [Live in Maastricht II] (N).mkv",cache=false,format="YUV420P8", prefer_hw=1)
(only one Frame)
and
Code:
LWLibavVideoSource("C:\Users\Selur\Desktop\Il Silenzio (Melissa Venema) [Live in Maastricht II] (N).mkv",cache=false,format="YUV420P8", prefer_hw=0)
program closes.
(as expected using prefer_hw=3 also returns one frame)

Uploaded the source to my GoogleDrive.
(Using Ryzen 7 1800X, Windows 10, 32GB RAM, GeForce GTX 1070Ti in case it helps.)

Cu Selur
Indeed. Instant crash in my SeekTester tool


Update: It looks like video has to be demuxed to raw .264 in order to be correctly decoded by LSMASH.

Update2: Demuxed .264 does not crash LSMASH but some frames are missing after seeking.

Last edited by Atak_Snajpera; 24th September 2019 at 16:21.
Atak_Snajpera is offline   Reply With Quote
Old 24th September 2019, 23:11   #994  |  Link
videoh
Registered User
 
Join Date: Jul 2014
Posts: 1,069
Quote:
Originally Posted by Atak_Snajpera View Post
Check this out!
Can you please give me the x264 version you used and a link to get it? Thank you.

BTW, DGSource() on a 2080 Ti gives 500 fps for your stream compared to your 124 fps for SW, and 122 fps for your ancient GT 710.

Last edited by videoh; 24th September 2019 at 23:24.
videoh is offline   Reply With Quote
Old 25th September 2019, 00:16   #995  |  Link
Atak_Snajpera
RipBot264 author
 
Atak_Snajpera's Avatar
 
Join Date: May 2006
Location: Poland
Posts: 7,338
Just download latest. Ask uncle google for directions.
Atak_Snajpera is offline   Reply With Quote
Old 25th September 2019, 00:37   #996  |  Link
videoh
Registered User
 
Join Date: Jul 2014
Posts: 1,069
First test with your stream to x64:

DGSource + 2080 Ti: 4:30

That is to be compared to your 13:21 for SW.

Looks like a fine boost to me.
videoh is offline   Reply With Quote
Old 25th September 2019, 01:11   #997  |  Link
poisondeathray
Registered User
 
Join Date: Sep 2007
Posts: 4,046
Quote:
Originally Posted by videoh View Post
First test with your stream to x64:

DGSource + 2080 Ti: 4:30

That is to be compared to your 13:21 for SW.

Looks like a fine boost to me.

What about compared to your SW?

Comparing 2 different CPU's setups is less relevant if his is an old Q8200 and you have something probably 10 years newer and with more cores
poisondeathray is offline   Reply With Quote
Old 25th September 2019, 03:19   #998  |  Link
videoh
Registered User
 
Join Date: Jul 2014
Posts: 1,069
Oy, OK, I never wanted lsmash or any of that on my PC but I'll see what I can do for you. BTW, I have only a lowly 7700K @4.2GHz. Your request is fair and reasonable.

Last edited by videoh; 25th September 2019 at 04:34.
videoh is offline   Reply With Quote
Old 25th September 2019, 03:56   #999  |  Link
MeteorRain
結城有紀
 
Join Date: Dec 2003
Location: NJ; OR; Shanghai
Posts: 624
Actually this is the first time I noticed that's a q8200, which was launched 11 years ago.

This brings me the question. What kind of hardware spec range should we expect in daily benchmarks.
Shall we even care about how the performance is to encode x265 1080p on an 11 years old CPU?
Shall we focus on some more "modern" hardware?

IMHO, even E5v1 and SNB desktop series are considered a bit outdated now.
MeteorRain is offline   Reply With Quote
Old 25th September 2019, 04:13   #1000  |  Link
poisondeathray
Registered User
 
Join Date: Sep 2007
Posts: 4,046
Quote:
Originally Posted by MeteorRain View Post
Actually this is the first time I noticed that's a q8200, which was launched 11 years ago.

This brings me the question. What kind of hardware spec range should we expect in daily benchmarks.
Shall we even care about how the performance is to encode x265 1080p on an 11 years old CPU?
Shall we focus on some more "modern" hardware?

IMHO, even E5v1 and SNB desktop series are considered a bit outdated now.


It really doesn't matter, as long as the relevant testing and background info is provided for context. Some people have older than 10 year old hardware, some older 3rd or 4th computers laying around. It might be useful info for them. But given limited time constraints - I would put higher priority testing on newer hardware if possible

But the question here was measuring the effect of off loading "GPU" decoding on actual encoding speed. So the delta on the same hardware needs to be tested, not comparing different CPU hardware. Obviously the Q8200 will be slower for encoding in every situation
poisondeathray is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 11:23.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2020, vBulletin Solutions Inc.