Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion.

Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules.

 

Go Back   Doom9's Forum > Capturing and Editing Video > VapourSynth

Reply
 
Thread Tools Search this Thread Display Modes
Old 29th December 2018, 20:02   #1  |  Link
Cary Knoop
Cary Knoop
 
Cary Knoop's Avatar
 
Join Date: Feb 2017
Location: Newark CA, USA
Posts: 156
Problem processing large video

I am trying to process a 4K video encoded ProRes 4:2:2 HQ.

Even when I try to simply open (commenting out the decimate) nothing seems to happen (no significant disk, CPU or memory activity):

Code:
from vapoursynth import core
import vapoursynth as vs

c = core.ffms2.Source('a:\video.mov')
#c = core.std.SelectEvery(c, cycle=3, offsets=[0,1])
  
c.set_output()
Running: Vapoursynth R45. Windows 10 on a Threadripper 1950X with 64GB of memory, source disk A:\ is an NVME drive.
Cary Knoop is offline   Reply With Quote
Old 29th December 2018, 20:16   #2  |  Link
Cary Knoop
Cary Knoop
 
Cary Knoop's Avatar
 
Join Date: Feb 2017
Location: Newark CA, USA
Posts: 156
Well, I just was proven to be impatient.
It's super slow though.
Cary Knoop is offline   Reply With Quote
Old 29th December 2018, 22:02   #3  |  Link
Myrsloik
Professional Code Monkey
 
Myrsloik's Avatar
 
Join Date: Jun 2003
Location: Ikea Chair
Posts: 1,921
Quote:
Originally Posted by Cary Knoop View Post
Well, I just was proven to be impatient.
It's super slow though.
Your drive is super slow
__________________
VapourSynth - proving that scripting languages and video processing isn't dead yet
Myrsloik is offline   Reply With Quote
Old 29th December 2018, 22:16   #4  |  Link
Cary Knoop
Cary Knoop
 
Cary Knoop's Avatar
 
Join Date: Feb 2017
Location: Newark CA, USA
Posts: 156
Quote:
Originally Posted by Myrsloik View Post
Your drive is super slow
My A:\ is mapped to an NVME PNY CS2030 480GB drive.

Not really my idea of super slow:



Source: https://www.techadvisor.co.uk/review...eview-3655600/
Cary Knoop is offline   Reply With Quote
Old 30th December 2018, 00:55   #5  |  Link
VS_Fan
Registered User
 
Join Date: Jan 2016
Posts: 91
You could try:
  • accessing your disk directly without mapping it;
  • download and run CrystalDiskMark on your disk
VS_Fan is offline   Reply With Quote
Old 30th December 2018, 03:12   #6  |  Link
asarian
Registered User
 
Join Date: May 2005
Posts: 1,372
Quote:
Originally Posted by Cary Knoop View Post
Well, I just was proven to be impatient.
It's super slow though.
You realize FFMS2 needs to create an index of the file first, right?! On a large 4k film. that could takes minutes even before actual processing starts.
__________________
Gorgeous, delicious, deculture!
asarian is offline   Reply With Quote
Old 30th December 2018, 05:20   #7  |  Link
poisondeathray
Registered User
 
Join Date: Sep 2007
Posts: 3,811
Another option is LSmash , which does not need to index ISO base media formats , such as MOV, MP4
poisondeathray is offline   Reply With Quote
Old 30th December 2018, 05:29   #8  |  Link
Cary Knoop
Cary Knoop
 
Cary Knoop's Avatar
 
Join Date: Feb 2017
Location: Newark CA, USA
Posts: 156
Quote:
Originally Posted by poisondeathray View Post
Another option is LSmash , which does not need to index ISO base media formats , such as MOV, MP4
I tried that as well, but it was very slow as well.

Never had problems opening files but in this case, for a very large and low compressed video, it is definitely slow. And this was only a 12 minutes master, what if it is a 2-hour master.

The suggestion that it must be my hard drive I frankly find not very helpful.
Cary Knoop is offline   Reply With Quote
Old 30th December 2018, 05:29   #9  |  Link
Cary Knoop
Cary Knoop
 
Cary Knoop's Avatar
 
Join Date: Feb 2017
Location: Newark CA, USA
Posts: 156
Quote:
Originally Posted by asarian View Post
You realize FFMS2 needs to create an index of the file first, right?! On a large 4k film. that could takes minutes even before actual processing starts.
I do, but it's very slow.
Cary Knoop is offline   Reply With Quote
Old 30th December 2018, 05:49   #10  |  Link
poisondeathray
Registered User
 
Join Date: Sep 2007
Posts: 3,811
Quote:
Originally Posted by Cary Knoop View Post
I tried that as well, but it was very slow as well.
Slow before opening ? As if it were indexing ?

or slow seeking performance "after" you were "patient ?"

Did you use core.lsmas.LibavSMASHSource , which is for ISO base media formats ? - This doesn't index and should open immediately

(core.lsmas.LWLibavSource is for other formats, and indexes)
poisondeathray is offline   Reply With Quote
Old 30th December 2018, 05:56   #11  |  Link
Cary Knoop
Cary Knoop
 
Cary Knoop's Avatar
 
Join Date: Feb 2017
Location: Newark CA, USA
Posts: 156
Quote:
Originally Posted by poisondeathray View Post
Slow before opening ? As if it were indexing ?

or slow seeking performance "after" you were "patient ?"

Did you use core.lsmas.LibavSMASHSource , which is for ISO base media formats ? - This doesn't index and should open immediately

(core.lsmas.LWLibavSource is for other formats, and indexes)
Ah, I tried core.lsmas.LWLibavSource() instead of core.lsmas.LibavSMASHSource()!

And indeed, once it is working, consecutive access is almost instantly.

Thanks!
Cary Knoop is offline   Reply With Quote
Old 30th December 2018, 06:39   #12  |  Link
Selur
Registered User
 
Selur's Avatar
 
Join Date: Oct 2001
Location: Germany
Posts: 5,822
When using the ffms2 I usually create the index file with ffmsindex (add the created index to the call) and then open the Vapoursynth script.
This doesn't really speed things up, but it allows to know what time is spend on creating the index.
__________________
Hybrid here in the forum, homepage
Selur is offline   Reply With Quote
Old 30th December 2018, 08:36   #13  |  Link
asarian
Registered User
 
Join Date: May 2005
Posts: 1,372
Quote:
Originally Posted by Cary Knoop View Post
Ah, I tried core.lsmas.LWLibavSource() instead of core.lsmas.LibavSMASHSource()!

And indeed, once it is working, consecutive access is almost instantly.

Thanks!
If you have a nVidia card, you could also give DGDecodeNV a try. Creating the .dgi file may take a while, but its frame-serving processing power is phenomenal.
__________________
Gorgeous, delicious, deculture!

Last edited by asarian; 30th December 2018 at 08:39.
asarian is offline   Reply With Quote
Old 30th December 2018, 17:10   #14  |  Link
poisondeathray
Registered User
 
Join Date: Sep 2007
Posts: 3,811
Quote:
Originally Posted by asarian View Post
If you have a nVidia card, you could also give DGDecodeNV a try. Creating the .dgi file may take a while, but its frame-serving processing power is phenomenal.
Won't help for prores
poisondeathray is offline   Reply With Quote
Old 30th December 2018, 19:16   #15  |  Link
asarian
Registered User
 
Join Date: May 2005
Posts: 1,372
Quote:
Originally Posted by poisondeathray View Post
Won't help for prores
My bad. Fully missed he was talking about ProRes material.
__________________
Gorgeous, delicious, deculture!
asarian is offline   Reply With Quote
Old 1st January 2019, 12:09   #16  |  Link
ChaosKing
Registered User
 
Join Date: Dec 2005
Location: Germany
Posts: 847
Is mov in ffms2 frame accurate? You should test it.

Last edited by ChaosKing; 1st January 2019 at 16:36.
ChaosKing is offline   Reply With Quote
Old 1st January 2019, 16:25   #17  |  Link
poisondeathray
Registered User
 
Join Date: Sep 2007
Posts: 3,811
Quote:
Originally Posted by ChaosKing View Post
I mov in ffms2 frame accurate? You should test it.
I-frame formats, like prores, are usually frame accurate

long gop in mov, such as some xdcam variants, h264 are usually frame accurate too with both lsmash/ffms2 in my experience
poisondeathray is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 15:35.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2019, vBulletin Solutions Inc.