GenMotion and DePan plugins for global motion compensation - Page 12

DarkT · 8th December 2007, 23:32

Ah, thanks, I was put off by the author's original guide, he wrote there:

"Deshaker works best for video shot using high shutter speeds (at least 1/200 sec or so). Otherwise you might get motion blur without motion in the deshaked video. Also, the matching will work better."

I need it to stabilize ANIME - should I still give it a try?

johnmeyer · 9th December 2007, 01:47

Quote:

I need it to stabilize ANIME - should I still give it a try?

I do a LOT of work with film, both film that I transfer with workprinter as well as film that I inverse telecine back to 24p. Deshaker works wonders eliminating gate weave/judder (the slight motion introduce because the film doesn't come to rest exactly the same way from one frame to the next, either in the camera when it is being shot, or in the projector when it is being shown). In fact, the guy that wrote Deshaker even added a few settings specifically for a guy that wanted to get rid of this problem, but without affecting the global motion. In general, you want to use really "mild" settings so that only the small motion from gate weave is eliminated.

odyssey · 9th December 2007, 13:50

Great. I'll look into it

Addendum:
Another thing, I've messed slightly around with the Virtualdub filter plugin and Deshaker in avisynth. Is it possible to set the nessesary parameters all inside a script and avoid the vdub step?

Depan should be able to read these log files (although I haven't had any success with it yet), would it make any difference, for Depan to do the 2nd pass instead of deshaker?

johnmeyer · 9th December 2007, 17:54

I wrote a script for the editing program, Sony Vegas. That script communicates with Deshaker through the VirtualDub scripting language. If you want to take a look at what I did, you can download that script here:

http://www.lawrence-arnold.com/Vegas/DeshakerScript.htm

The .js portion is the script for Vegas which you can read in Notepad. If you go about 3/4 of the way down in that script you will see the call I make to VirtualDub and will see how I pass parameters into the VirtualDub script. It is a real kludge because the VirtualDub scripting was something that was added as an afterthought and has never really been enhanced or supported. However, the kludge works and I have a lot of happy Vegas users, especially since Deshaker actually works better than most of the commercial solutions.

DarkT · 9th December 2007, 23:22

Thanks a bunch, I'll be trying it out as soon as I encode my next messy episode.

johnmeyer · 9th December 2007, 23:33

After you run the "deshake.exe" file (which is just a zip file), this will put all the files in the c:\deshake directory. That is all it does (no registry changes or anything else). As soon as the files are unzipped, immediately open the readme.txt file. It will tell you (I think) everything you need to know for your purposes.

odyssey · 11th December 2007, 20:05

Since this is the Depan-thread, I would really like to know how i'm able to load (and save) a log-file as described in on the web page.

It's interresting, if i'm able to scan the video with eigher Depan and Deshaker, but use Depan only for stabilizing the image, especially if i'm able to make corrections to the log-file.

johnmeyer · 11th December 2007, 21:08

Quote:

I would really like to know how i'm able to load (and save) a log-file as described in on the web page.

If you are talking about using the Deshaker log file for other plugins/filters, I have seen that discussed in many places, including the home page for each of the filters and here on the forum. Try doing a search for "Deshaker" AND the name of the filter that you want to have read the Deshaker log file.

Fizick · 11th December 2007, 21:46

odyssey, syntax is simple as it can be:
DePanStabilize (source, data=source, ..., inputlog="deshaker.log")
So, you are able to read (at last old Deshaker 1.x versions - i did not test recent).
But log file does not contain "stabilized" data. It contains estimated motiion data only.
so, you cant change intrenal stabilization algo

odyssey · 11th December 2007, 22:31

Quote:

Originally Posted by Fizick

odyssey, syntax is simple as it can be:
DePanStabilize (source, data=source, ..., inputlog="deshaker.log")
So, you are able to read (at last old Deshaker 1.x versions - i did not test recent).
But log file does not contain "stabilized" data. It contains estimated motiion data only.
so, you cant change intrenal stabilization algo

Why is a data source needed, if an input file is specified? I thought you could get past the estimation part, and concentrate on stabilizing?

Fizick · 11th December 2007, 22:42

its dummy data

odyssey · 11th December 2007, 23:42

Quote:

Originally Posted by Fizick

its dummy data

So it could be anything? How can I send dummy data without wasting CPU?

Fizick · 11th December 2007, 23:55

any way

odyssey · 12th December 2007, 01:20

Got it

At which stage is the BASE frame detected? I have trouble with some scenes where it cannot find a BASE frame and just counts on, and other scenes where a BASE frame is picked too often.

It seems like the log file contains just cordinates, but they are not equal to the cordinates displayed with info=true.

It would be great if I were able to get a pretty good estimation logged and are able to edit out a few wrongs manually.

This is the intro of one of the old disney shorts i'm working on, and I'd assume it's an easy task for any image stabilizer as no elements in the picture are not moving (just the film). Still I have problems with the duck-image and the title, where BASE frame is simply ignored and no correction made.

anton_foy · 12th December 2007, 19:31

I have tried depan very little but here is ( IMHO ) a great way to convert 50i footage to look like it has been shot at 15 fps, "silent film"/super-8 -style.

input = input.nnedi()

vectors = depanestimate(input)
input_1_of_12 = input.duplicateframe(0)
input_2_of_12 = input.depan(vectors,offset= 1./12.,mirror=15,blur=35)
input_3_of_12 = input.depan(vectors,offset= 2./12.,mirror=15,blur=35)
input_4_of_12 = input.depan(vectors,offset= 3./12.,mirror=15,blur=35)
input_5_of_12 = input.depan(vectors,offset= 4./12.,mirror=15,blur=35)
input_6_of_12 = input.depan(vectors,offset= 5./12.,mirror=15,blur=35)
input_7_of_12 = input.depan(vectors,offset= 6./12.,mirror=15,blur=35)
input_8_of_12 = input.depan(vectors,offset= 7./12.,mirror=15,blur=35)
input_9_of_12 = input.depan(vectors,offset= 8./12.,mirror=15,blur=35)
input_10_of_12 = input.depan(vectors,offset= 9./12.,mirror=15,blur=35)
input_11_of_12 = input.depan(vectors,offset=10./12.,mirror=15,blur=35)
input_12_of_12 = input.depan(vectors,offset=11./12.,mirror=15,blur=35)
interleave(input_1_of_12,input_2_of_12,input_3_of_12,input_4_of_12,input_5_of_12,input_6_of_12,
\ input_7_of_12,input_8_of_12,input_9_of_12,input_10_of_12,input_11_of_12,input_12_of_12)

ChangeFPS(15,linear=false)
assumefps(25,true)

I have not seen any artifacts when using this script, very cool!

Edit: mostly silent film was shot at 16 fps rather than 15 but it has occured.

johnmeyer · 12th December 2007, 19:57

That's a great script. Now if only someone could post one that would do a good job of taking 30p video taken with the "movie" function on still cams, and turn it into decent 60i. I've tried various things with mvtools (which may or may not be a better tool for this than DePan), but so far have not gotten consisten results.

odyssey · 16th December 2007, 23:46

Could you please try to describe the use of cutoff and damping values? I don't understand how to use these, but I think they have a significant impact on my trouble.

Fizick · 17th December 2007, 00:14

do not touch damping.
try firstly play with cutoff.
this thread is 12 pages only

odyssey · 17th December 2007, 00:30

Quote:

Originally Posted by Fizick

do not touch damping.
try firstly play with cutoff.
this thread is 12 pages only

I did, but still don't really understand it. If I set it to 0.1, the intro is almost perfectly stable, but throughout the movie it only corrects few frames at a time.

Setting it to an insanely high value (say 100) makes the picture shake around randomly with insane correction values - Why is that?

Regardless of any value I put, the duck-image is not detected as a scene - Why not?

Fizick · 17th December 2007, 07:05

I can not use megaupload in Russia.
My internet is not cheap (about 1 USD per 10 MB).

So, I do no know nothing about your "duck"

As I wrote above, DepaStabilize was designed not for movie, but for camcorder video.
Try apply DePanstimate on cropped border only of your films if it present and stabilize whole frame.
Try watch "trust" values and scenedetection.

9th December 2007, 13:50	#223 \| Link
odyssey Registered User Join Date: Dec 2003 Posts: 155	Great. I'll look into it Addendum: Another thing, I've messed slightly around with the Virtualdub filter plugin and Deshaker in avisynth. Is it possible to set the nessesary parameters all inside a script and avoid the vdub step? Depan should be able to read these log files (although I haven't had any success with it yet), would it make any difference, for Depan to do the 2nd pass instead of deshaker? Last edited by odyssey; 9th December 2007 at 14:00.

11th December 2007, 21:46	#229 \| Link
Fizick AviSynth plugger Join Date: Nov 2003 Location: Russia Posts: 2,183	odyssey, syntax is simple as it can be: DePanStabilize (source, data=source, ..., inputlog="deshaker.log") So, you are able to read (at last old Deshaker 1.x versions - i did not test recent). But log file does not contain "stabilized" data. It contains estimated motiion data only. so, you cant change intrenal stabilization algo __________________ My Avisynth plugins are now at http://avisynth.org.ru and mirror at http://avisynth.nl/users/fizick I usually do not provide a technical support in private messages.

11th December 2007, 22:42	#231 \| Link
Fizick AviSynth plugger Join Date: Nov 2003 Location: Russia Posts: 2,183	its dummy data __________________ My Avisynth plugins are now at http://avisynth.org.ru and mirror at http://avisynth.nl/users/fizick I usually do not provide a technical support in private messages.

11th December 2007, 23:55	#233 \| Link
Fizick AviSynth plugger Join Date: Nov 2003 Location: Russia Posts: 2,183	any way __________________ My Avisynth plugins are now at http://avisynth.org.ru and mirror at http://avisynth.nl/users/fizick I usually do not provide a technical support in private messages.

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

8th December 2007, 23:32	#221 \| Link
DarkT Registered User Join Date: Dec 2006 Posts: 280	Ah, thanks, I was put off by the author's original guide, he wrote there: "Deshaker works best for video shot using high shutter speeds (at least 1/200 sec or so). Otherwise you might get motion blur without motion in the deshaked video. Also, the matching will work better." I need it to stabilize ANIME - should I still give it a try?

9th December 2007, 17:54	#224 \| Link
johnmeyer Registered User Join Date: Feb 2002 Location: California Posts: 2,695	I wrote a script for the editing program, Sony Vegas. That script communicates with Deshaker through the VirtualDub scripting language. If you want to take a look at what I did, you can download that script here: http://www.lawrence-arnold.com/Vegas/DeshakerScript.htm The .js portion is the script for Vegas which you can read in Notepad. If you go about 3/4 of the way down in that script you will see the call I make to VirtualDub and will see how I pass parameters into the VirtualDub script. It is a real kludge because the VirtualDub scripting was something that was added as an afterthought and has never really been enhanced or supported. However, the kludge works and I have a lot of happy Vegas users, especially since Deshaker actually works better than most of the commercial solutions.

9th December 2007, 23:22	#225 \| Link
DarkT Registered User Join Date: Dec 2006 Posts: 280	Thanks a bunch, I'll be trying it out as soon as I encode my next messy episode.

9th December 2007, 23:33	#226 \| Link
johnmeyer Registered User Join Date: Feb 2002 Location: California Posts: 2,695	After you run the "deshake.exe" file (which is just a zip file), this will put all the files in the c:\deshake directory. That is all it does (no registry changes or anything else). As soon as the files are unzipped, immediately open the readme.txt file. It will tell you (I think) everything you need to know for your purposes.

11th December 2007, 20:05	#227 \| Link
odyssey Registered User Join Date: Dec 2003 Posts: 155	Since this is the Depan-thread, I would really like to know how i'm able to load (and save) a log-file as described in on the web page. It's interresting, if i'm able to scan the video with eigher Depan and Deshaker, but use Depan only for stabilizing the image, especially if i'm able to make corrections to the log-file.

12th December 2007, 01:20	#234 \| Link
odyssey Registered User Join Date: Dec 2003 Posts: 155	Got it At which stage is the BASE frame detected? I have trouble with some scenes where it cannot find a BASE frame and just counts on, and other scenes where a BASE frame is picked too often. It seems like the log file contains just cordinates, but they are not equal to the cordinates displayed with info=true. It would be great if I were able to get a pretty good estimation logged and are able to edit out a few wrongs manually. This is the intro of one of the old disney shorts i'm working on, and I'd assume it's an easy task for any image stabilizer as no elements in the picture are not moving (just the film). Still I have problems with the duck-image and the title, where BASE frame is simply ignored and no correction made.

12th December 2007, 19:31	#235 \| Link
anton_foy Registered User Join Date: Dec 2005 Location: Sweden Posts: 703	I have tried depan very little but here is ( IMHO ) a great way to convert 50i footage to look like it has been shot at 15 fps, "silent film"/super-8 -style. input = input.nnedi() vectors = depanestimate(input) input_1_of_12 = input.duplicateframe(0) input_2_of_12 = input.depan(vectors,offset= 1./12.,mirror=15,blur=35) input_3_of_12 = input.depan(vectors,offset= 2./12.,mirror=15,blur=35) input_4_of_12 = input.depan(vectors,offset= 3./12.,mirror=15,blur=35) input_5_of_12 = input.depan(vectors,offset= 4./12.,mirror=15,blur=35) input_6_of_12 = input.depan(vectors,offset= 5./12.,mirror=15,blur=35) input_7_of_12 = input.depan(vectors,offset= 6./12.,mirror=15,blur=35) input_8_of_12 = input.depan(vectors,offset= 7./12.,mirror=15,blur=35) input_9_of_12 = input.depan(vectors,offset= 8./12.,mirror=15,blur=35) input_10_of_12 = input.depan(vectors,offset= 9./12.,mirror=15,blur=35) input_11_of_12 = input.depan(vectors,offset=10./12.,mirror=15,blur=35) input_12_of_12 = input.depan(vectors,offset=11./12.,mirror=15,blur=35) interleave(input_1_of_12,input_2_of_12,input_3_of_12,input_4_of_12,input_5_of_12,input_6_of_12, \ input_7_of_12,input_8_of_12,input_9_of_12,input_10_of_12,input_11_of_12,input_12_of_12) ChangeFPS(15,linear=false) assumefps(25,true) I have not seen any artifacts when using this script, very cool! Edit: mostly silent film was shot at 16 fps rather than 15 but it has occured.

12th December 2007, 19:57	#236 \| Link
johnmeyer Registered User Join Date: Feb 2002 Location: California Posts: 2,695	That's a great script. Now if only someone could post one that would do a good job of taking 30p video taken with the "movie" function on still cams, and turn it into decent 60i. I've tried various things with mvtools (which may or may not be a better tool for this than DePan), but so far have not gotten consisten results.

16th December 2007, 23:46	#237 \| Link
odyssey Registered User Join Date: Dec 2003 Posts: 155	Could you please try to describe the use of cutoff and damping values? I don't understand how to use these, but I think they have a significant impact on my trouble.

17th December 2007, 00:14	#238 \| Link
Fizick AviSynth plugger Join Date: Nov 2003 Location: Russia Posts: 2,183	do not touch damping. try firstly play with cutoff. this thread is 12 pages only

17th December 2007, 07:05	#240 \| Link
Fizick AviSynth plugger Join Date: Nov 2003 Location: Russia Posts: 2,183	I can not use megaupload in Russia. My internet is not cheap (about 1 USD per 10 MB). So, I do no know nothing about your "duck" As I wrote above, DepaStabilize was designed not for movie, but for camcorder video. Try apply DePanstimate on cropped border only of your films if it present and stabilize whole frame. Try watch "trust" values and scenedetection.