Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion.

Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules.

 

Go Back   Doom9's Forum > Capturing and Editing Video > Avisynth Usage

Reply
 
Thread Tools Search this Thread Display Modes
Old 25th July 2014, 16:18   #1  |  Link
xyzdragon
Registered User
 
Join Date: Jun 2014
Posts: 5
24fps->60fps for Anime footage

Hello,

I'm new here, but know of and was reading on this board for a long time.

I want to interpolate my Bluray-Animes, because I observe a nasty shaky movement especially in pure pans, since I got a newer and larger monitor. (I also noticed banding since then on many sources, but this is another matter)

Now I tried many Avisynth-Filters like InterFrame, SVPFlow and DePan, but they all are not satisfactory, because I definitely don't want to introduce artefacts.
DePan is momentarily my favorite, because it introduces the least artifacts on the interpolated frames.

The problem for DePan are scenes where a background pans with one velocity and a foreground (figures, faces, ...) pans/moves with another velocity. This results in jittery movement for one or another. DePan doesn't seem to be able to differentiate well enough between these mixed pans and normal ones. Heck sometimes pans with a perfectly still image has a trust value much lower than these mixed movements. (In the depan documentation it's also not mentionend, but it seems the dxmax, dymax affect the trust-value, even though 'stab' should be defaulted to 0)

Also a small problem seems, that for perfectly still scenes depan can actually introduce jitter! I would need a dxmin, dymin feature for that, because in the log the dx and dy always move around +0.0,-0.0,+0.1,-0.1 for perfectly still scenes.

Also there are two methods using depan. Using DePan or using ChangeFPS with following DePanStabilize. I noticed, that the latter method seems to perform worse when detecting motion, possibly because of the duplicated frames in-between.

SVPFlow is another matter. The parameters are not very well documented, so its really hard to tweak it.

I tried getting it to recognize only global motion, like hinted to in the svpproject wiki for the GUI-Version: http://www.svp-team.com/wiki/Watching_anime
My best settings were:
Code:
super   = SVSuper( "{ scale:{ up:0, down:4 }, gpu:1 }" )      
vectors = SVAnalyse( super, "{ block:{w:32, overlap:0 }, main:{ search:{ coarse:{type:2, distance:-6, satd:false}, penalty:{ lsad:0 }, distance:0, bad:{sad:0} } } }" )
SVSmoothFps( super, vectors, "{ rate: { num:60000 , den:1001, abs:true }, algo:2 , mask:{ cover:0 }, scene:{ blend:false, mode:0 } }", url="www.svp-team.com", mt=4 )
The problem with these settings, which I partially extracted from the InterFrame-Plugin, is, that it still tries to find individual movement on some scale in a pan or in a still background scene. This results in a really noticeable kind of 'aura' around moving objects, because part of the background also gets moved and distorted. Compare for example the two frames in the attachment and you will see it.


Does anyone know of some method to only interpolate perfect pans without moving objects or can tweak DePan a bit better than me or ... ?

Last edited by avih; 1st August 2014 at 21:27.
xyzdragon is offline   Reply With Quote
Old 26th July 2014, 10:50   #2  |  Link
creaothceann
Registered User
 
Join Date: Jul 2010
Location: Germany
Posts: 357
Quote:
Originally Posted by xyzdragon View Post
I want to interpolate my Bluray-Animes, because I observe a nasty shaky movement especially in pure pans, since I got a newer and larger monitor.
TV or computer monitor? If it's the latter and if you can set it to 50Hz (you may need to create a custom resolution), try ReClock.

Last edited by creaothceann; 26th July 2014 at 11:00.
creaothceann is offline   Reply With Quote
Old 26th July 2014, 17:25   #3  |  Link
xyzdragon
Registered User
 
Join Date: Jun 2014
Posts: 5
Quote:
Originally Posted by creaothceann View Post
TV or computer monitor? If it's the latter and if you can set it to 50Hz (you may need to create a custom resolution), try ReClock.
Computer monitor "LG 24EA53VQ 24 Zoll IPS". I don't think this is the problem. (I tried setting it to 50Hz just now) I think I observe it only on this monitor, because it's larger and therefore the jump per frame is maybe 1cm instead of 0.5cm in real space.

The 60fps footage I got really looks awesome and is exactly what I want, if the pan recognition wouldn't be so random.

Is there maybe another way to prepare a clip which can get better results in DePanEstimate? Denoising for example helps extremely. Maybe it's possible that higher contrast or heavily overcleaned/denoised footage would lead to better results. But I don't know how DePan works, to know where to start with this.
xyzdragon is offline   Reply With Quote
Old 26th July 2014, 18:53   #4  |  Link
creaothceann
Registered User
 
Join Date: Jul 2010
Location: Germany
Posts: 357
Quote:
Originally Posted by xyzdragon View Post
I think I observe it only on this monitor, because it's larger and therefore the jump per frame is maybe 1cm instead of 0.5cm in real space.
Then wouldn't it be better to interpolate to 50 (or 50/1001) Hz instead of 60? I don't know about the interpolation glitches though.
creaothceann is offline   Reply With Quote
Old 27th July 2014, 00:27   #5  |  Link
xyzdragon
Registered User
 
Join Date: Jun 2014
Posts: 5
Quote:
Originally Posted by creaothceann View Post
Then wouldn't it be better to interpolate to 50 (or 50/1001) Hz instead of 60? I don't know about the interpolation glitches though.
50 or 60 (59.94), I don't really see the difference. 60Hz is standard maximum for many monitors, so I thought that would be best. That can be done with factor 5/2. But maybe your point is 24->48 would make less interpolation glitches, because there wouldn't be so much to interpolate... This is worth a try. Edit: Won't alleviate the problem.

Last edited by xyzdragon; 27th July 2014 at 00:40.
xyzdragon is offline   Reply With Quote
Old 27th July 2014, 00:56   #6  |  Link
creaothceann
Registered User
 
Join Date: Jul 2010
Location: Germany
Posts: 357
Quote:
Originally Posted by xyzdragon View Post
50 or 60, I don't really see the difference.
Well, there should be completely smooth movement (though with large spatial increments) if everything is set up right: video (24/1.001Hz) → ReClock (25Hz) → monitor (50Hz)
creaothceann is offline   Reply With Quote
Old 27th July 2014, 03:25   #7  |  Link
foxyshadis
ангел смерти
 
foxyshadis's Avatar
 
Join Date: Nov 2004
Location: Lost
Posts: 9,558
You should check out MadVR interpolation if you're only going to watch on a PC. MadVR has an option to blend to your monitor's framerate instead of juddering. (The artifacts of blending are usually less noticeable than the artifacts of flow or depan in motion. Flow tends to compress better, on the other hand.) That beats warping your backup to conform. Unfortunately, there's really no solution to flowing differing background/foreground framerates. clouded was writing the celforeground/celbackground plugins partly for that purpose, but the project got too difficult to finish.
foxyshadis is offline   Reply With Quote
Old 28th July 2014, 12:42   #8  |  Link
fvisagie
Registered User
 
Join Date: Aug 2008
Location: Isle of Man
Posts: 588
Quote:
Originally Posted by xyzdragon View Post
I want to interpolate my Bluray-Animes, because I observe a asty shaky movement especially in pure pans
Just a question - are you throwing the right tool at the problem? More specifically, are you sure that what you observe isn't the result of incorrect field order, (poor) telecine handling, etc. earlier in the life of those videos? Just a thought .
fvisagie is offline   Reply With Quote
Old 28th July 2014, 19:03   #9  |  Link
xyzdragon
Registered User
 
Join Date: Jun 2014
Posts: 5
Quote:
Originally Posted by fvisagie View Post
Just a question - are you throwing the right tool at the problem? More specifically, are you sure that what you observe isn't the result of incorrect field order, (poor) telecine handling, etc. earlier in the life of those videos? Just a thought .
I'm pretty sure. The Blurays of Ichiban no Ushiro Daimaou are one of the better ones, unlike interlaced Ghost Hound or seeminlgy upscaled and noisy Jormungand (the cgi isn't even antialiased).
My avisynth script therefore:

Code:
function ´(clip) {
    data = DePanEstimate( clip, trust=5, dxmax=20, dymax=20, stab=-0.5, info=true, extlog="motiondata.log" )
    t0   = data
    t1   = DePan( clip, data, offset=0.5, mirror=15 ).DeleteFrame(0)
    Interleave( t0,t1 )
}

DirectShowSource("D:\Blurays\ichiban_bd1_006.mkv", audio=false, convertfps=true, fps=23.976)
Trim(100,-200)
ConvertToYV12()
Crop(2,2, -2,-2)    
fps1to2()
Crop(4,4, -4,-4)
I also checked every single frame by exporting to png using ffmpeg (mpc doesn't seem to work perfectly. It seems to jump 2 frames at once when using the arrow-right-key, also it's of course slow)
xyzdragon is offline   Reply With Quote
Old 28th July 2014, 20:33   #10  |  Link
creaothceann
Registered User
 
Join Date: Jul 2010
Location: Germany
Posts: 357
Some nitpicks...

Quote:
Originally Posted by xyzdragon View Post
DirectShowSource
DSS2 is better. DirectShowSource often had problems with frame-accurate seeking for me.

Quote:
Originally Posted by xyzdragon View Post
fps=23.976
Perfectly correct number would be 24.0/1.001.

Quote:
Originally Posted by xyzdragon View Post
ConvertToYV12()
Isn't it already?

Quote:
Originally Posted by xyzdragon View Post
mpc doesn't seem to work perfectly. It seems to jump 2 frames at once when using the arrow-right-key, also it's of course slow)
Tried AvsPmod / VirtualDub (while using DSS2)?
creaothceann is offline   Reply With Quote
Old 1st August 2014, 21:27   #11  |  Link
avih
Capture, Deinterlace
 
avih's Avatar
 
Join Date: Feb 2002
Location: Right there
Posts: 1,971
Quote:
Originally Posted by xyzdragon View Post
Hello,
...
Does anyone know of some method to only interpolate perfect pans without moving objects or can tweak DePan a bit better than me or ... ?
I didn't approve those attachments because I don't see how these images contribute to understanding the issue or help in solving it.

Generally, try to be reasonable with the size and relevance of attachments. Thanks.

Last edited by avih; 1st August 2014 at 22:01.
avih is offline   Reply With Quote
Reply

Tags
anime, depan, frames interpolation, svp

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 14:26.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2024, vBulletin Solutions Inc.