Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion.

Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules.

Domains: forum.doom9.org / forum.doom9.net / forum.doom9.se

 

Go Back   Doom9's Forum > Capturing and Editing Video > VapourSynth

Reply
 
Thread Tools Display Modes
Old 30th January 2026, 15:09   #221  |  Link
Selur
.
 
Selur's Avatar
 
Join Date: Oct 2001
Location: Germany
Posts: 7,875
Quote:
Getting my hopes up... You did not - by any chance - fiddle SeedVR2 into hybrid ?
No, don't really see a meaningful way to do it atm.
I used it through ComfyUI following https://www.youtube.com/watch?v=MBtWYXq_r60
Just wanted to show that it really produces nice results if you feed it a clean source.
Haven't played around with it much simply due to the resource hunger of the whole thing.

Cu Selur
__________________
Hybrid here in the forum, homepage, its own forum
Selur is offline   Reply With Quote
Old 31st January 2026, 14:40   #222  |  Link
ReinerSchweinlin
Registered User
 
Join Date: Oct 2001
Posts: 501
Quote:
Originally Posted by Selur View Post
No, don't really see a meaningful way to do it atm.
I used it through ComfyUI following https://www.youtube.com/watch?v=MBtWYXq_r60
Just wanted to show that it really produces nice results if you feed it a clean source.
Haven't played around with it much simply due to the resource hunger of the whole thing.

I did not really expect it

Yes, its very hungry... I tried to use multiple GPUs to speed it up - no luck at the moment...

The diffusion ability indeed is able to introduce new details, very fascinating to see.
ReinerSchweinlin is offline   Reply With Quote
Old 31st January 2026, 20:46   #223  |  Link
Selur
.
 
Selur's Avatar
 
Join Date: Oct 2001
Location: Germany
Posts: 7,875
Quote:
The diffusion ability indeed is able to introduce new details, very fascinating to see.
Yup, it's impressive (https://www.mediafire.com/folder/pqr.../seedvr2_test4) and I'm hoping someone will come up with a way to leverage this in Vapoursynth.
__________________
Hybrid here in the forum, homepage, its own forum
Selur is offline   Reply With Quote
Old 18th February 2026, 16:08   #224  |  Link
Selur
.
 
Selur's Avatar
 
Join Date: Oct 2001
Location: Germany
Posts: 7,875
Just saw RVRT (Recurrent Video Restoration Transformer), which atm. doesn't work with Python 3.12+, but I thought it might be interesting for someone here.
vs-rvrt is based on https://github.com/JingyunLiang/RVRT

Update 1:
might work with Python 3.12+ now, but fails on portable environment since it can't find cuda,...

Cu Selur
__________________
Hybrid here in the forum, homepage, its own forum

Last edited by Selur; 18th February 2026 at 18:26.
Selur is offline   Reply With Quote
Old 23rd February 2026, 17:12   #225  |  Link
Selur
.
 
Selur's Avatar
 
Join Date: Oct 2001
Location: Germany
Posts: 7,875
vs-vsrvrt is working now. (will probably add it to Hybrids dev next weekend)
__________________
Hybrid here in the forum, homepage, its own forum
Selur is offline   Reply With Quote
Old 24th February 2026, 10:56   #226  |  Link
ReinerSchweinlin
Registered User
 
Join Date: Oct 2001
Posts: 501
VERY COOL, thank you !

do you have a rough speed estimate from your tests? are 10 x 5090 enough for 1 hour / frame ?
ReinerSchweinlin is offline   Reply With Quote
Old 24th February 2026, 18:12   #227  |  Link
Selur
.
 
Selur's Avatar
 
Join Date: Oct 2001
Location: Germany
Posts: 7,875
Just tested with
Code:
clip = vsrvrt.SuperRes(clip, scale=4, model="reds",preview_mode=True)
and get:
Code:
F:\Hybrid\64bit\Vapoursynth>VSPipe.exe c:\Users\Selur\Desktop\test3.vpy -c y4m NUL --progress
RVRT: Using preview mode (lazy chunk processing)
Warning: F:\Hybrid\64bit\Vapoursynth\Lib\site-packages\torch\functional.py:554: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at C:\actions-runner\_work\pytorch\pytorch\pytorch\aten\src\ATen\native\TensorShape.cpp:4316.)
  return _VF.meshgrid(tensors, **kwargs)  # type: ignore[attr-defined]

Loading model from: C:\Users\Selur\AppData\Local\vsrvrt\models\001_RVRT_videosr_bi_REDS_30frames.pth
RVRT: Preview mode - 429 frames in 9 chunk(s)
RVRT: Chunk size=64, processing on-demand
Script evaluation done in 2.14 seconds
RVRT: Processing chunk 1/9 (frames 0-63) for preview
RVRT: Auto-tiling: (11, 256, 256)
RVRT: Available VRAM: 14.5 GB, Estimated: 14.5 GB
RVRT: Processing chunk 2/9 (frames 48-111) for preview
RVRT: Auto-tiling: (10, 256, 256)
RVRT: Available VRAM: 14.4 GB, Estimated: 13.2 GB
RVRT: Processing chunk 3/9 (frames 96-159) for preview
RVRT: Auto-tiling: (10, 256, 256)
RVRT: Available VRAM: 14.3 GB, Estimated: 13.2 GB
RVRT: Processing chunk 4/9 (frames 144-207) for preview
RVRT: Auto-tiling: (10, 256, 256)
RVRT: Available VRAM: 14.3 GB, Estimated: 13.2 GB
RVRT: Processing chunk 5/9 (frames 192-255) for preview
RVRT: Auto-tiling: (10, 256, 256)
RVRT: Available VRAM: 14.3 GB, Estimated: 13.2 GB
RVRT: Processing chunk 6/9 (frames 240-303) for preview
RVRT: Auto-tiling: (10, 256, 256)
RVRT: Available VRAM: 14.3 GB, Estimated: 13.2 GB
RVRT: Processing chunk 7/9 (frames 288-351) for preview
RVRT: Auto-tiling: (10, 256, 256)
RVRT: Available VRAM: 14.3 GB, Estimated: 13.2 GB
RVRT: Processing chunk 8/9 (frames 336-399) for preview
RVRT: Auto-tiling: (10, 256, 256)
RVRT: Available VRAM: 14.3 GB, Estimated: 13.2 GB
RVRT: Processing chunk 9/9 (frames 384-428) for preview
RVRT: Auto-tiling: (10, 256, 256)
RVRT: Available VRAM: 14.3 GB, Estimated: 13.2 GB
Output 429 frames in 1034.04 seconds (0.41 fps)
using:
Code:
clip = vsrvrt.SuperRes(clip, scale=4, model="reds",preview_mode=False)
I get:
Code:
F:\Hybrid\64bit\Vapoursynth>VSPipe.exe c:\Users\Selur\Desktop\test3.vpy -c y4m NUL --progress
RVRT: Using chunked processing (video too long for single-pass)
Warning: F:\Hybrid\64bit\Vapoursynth\Lib\site-packages\torch\functional.py:554: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at C:\actions-runner\_work\pytorch\pytorch\pytorch\aten\src\ATen\native\TensorShape.cpp:4316.)
  return _VF.meshgrid(tensors, **kwargs)  # type: ignore[attr-defined]

Loading model from: C:\Users\Selur\AppData\Local\vsrvrt\models\001_RVRT_videosr_bi_REDS_30frames.pth
RVRT: Processing 429 frames in 9 chunk(s)
RVRT: Chunk size=64, overlap=16
RVRT: Processing chunk 1/9 (frames 0-63)
RVRT: Auto-tiling: (11, 256, 256)
RVRT: Available VRAM: 14.5 GB, Estimated: 14.5 GB
RVRT: Processing chunk 2/9 (frames 48-111)
RVRT: Auto-tiling: (10, 256, 256)
RVRT: Available VRAM: 14.4 GB, Estimated: 13.2 GB
RVRT: Processing chunk 3/9 (frames 96-159)
RVRT: Auto-tiling: (10, 256, 256)
RVRT: Available VRAM: 14.3 GB, Estimated: 13.2 GB
RVRT: Processing chunk 4/9 (frames 144-207)
RVRT: Auto-tiling: (10, 256, 256)
RVRT: Available VRAM: 14.3 GB, Estimated: 13.2 GB
RVRT: Processing chunk 5/9 (frames 192-255)
RVRT: Auto-tiling: (10, 256, 256)
RVRT: Available VRAM: 14.3 GB, Estimated: 13.2 GB
RVRT: Processing chunk 6/9 (frames 240-303)
RVRT: Auto-tiling: (10, 256, 256)
RVRT: Available VRAM: 14.3 GB, Estimated: 13.2 GB
RVRT: Processing chunk 7/9 (frames 288-351)
RVRT: Auto-tiling: (10, 256, 256)
RVRT: Available VRAM: 14.3 GB, Estimated: 13.2 GB
RVRT: Processing chunk 8/9 (frames 336-399)
RVRT: Auto-tiling: (10, 256, 256)
RVRT: Available VRAM: 14.3 GB, Estimated: 13.2 GB
RVRT: Processing chunk 9/9 (frames 384-428)
RVRT: Padded chunk from 45 to 64 frames
RVRT: Auto-tiling: (10, 256, 256)
RVRT: Available VRAM: 14.3 GB, Estimated: 13.2 GB
RVRT: Final output shape: torch.Size([1, 429, 3, 1408, 2560])
Script evaluation done in 1050.36 seconds
Output 429 frames in 6.47 seconds (66.28 fps)
so 0.4fps seems to be the correct speed.

Also tested:
Code:
clip = vsrvrt.Denoise(clip)
and got:
Code:
F:\Hybrid\64bit\Vapoursynth>VSPipe.exe c:\Users\Selur\Desktop\test3.vpy -c y4m NUL --progress
Information: VideoSource track #0 index progress 7%
RVRT: Using chunked processing (video too long for single-pass)
Warning: F:\Hybrid\64bit\Vapoursynth\Lib\site-packages\torch\functional.py:554: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at C:\actions-runner\_work\pytorch\pytorch\pytorch\aten\src\ATen\native\TensorShape.cpp:4316.)
  return _VF.meshgrid(tensors, **kwargs)  # type: ignore[attr-defined]

Loading model from: C:\Users\Selur\AppData\Local\vsrvrt\models\006_RVRT_videodenoising_DAVIS_16frames.pth
RVRT: Processing 429 frames in 9 chunk(s)
RVRT: Chunk size=64, overlap=16
RVRT: Processing chunk 1/9 (frames 0-63)
RVRT: Auto-tiling: (64, 256, 256)
RVRT: Available VRAM: 14.5 GB, Estimated: 8.7 GB
RVRT: Processing chunk 2/9 (frames 48-111)
RVRT: Auto-tiling: (64, 256, 256)
RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB
RVRT: Processing chunk 3/9 (frames 96-159)
RVRT: Auto-tiling: (64, 256, 256)
RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB
RVRT: Processing chunk 4/9 (frames 144-207)
RVRT: Auto-tiling: (64, 256, 256)
RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB
RVRT: Processing chunk 5/9 (frames 192-255)
RVRT: Auto-tiling: (64, 256, 256)
RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB
RVRT: Processing chunk 6/9 (frames 240-303)
RVRT: Auto-tiling: (64, 256, 256)
RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB
RVRT: Processing chunk 7/9 (frames 288-351)
RVRT: Auto-tiling: (64, 256, 256)
RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB
RVRT: Processing chunk 8/9 (frames 336-399)
RVRT: Auto-tiling: (64, 256, 256)
RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB
RVRT: Processing chunk 9/9 (frames 384-428)
RVRT: Padded chunk from 45 to 64 frames
RVRT: Auto-tiling: (64, 256, 256)
RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB
RVRT: Final output shape: torch.Size([1, 429, 3, 352, 640])
Script evaluation done in 63.90 seconds
Output 429 frames in 0.21 seconds (2090.79 fps)
Code:
clip = vsrvrt.Denoise(clip, preview_mode=True)
and got:
Code:
F:\Hybrid\64bit\Vapoursynth>VSPipe.exe c:\Users\Selur\Desktop\test3.vpy -c y4m NUL --progress
RVRT: Using preview mode (lazy chunk processing)
Warning: F:\Hybrid\64bit\Vapoursynth\Lib\site-packages\torch\functional.py:554: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at C:\actions-runner\_work\pytorch\pytorch\pytorch\aten\src\ATen\native\TensorShape.cpp:4316.)
  return _VF.meshgrid(tensors, **kwargs)  # type: ignore[attr-defined]

Loading model from: C:\Users\Selur\AppData\Local\vsrvrt\models\006_RVRT_videodenoising_DAVIS_16frames.pth
RVRT: Preview mode - 429 frames in 9 chunk(s)
RVRT: Chunk size=64, processing on-demand
Script evaluation done in 2.03 seconds
RVRT: Processing chunk 1/9 (frames 0-63) for preview
RVRT: Auto-tiling: (64, 256, 256)
RVRT: Available VRAM: 14.5 GB, Estimated: 8.7 GB
RVRT: Processing chunk 2/9 (frames 48-111) for preview
RVRT: Auto-tiling: (64, 256, 256)
RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB
RVRT: Processing chunk 3/9 (frames 96-159) for preview
RVRT: Auto-tiling: (64, 256, 256)
RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB
RVRT: Processing chunk 4/9 (frames 144-207) for preview
RVRT: Auto-tiling: (64, 256, 256)
RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB
RVRT: Processing chunk 5/9 (frames 192-255) for preview
RVRT: Auto-tiling: (64, 256, 256)
RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB
RVRT: Processing chunk 6/9 (frames 240-303) for preview
RVRT: Auto-tiling: (64, 256, 256)
RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB
RVRT: Processing chunk 7/9 (frames 288-351) for preview
RVRT: Auto-tiling: (64, 256, 256)
RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB
RVRT: Processing chunk 8/9 (frames 336-399) for preview
RVRT: Auto-tiling: (64, 256, 256)
RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB
RVRT: Processing chunk 9/9 (frames 384-428) for preview
RVRT: Auto-tiling: (64, 256, 256)
RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB
Output 429 frames in 61.37 seconds (6.99 fps)
for:
Code:
clip = vsrvrt.Deblur(clip, preview_mode=True)
I got:
Code:
F:\Hybrid\64bit\Vapoursynth>VSPipe.exe c:\Users\Selur\Desktop\test3.vpy -c y4m NUL --progress
RVRT: Using preview mode (lazy chunk processing)
Warning: F:\Hybrid\64bit\Vapoursynth\Lib\site-packages\torch\functional.py:554: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at C:\actions-runner\_work\pytorch\pytorch\pytorch\aten\src\ATen\native\TensorShape.cpp:4316.)
  return _VF.meshgrid(tensors, **kwargs)  # type: ignore[attr-defined]

Loading model from: C:\Users\Selur\AppData\Local\vsrvrt\models\005_RVRT_videodeblurring_GoPro_16frames.pth
RVRT: Preview mode - 429 frames in 9 chunk(s)
RVRT: Chunk size=64, processing on-demand
Script evaluation done in 2.14 seconds
RVRT: Processing chunk 1/9 (frames 0-63) for preview
RVRT: Auto-tiling: (64, 256, 256)
RVRT: Available VRAM: 14.5 GB, Estimated: 8.7 GB
RVRT: Processing chunk 2/9 (frames 48-111) for preview
RVRT: Auto-tiling: (64, 256, 256)
RVRT: Available VRAM: 14.5 GB, Estimated: 8.7 GB
RVRT: Processing chunk 3/9 (frames 96-159) for preview
RVRT: Auto-tiling: (64, 256, 256)
RVRT: Available VRAM: 14.5 GB, Estimated: 8.7 GB
RVRT: Processing chunk 4/9 (frames 144-207) for preview
RVRT: Auto-tiling: (64, 256, 256)
RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB
RVRT: Processing chunk 5/9 (frames 192-255) for preview
RVRT: Auto-tiling: (64, 256, 256)
RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB
RVRT: Processing chunk 6/9 (frames 240-303) for preview
RVRT: Auto-tiling: (64, 256, 256)
RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB
RVRT: Processing chunk 7/9 (frames 288-351) for preview
RVRT: Auto-tiling: (64, 256, 256)
RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB
RVRT: Processing chunk 8/9 (frames 336-399) for preview
RVRT: Auto-tiling: (64, 256, 256)
RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB
RVRT: Processing chunk 9/9 (frames 384-428) for preview
RVRT: Auto-tiling: (64, 256, 256)
RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB
Output 429 frames in 60.19 seconds (7.13 fps)
Cu Selur
__________________
Hybrid here in the forum, homepage, its own forum

Last edited by Selur; 24th February 2026 at 18:27.
Selur is offline   Reply With Quote
Old 26th February 2026, 00:05   #228  |  Link
ReinerSchweinlin
Registered User
 
Join Date: Oct 2001
Posts: 501
thanx. 16gb vram? which gpu did you use?
ReinerSchweinlin is offline   Reply With Quote
Old 26th February 2026, 12:39   #229  |  Link
Selur
.
 
Selur's Avatar
 
Join Date: Oct 2001
Location: Germany
Posts: 7,875
my Geforce RTX 4080
__________________
Hybrid here in the forum, homepage, its own forum
Selur is offline   Reply With Quote
Old 26th February 2026, 20:44   #230  |  Link
Selur
.
 
Selur's Avatar
 
Join Date: Oct 2001
Location: Germany
Posts: 7,875
Uploading a new dev&torch atm., which will be up in 1 1/2 hours which has basic support for RVRT.

Cu Selur
__________________
Hybrid here in the forum, homepage, its own forum
Selur is offline   Reply With Quote
Old 27th February 2026, 09:19   #231  |  Link
ReinerSchweinlin
Registered User
 
Join Date: Oct 2001
Posts: 501
Quote:
Originally Posted by Selur View Post
Uploading a new dev&torch atm., which will be up in 1 1/2 hours which has basic support for RVRT.

Cu Selur
nice
thanx !
ReinerSchweinlin is offline   Reply With Quote
Old 27th February 2026, 12:38   #232  |  Link
Selur
.
 
Selur's Avatar
 
Join Date: Oct 2001
Location: Germany
Posts: 7,875
side note: you might want to enable 'Lazy Chunking'/'preview_mode' and lower the chunking values, if you use the filter in a preview.
Without 'Lazy Chunking'/'preview_mode' all frames get processed before outputting a frame,..
__________________
Hybrid here in the forum, homepage, its own forum
Selur is offline   Reply With Quote
Old 27th February 2026, 13:07   #233  |  Link
ReinerSchweinlin
Registered User
 
Join Date: Oct 2001
Posts: 501
Quote:
Originally Posted by Selur View Post
side note: you might want to enable 'Lazy Chunking'/'preview_mode' and lower the chunking values, if you use the filter in a preview.
Without 'Lazy Chunking'/'preview_mode' all frames get processed before outputting a frame,..
good to know Thanx !
ReinerSchweinlin is offline   Reply With Quote
Old 4th March 2026, 21:39   #234  |  Link
ReinerSchweinlin
Registered User
 
Join Date: Oct 2001
Posts: 501
tried it on my 4060TI 16GB ...

The deblur model works fine, but with the Super resoultion I get no visible difference (enabled DIFF in preview). Running a 1x "clean up pass"

Its a MPEG2 File as MKV, just deinterlaced prior to running RVRT.

I remember in the past that some of the resizers needed actual resize to be enabled in the resize tab - tried that, made no difference.

ah, another thing I noticed:

the tiled processing (deblur in this case) seems to produce a fine line sometimes visible

Last edited by ReinerSchweinlin; 4th March 2026 at 21:44.
ReinerSchweinlin is offline   Reply With Quote
Old 5th March 2026, 05:51   #235  |  Link
Selur
.
 
Selur's Avatar
 
Join Date: Oct 2001
Location: Germany
Posts: 7,875
Resizing does give quite different results for me, depending on the input. Like results are not as aggresive as for example RealESRGAN, but they are there. To to me that seems to work fine.
Since the changes are more subtile, you might loose them depending on the additional resizing that is done to archive your target resolution.
About tiling: I'll probably also add the tile_overlap control to the gui, which should allow to lower / circumvent this effect.

Cu Selur
__________________
Hybrid here in the forum, homepage, its own forum
Selur is offline   Reply With Quote
Old 5th March 2026, 16:56   #236  |  Link
Selur
.
 
Selur's Avatar
 
Join Date: Oct 2001
Location: Germany
Posts: 7,875
Added tile_overlap controls to Hybrid, which should help with those lines.
__________________
Hybrid here in the forum, homepage, its own forum
Selur is offline   Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 17:59.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.