Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion. Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules. Domains: forum.doom9.org / forum.doom9.net / forum.doom9.se |
|
|
#221 | Link | |
|
.
![]() Join Date: Oct 2001
Location: Germany
Posts: 7,875
|
Quote:
I used it through ComfyUI following https://www.youtube.com/watch?v=MBtWYXq_r60 Just wanted to show that it really produces nice results if you feed it a clean source. ![]() Haven't played around with it much simply due to the resource hunger of the whole thing. ![]() Cu Selur |
|
|
|
|
|
|
#222 | Link | |
|
Registered User
Join Date: Oct 2001
Posts: 501
|
Quote:
![]() I did not really expect it ![]() Yes, its very hungry... I tried to use multiple GPUs to speed it up - no luck at the moment... The diffusion ability indeed is able to introduce new details, very fascinating to see. |
|
|
|
|
|
|
#223 | Link | |
|
.
![]() Join Date: Oct 2001
Location: Germany
Posts: 7,875
|
Quote:
|
|
|
|
|
|
|
#224 | Link |
|
.
![]() Join Date: Oct 2001
Location: Germany
Posts: 7,875
|
Just saw RVRT (Recurrent Video Restoration Transformer), which atm. doesn't work with Python 3.12+, but I thought it might be interesting for someone here.
![]() vs-rvrt is based on https://github.com/JingyunLiang/RVRT Update 1: might work with Python 3.12+ now, but fails on portable environment since it can't find cuda,... Cu Selur Last edited by Selur; 18th February 2026 at 18:26. |
|
|
|
|
|
#227 | Link |
|
.
![]() Join Date: Oct 2001
Location: Germany
Posts: 7,875
|
Just tested with
Code:
clip = vsrvrt.SuperRes(clip, scale=4, model="reds",preview_mode=True) Code:
F:\Hybrid\64bit\Vapoursynth>VSPipe.exe c:\Users\Selur\Desktop\test3.vpy -c y4m NUL --progress RVRT: Using preview mode (lazy chunk processing) Warning: F:\Hybrid\64bit\Vapoursynth\Lib\site-packages\torch\functional.py:554: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at C:\actions-runner\_work\pytorch\pytorch\pytorch\aten\src\ATen\native\TensorShape.cpp:4316.) return _VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined] Loading model from: C:\Users\Selur\AppData\Local\vsrvrt\models\001_RVRT_videosr_bi_REDS_30frames.pth RVRT: Preview mode - 429 frames in 9 chunk(s) RVRT: Chunk size=64, processing on-demand Script evaluation done in 2.14 seconds RVRT: Processing chunk 1/9 (frames 0-63) for preview RVRT: Auto-tiling: (11, 256, 256) RVRT: Available VRAM: 14.5 GB, Estimated: 14.5 GB RVRT: Processing chunk 2/9 (frames 48-111) for preview RVRT: Auto-tiling: (10, 256, 256) RVRT: Available VRAM: 14.4 GB, Estimated: 13.2 GB RVRT: Processing chunk 3/9 (frames 96-159) for preview RVRT: Auto-tiling: (10, 256, 256) RVRT: Available VRAM: 14.3 GB, Estimated: 13.2 GB RVRT: Processing chunk 4/9 (frames 144-207) for preview RVRT: Auto-tiling: (10, 256, 256) RVRT: Available VRAM: 14.3 GB, Estimated: 13.2 GB RVRT: Processing chunk 5/9 (frames 192-255) for preview RVRT: Auto-tiling: (10, 256, 256) RVRT: Available VRAM: 14.3 GB, Estimated: 13.2 GB RVRT: Processing chunk 6/9 (frames 240-303) for preview RVRT: Auto-tiling: (10, 256, 256) RVRT: Available VRAM: 14.3 GB, Estimated: 13.2 GB RVRT: Processing chunk 7/9 (frames 288-351) for preview RVRT: Auto-tiling: (10, 256, 256) RVRT: Available VRAM: 14.3 GB, Estimated: 13.2 GB RVRT: Processing chunk 8/9 (frames 336-399) for preview RVRT: Auto-tiling: (10, 256, 256) RVRT: Available VRAM: 14.3 GB, Estimated: 13.2 GB RVRT: Processing chunk 9/9 (frames 384-428) for preview RVRT: Auto-tiling: (10, 256, 256) RVRT: Available VRAM: 14.3 GB, Estimated: 13.2 GB Output 429 frames in 1034.04 seconds (0.41 fps) Code:
clip = vsrvrt.SuperRes(clip, scale=4, model="reds",preview_mode=False) Code:
F:\Hybrid\64bit\Vapoursynth>VSPipe.exe c:\Users\Selur\Desktop\test3.vpy -c y4m NUL --progress RVRT: Using chunked processing (video too long for single-pass) Warning: F:\Hybrid\64bit\Vapoursynth\Lib\site-packages\torch\functional.py:554: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at C:\actions-runner\_work\pytorch\pytorch\pytorch\aten\src\ATen\native\TensorShape.cpp:4316.) return _VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined] Loading model from: C:\Users\Selur\AppData\Local\vsrvrt\models\001_RVRT_videosr_bi_REDS_30frames.pth RVRT: Processing 429 frames in 9 chunk(s) RVRT: Chunk size=64, overlap=16 RVRT: Processing chunk 1/9 (frames 0-63) RVRT: Auto-tiling: (11, 256, 256) RVRT: Available VRAM: 14.5 GB, Estimated: 14.5 GB RVRT: Processing chunk 2/9 (frames 48-111) RVRT: Auto-tiling: (10, 256, 256) RVRT: Available VRAM: 14.4 GB, Estimated: 13.2 GB RVRT: Processing chunk 3/9 (frames 96-159) RVRT: Auto-tiling: (10, 256, 256) RVRT: Available VRAM: 14.3 GB, Estimated: 13.2 GB RVRT: Processing chunk 4/9 (frames 144-207) RVRT: Auto-tiling: (10, 256, 256) RVRT: Available VRAM: 14.3 GB, Estimated: 13.2 GB RVRT: Processing chunk 5/9 (frames 192-255) RVRT: Auto-tiling: (10, 256, 256) RVRT: Available VRAM: 14.3 GB, Estimated: 13.2 GB RVRT: Processing chunk 6/9 (frames 240-303) RVRT: Auto-tiling: (10, 256, 256) RVRT: Available VRAM: 14.3 GB, Estimated: 13.2 GB RVRT: Processing chunk 7/9 (frames 288-351) RVRT: Auto-tiling: (10, 256, 256) RVRT: Available VRAM: 14.3 GB, Estimated: 13.2 GB RVRT: Processing chunk 8/9 (frames 336-399) RVRT: Auto-tiling: (10, 256, 256) RVRT: Available VRAM: 14.3 GB, Estimated: 13.2 GB RVRT: Processing chunk 9/9 (frames 384-428) RVRT: Padded chunk from 45 to 64 frames RVRT: Auto-tiling: (10, 256, 256) RVRT: Available VRAM: 14.3 GB, Estimated: 13.2 GB RVRT: Final output shape: torch.Size([1, 429, 3, 1408, 2560]) Script evaluation done in 1050.36 seconds Output 429 frames in 6.47 seconds (66.28 fps) Also tested: Code:
clip = vsrvrt.Denoise(clip) Code:
F:\Hybrid\64bit\Vapoursynth>VSPipe.exe c:\Users\Selur\Desktop\test3.vpy -c y4m NUL --progress Information: VideoSource track #0 index progress 7% RVRT: Using chunked processing (video too long for single-pass) Warning: F:\Hybrid\64bit\Vapoursynth\Lib\site-packages\torch\functional.py:554: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at C:\actions-runner\_work\pytorch\pytorch\pytorch\aten\src\ATen\native\TensorShape.cpp:4316.) return _VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined] Loading model from: C:\Users\Selur\AppData\Local\vsrvrt\models\006_RVRT_videodenoising_DAVIS_16frames.pth RVRT: Processing 429 frames in 9 chunk(s) RVRT: Chunk size=64, overlap=16 RVRT: Processing chunk 1/9 (frames 0-63) RVRT: Auto-tiling: (64, 256, 256) RVRT: Available VRAM: 14.5 GB, Estimated: 8.7 GB RVRT: Processing chunk 2/9 (frames 48-111) RVRT: Auto-tiling: (64, 256, 256) RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB RVRT: Processing chunk 3/9 (frames 96-159) RVRT: Auto-tiling: (64, 256, 256) RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB RVRT: Processing chunk 4/9 (frames 144-207) RVRT: Auto-tiling: (64, 256, 256) RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB RVRT: Processing chunk 5/9 (frames 192-255) RVRT: Auto-tiling: (64, 256, 256) RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB RVRT: Processing chunk 6/9 (frames 240-303) RVRT: Auto-tiling: (64, 256, 256) RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB RVRT: Processing chunk 7/9 (frames 288-351) RVRT: Auto-tiling: (64, 256, 256) RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB RVRT: Processing chunk 8/9 (frames 336-399) RVRT: Auto-tiling: (64, 256, 256) RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB RVRT: Processing chunk 9/9 (frames 384-428) RVRT: Padded chunk from 45 to 64 frames RVRT: Auto-tiling: (64, 256, 256) RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB RVRT: Final output shape: torch.Size([1, 429, 3, 352, 640]) Script evaluation done in 63.90 seconds Output 429 frames in 0.21 seconds (2090.79 fps) Code:
clip = vsrvrt.Denoise(clip, preview_mode=True) Code:
F:\Hybrid\64bit\Vapoursynth>VSPipe.exe c:\Users\Selur\Desktop\test3.vpy -c y4m NUL --progress RVRT: Using preview mode (lazy chunk processing) Warning: F:\Hybrid\64bit\Vapoursynth\Lib\site-packages\torch\functional.py:554: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at C:\actions-runner\_work\pytorch\pytorch\pytorch\aten\src\ATen\native\TensorShape.cpp:4316.) return _VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined] Loading model from: C:\Users\Selur\AppData\Local\vsrvrt\models\006_RVRT_videodenoising_DAVIS_16frames.pth RVRT: Preview mode - 429 frames in 9 chunk(s) RVRT: Chunk size=64, processing on-demand Script evaluation done in 2.03 seconds RVRT: Processing chunk 1/9 (frames 0-63) for preview RVRT: Auto-tiling: (64, 256, 256) RVRT: Available VRAM: 14.5 GB, Estimated: 8.7 GB RVRT: Processing chunk 2/9 (frames 48-111) for preview RVRT: Auto-tiling: (64, 256, 256) RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB RVRT: Processing chunk 3/9 (frames 96-159) for preview RVRT: Auto-tiling: (64, 256, 256) RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB RVRT: Processing chunk 4/9 (frames 144-207) for preview RVRT: Auto-tiling: (64, 256, 256) RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB RVRT: Processing chunk 5/9 (frames 192-255) for preview RVRT: Auto-tiling: (64, 256, 256) RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB RVRT: Processing chunk 6/9 (frames 240-303) for preview RVRT: Auto-tiling: (64, 256, 256) RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB RVRT: Processing chunk 7/9 (frames 288-351) for preview RVRT: Auto-tiling: (64, 256, 256) RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB RVRT: Processing chunk 8/9 (frames 336-399) for preview RVRT: Auto-tiling: (64, 256, 256) RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB RVRT: Processing chunk 9/9 (frames 384-428) for preview RVRT: Auto-tiling: (64, 256, 256) RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB Output 429 frames in 61.37 seconds (6.99 fps) Code:
clip = vsrvrt.Deblur(clip, preview_mode=True) Code:
F:\Hybrid\64bit\Vapoursynth>VSPipe.exe c:\Users\Selur\Desktop\test3.vpy -c y4m NUL --progress RVRT: Using preview mode (lazy chunk processing) Warning: F:\Hybrid\64bit\Vapoursynth\Lib\site-packages\torch\functional.py:554: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at C:\actions-runner\_work\pytorch\pytorch\pytorch\aten\src\ATen\native\TensorShape.cpp:4316.) return _VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined] Loading model from: C:\Users\Selur\AppData\Local\vsrvrt\models\005_RVRT_videodeblurring_GoPro_16frames.pth RVRT: Preview mode - 429 frames in 9 chunk(s) RVRT: Chunk size=64, processing on-demand Script evaluation done in 2.14 seconds RVRT: Processing chunk 1/9 (frames 0-63) for preview RVRT: Auto-tiling: (64, 256, 256) RVRT: Available VRAM: 14.5 GB, Estimated: 8.7 GB RVRT: Processing chunk 2/9 (frames 48-111) for preview RVRT: Auto-tiling: (64, 256, 256) RVRT: Available VRAM: 14.5 GB, Estimated: 8.7 GB RVRT: Processing chunk 3/9 (frames 96-159) for preview RVRT: Auto-tiling: (64, 256, 256) RVRT: Available VRAM: 14.5 GB, Estimated: 8.7 GB RVRT: Processing chunk 4/9 (frames 144-207) for preview RVRT: Auto-tiling: (64, 256, 256) RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB RVRT: Processing chunk 5/9 (frames 192-255) for preview RVRT: Auto-tiling: (64, 256, 256) RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB RVRT: Processing chunk 6/9 (frames 240-303) for preview RVRT: Auto-tiling: (64, 256, 256) RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB RVRT: Processing chunk 7/9 (frames 288-351) for preview RVRT: Auto-tiling: (64, 256, 256) RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB RVRT: Processing chunk 8/9 (frames 336-399) for preview RVRT: Auto-tiling: (64, 256, 256) RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB RVRT: Processing chunk 9/9 (frames 384-428) for preview RVRT: Auto-tiling: (64, 256, 256) RVRT: Available VRAM: 14.4 GB, Estimated: 8.7 GB Output 429 frames in 60.19 seconds (7.13 fps) Last edited by Selur; 24th February 2026 at 18:27. |
|
|
|
|
|
#232 | Link |
|
.
![]() Join Date: Oct 2001
Location: Germany
Posts: 7,875
|
side note: you might want to enable 'Lazy Chunking'/'preview_mode' and lower the chunking values, if you use the filter in a preview.
Without 'Lazy Chunking'/'preview_mode' all frames get processed before outputting a frame,.. |
|
|
|
|
|
#234 | Link |
|
Registered User
Join Date: Oct 2001
Posts: 501
|
tried it on my 4060TI 16GB ...
The deblur model works fine, but with the Super resoultion I get no visible difference (enabled DIFF in preview). Running a 1x "clean up pass" Its a MPEG2 File as MKV, just deinterlaced prior to running RVRT. I remember in the past that some of the resizers needed actual resize to be enabled in the resize tab - tried that, made no difference. ah, another thing I noticed: the tiled processing (deblur in this case) seems to produce a fine line sometimes visible Last edited by ReinerSchweinlin; 4th March 2026 at 21:44. |
|
|
|
|
|
#235 | Link |
|
.
![]() Join Date: Oct 2001
Location: Germany
Posts: 7,875
|
Resizing does give quite different results for me, depending on the input. Like results are not as aggresive as for example RealESRGAN, but they are there. To to me that seems to work fine.
Since the changes are more subtile, you might loose them depending on the additional resizing that is done to archive your target resolution. About tiling: I'll probably also add the tile_overlap control to the gui, which should allow to lower / circumvent this effect. Cu Selur |
|
|
|
![]() |
| Thread Tools | |
| Display Modes | |
|
|