Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion.

Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules.

 

Go Back   Doom9's Forum > Capturing and Editing Video > VapourSynth

Reply
 
Thread Tools Search this Thread Display Modes
Old 25th August 2021, 03:38   #1  |  Link
poisondeathray
Registered User
 
Join Date: Sep 2007
Posts: 5,332
vs-basicvsr

Yet another contribution from HolyWu!

Thanks

https://github.com/HolyWu/vs-basicvsr

This one is true temporal SR for video, not single images

Also has tiling option for low GPU memory vs. task

Nice!
poisondeathray is offline   Reply With Quote
Old 25th August 2021, 22:12   #2  |  Link
Zarxrax
Registered User
 
Join Date: Dec 2001
Posts: 1,219
What is this difference between vs-basicvsr, vs-realesrgan, and VSGAN?
As far as I can see, it looks like vs-basicvsr & vs-realesrgan have built-in models that you can use, wheras VSGAN lets you just use whatever model you want.
Is there something else that I am missing?
Zarxrax is offline   Reply With Quote
Old 25th August 2021, 23:38   #3  |  Link
poisondeathray
Registered User
 
Join Date: Sep 2007
Posts: 5,332
Quote:
Originally Posted by Zarxrax View Post
What is this difference between vs-basicvsr, vs-realesrgan, and VSGAN?
As far as I can see, it looks like vs-basicvsr & vs-realesrgan have built-in models that you can use, wheras VSGAN lets you just use whatever model you want.
Is there something else that I am missing?
Yes,

other differences - vsgan implementation of ESRGAN does not have tiling (image is split up with padding and stitched up back togethe) - this helps when your GPU has low memory compared to image size; some other ESRGAN implementations have tiling. Quality wise you cannot tell the difference with large enough padding even zoomed in on still images - although it is detectable with amplified differences.

basicvsr is temporal - in general there is less aliasing and temporal flicker. It's meant for video and works on more than 1 frame. The others are meant for still images (except tecogan, but that does not have a VPY implementation). Single image based SR has less temporal consistency. Unfortunately I'm finding the 3 models provided for basicvsr generally only work for fairly clean sources. Just like with other GAN's you generally have to pre and post process to "massage" the input for a suitable model. It would be nice if you had a specific model for everything and thousands of different situations - I don't see it happening

But users can train their own models for basicvsr and realesrgan - the training code is published - but there isn't a public repository for them - only the published paper models are readily available. In theory you should be able to use other pre-trained models too, with minor adjustment to the script

Last edited by poisondeathray; 25th August 2021 at 23:41.
poisondeathray is offline   Reply With Quote
Old 26th August 2021, 02:17   #4  |  Link
aegisofrime
Registered User
 
Join Date: Apr 2009
Posts: 478
HolyWu is on a roll, holy molly.

Hoping to see VS implementations of AMD FSR or Intel XeSS next
aegisofrime is offline   Reply With Quote
Old 26th August 2021, 02:25   #5  |  Link
kedautinh12
Registered User
 
Join Date: Jan 2018
Posts: 2,127
Quote:
Originally Posted by aegisofrime View Post
HolyWu is on a roll, holy molly.

Hoping to see VS implementations of AMD FSR or Intel XeSS next
I think Nvidia dlss is better but sad it's close source
kedautinh12 is offline   Reply With Quote
Old 26th August 2021, 02:46   #6  |  Link
aegisofrime
Registered User
 
Join Date: Apr 2009
Posts: 478
Quote:
Originally Posted by kedautinh12 View Post
I think Nvidia dlss is better but sad it's close source
Yeah, that was the reason I didn't mention DLSS, unless nvidia decides to open source it due to competitive pressure.
aegisofrime is offline   Reply With Quote
Old 26th August 2021, 07:49   #7  |  Link
edcrfv94
Registered User
 
Join Date: Apr 2015
Posts: 84
Quote:
Originally Posted by aegisofrime View Post
Yeah, that was the reason I didn't mention DLSS, unless nvidia decides to open source it due to competitive pressure.
DLSS need motion vector.
edcrfv94 is offline   Reply With Quote
Old 26th August 2021, 07:53   #8  |  Link
kedautinh12
Registered User
 
Join Date: Jan 2018
Posts: 2,127
Quote:
Originally Posted by edcrfv94 View Post
DLSS need motion vector.
Yes, DLSS only for RTX card
kedautinh12 is offline   Reply With Quote
Old 26th August 2021, 12:04   #9  |  Link
Quadratic
Registered User
 
Join Date: Jul 2021
Posts: 26
Quote:
Originally Posted by aegisofrime View Post
HolyWu is on a roll, holy molly.

Hoping to see VS implementations of AMD FSR or Intel XeSS next
https://github.com/GPUOpen-Effects/F...fsr/ffx_fsr1.h
AMD FSR (EASU) is quite interesting, I would imagine one would probably be able to approximate the results with existing tools - but an actual implementation would be nice.
Quadratic is offline   Reply With Quote
Old 26th August 2021, 15:11   #10  |  Link
Julek
Registered User
 
Julek's Avatar
 
Join Date: Dec 2020
Posts: 83
DLSS even if open would not be easy to port, the models are trained specifically for each game, there is no generic model.
But if you have an RTX card, you can at least use DLISR, via the Akarin plugin.
https://github.com/AkarinVS/vapoursynth-plugin#dlisr
Julek is offline   Reply With Quote
Old 26th August 2021, 15:17   #11  |  Link
aegisofrime
Registered User
 
Join Date: Apr 2009
Posts: 478
Quote:
Originally Posted by Julek View Post
DLSS even if open would not be easy to port, the models are trained specifically for each game, there is no generic model.
But if you have an RTX card, you can at least use DLISR, via the Akarin plugin.
https://github.com/AkarinVS/vapoursynth-plugin#dlisr
OMG, I have been looking for a DLSS VS plugin for ages now, but I guess I either didn't bother Googling for it or my Google skills suck. Thanks for linking this! I wonder how many other plugins lie under my nose...
aegisofrime is offline   Reply With Quote
Old 26th August 2021, 17:56   #12  |  Link
Selur
Registered User
 
Selur's Avatar
 
Join Date: Oct 2001
Location: Germany
Posts: 7,231
Quote:
vs-basicvsr
Yet another contribution from HolyWu!
Nice, and there goes the weekend,..
__________________
Hybrid here in the forum, homepage
Selur is offline   Reply With Quote
Old 26th August 2021, 20:25   #13  |  Link
edcrfv94
Registered User
 
Join Date: Apr 2015
Posts: 84
Quote:
Originally Posted by Julek View Post
DLSS even if open would not be easy to port, the models are trained specifically for each game, there is no generic model.
But if you have an RTX card, you can at least use DLISR, via the Akarin plugin.
https://github.com/AkarinVS/vapoursynth-plugin#dlisr
DLSS 2.0 is generic model, but still need motion vector.
This means it cannot be used for video.
edcrfv94 is offline   Reply With Quote
Old 27th August 2021, 02:10   #14  |  Link
aegisofrime
Registered User
 
Join Date: Apr 2009
Posts: 478
Quote:
Originally Posted by edcrfv94 View Post
DLSS 2.0 is generic model, but still need motion vector.
This means it cannot be used for video.
According to the plugin description, it is using NGX though which is indeed designed for video applications.
aegisofrime is offline   Reply With Quote
Old 27th August 2021, 02:48   #15  |  Link
kedautinh12
Registered User
 
Join Date: Jan 2018
Posts: 2,127
Quote:
Originally Posted by aegisofrime View Post
According to the plugin description, it is using NGX though which is indeed designed for video applications.
I think DLSS don't same DLISR
kedautinh12 is offline   Reply With Quote
Old 27th August 2021, 21:06   #16  |  Link
Selur
Registered User
 
Selur's Avatar
 
Join Date: Oct 2001
Location: Germany
Posts: 7,231
Btw. has anyone an example where BasicVSR show some impressive results when starting from a 480p or 576p source?
Normal resizing using i.e. Lanczos and adding some contrast sharpening seems to produce more impressive results.
Only thing that I found is that it does do well is upscaling QCIF content, and I wonder whether that is it's goal.

Cu Selur
__________________
Hybrid here in the forum, homepage

Last edited by Selur; 27th August 2021 at 21:59.
Selur is offline   Reply With Quote
Old 27th August 2021, 21:20   #17  |  Link
ChaosKing
Registered User
 
Join Date: Dec 2005
Location: Germany
Posts: 1,788
@Selur I think the link is broken.
__________________
AVSRepoGUI // VSRepoGUI - Package Manager for AviSynth // VapourSynth
VapourSynth Portable FATPACK || VapourSynth Database
ChaosKing is offline   Reply With Quote
Old 27th August 2021, 22:00   #18  |  Link
Selur
Registered User
 
Selur's Avatar
 
Join Date: Oct 2001
Location: Germany
Posts: 7,231
Sorry, fixed now.
__________________
Hybrid here in the forum, homepage
Selur is offline   Reply With Quote
Old 28th August 2021, 00:38   #19  |  Link
kedautinh12
Registered User
 
Join Date: Jan 2018
Posts: 2,127
The link work for me but almost German
kedautinh12 is offline   Reply With Quote
Old 28th August 2021, 03:06   #20  |  Link
Reel.Deel
Registered User
 
Join Date: Mar 2012
Location: Texas
Posts: 1,664
Quote:
Originally Posted by kedautinh12 View Post
The link work for me but almost German
That is because is a German forum
Reel.Deel is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 02:34.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2024, vBulletin Solutions Inc.