vs-basicvsr

[poisondeathray]

Yet another contribution from HolyWu!

Thanks

https://github.com/HolyWu/vs-basicvsr

This one is true temporal SR for video, not single images

Also has tiling option for low GPU memory vs. task

Nice!

[Zarxrax]

What is this difference between vs-basicvsr, vs-realesrgan, and VSGAN?
As far as I can see, it looks like vs-basicvsr & vs-realesrgan have built-in models that you can use, wheras VSGAN lets you just use whatever model you want.
Is there something else that I am missing?

[poisondeathray]

Originally Posted by Zarxrax

What is this difference between vs-basicvsr, vs-realesrgan, and VSGAN?
As far as I can see, it looks like vs-basicvsr & vs-realesrgan have built-in models that you can use, wheras VSGAN lets you just use whatever model you want.
Is there something else that I am missing?

Yes,

other differences - vsgan implementation of ESRGAN does not have tiling (image is split up with padding and stitched up back togethe) - this helps when your GPU has low memory compared to image size; some other ESRGAN implementations have tiling. Quality wise you cannot tell the difference with large enough padding even zoomed in on still images - although it is detectable with amplified differences.

basicvsr is temporal - in general there is less aliasing and temporal flicker. It's meant for video and works on more than 1 frame. The others are meant for still images (except tecogan, but that does not have a VPY implementation). Single image based SR has less temporal consistency. Unfortunately I'm finding the 3 models provided for basicvsr generally only work for fairly clean sources. Just like with other GAN's you generally have to pre and post process to "massage" the input for a suitable model. It would be nice if you had a specific model for everything and thousands of different situations - I don't see it happening

But users can train their own models for basicvsr and realesrgan - the training code is published - but there isn't a public repository for them - only the published paper models are readily available. In theory you should be able to use other pre-trained models too, with minor adjustment to the script

[aegisofrime]

HolyWu is on a roll, holy molly.

Hoping to see VS implementations of AMD FSR or Intel XeSS next

[kedautinh12]

Originally Posted by aegisofrime

HolyWu is on a roll, holy molly.

Hoping to see VS implementations of AMD FSR or Intel XeSS next

I think Nvidia dlss is better but sad it's close source

[aegisofrime]

Originally Posted by kedautinh12

I think Nvidia dlss is better but sad it's close source

Yeah, that was the reason I didn't mention DLSS, unless nvidia decides to open source it due to competitive pressure.

[edcrfv94]

Originally Posted by aegisofrime

Yeah, that was the reason I didn't mention DLSS, unless nvidia decides to open source it due to competitive pressure.

DLSS need motion vector.

[kedautinh12]

Originally Posted by edcrfv94

DLSS need motion vector.

Yes, DLSS only for RTX card

[Quadratic]

Originally Posted by aegisofrime

HolyWu is on a roll, holy molly.

Hoping to see VS implementations of AMD FSR or Intel XeSS next

https://github.com/GPUOpen-Effects/F...fsr/ffx_fsr1.h
AMD FSR (EASU) is quite interesting, I would imagine one would probably be able to approximate the results with existing tools - but an actual implementation would be nice.

[Julek]

DLSS even if open would not be easy to port, the models are trained specifically for each game, there is no generic model.
But if you have an RTX card, you can at least use DLISR, via the Akarin plugin.
https://github.com/AkarinVS/vapoursynth-plugin#dlisr

[aegisofrime]

Originally Posted by Julek

DLSS even if open would not be easy to port, the models are trained specifically for each game, there is no generic model.
But if you have an RTX card, you can at least use DLISR, via the Akarin plugin.
https://github.com/AkarinVS/vapoursynth-plugin#dlisr

OMG, I have been looking for a DLSS VS plugin for ages now, but I guess I either didn't bother Googling for it or my Google skills suck. Thanks for linking this! I wonder how many other plugins lie under my nose...

[Selur]

vs-basicvsr
Yet another contribution from HolyWu!

Nice, and there goes the weekend,..

[edcrfv94]

Originally Posted by Julek

DLSS even if open would not be easy to port, the models are trained specifically for each game, there is no generic model.
But if you have an RTX card, you can at least use DLISR, via the Akarin plugin.
https://github.com/AkarinVS/vapoursynth-plugin#dlisr

DLSS 2.0 is generic model, but still need motion vector.
This means it cannot be used for video.

[aegisofrime]

Originally Posted by edcrfv94

DLSS 2.0 is generic model, but still need motion vector.
This means it cannot be used for video.

According to the plugin description, it is using NGX though which is indeed designed for video applications.

[kedautinh12]

Originally Posted by aegisofrime

According to the plugin description, it is using NGX though which is indeed designed for video applications.

I think DLSS don't same DLISR

[Selur]

Btw. has anyone an example where BasicVSR show some impressive results when starting from a 480p or 576p source?
Normal resizing using i.e. Lanczos and adding some contrast sharpening seems to produce more impressive results.
Only thing that I found is that it does do well is upscaling QCIF content, and I wonder whether that is it's goal.

Cu Selur

[ChaosKing]

@Selur I think the link is broken.

[Selur]

Sorry, fixed now.

[kedautinh12]

The link work for me but almost German

[Reel.Deel]

Originally Posted by kedautinh12

The link work for me but almost German

That is because is a German forum