[Neo] Vague-Denoiser

[MeteorRain]

Neo filters family is not to be confused with AviSynth-Neo. Neo filters family is not affiliated in any way with AviSynth-Neo.

[Neo] Vague Denoiser → GitHub

Vague Denoiser is a wavelet based denoiser.

Basically, it transforms each frame from the video input into the wavelet domain, using Cohen-Daubechies-Feauveau 9/7. Then it applies some filtering to the obtained coefficients. It does an inverse wavelet transform after. Due to wavelet properties, it should give a nice smoothed result, and reduced noise, without blurring picture features.

It was originally written by Lefungus, and later modified by Kurosu and Fizick for further improvement. VapourSynth-VagueDenoiser was ported to VapourSynth interface and refactored by HolyWu. Kudos to them for creating and improving this fantastic tool.

Difference compared to VapourSynth-VagueDenoiser

• Dual interface, supporting AviSynth+ and VapourSynth
• Added SSE and AVX routine

Result bit-identicalness

• Neo-Vague-Denoiser C - VapourSynth-VagueDenoiser C: identical
  ===== ===== ===== =====
• Neo-Vague-Denoiser SSE - C: non-identical due to order of floating point addition and multiplication
• Neo-Vague-Denoiser AVX - C: non-identical due to order of floating point addition and multiplication
  PSNR on default parameters:
  8-bit ~93dB; 16-bit ~115dB
  
• Neo-Vague-Denoiser SSE - AVX: identical

[StainlessS]

Right from the beginning, my favourtite spatial denoiser, thanks very much.

EDIT: To below. yip, will do, again thanx

[MeteorRain]

You are very welcome. Definitely let me know if you see something wrong with it.

[ChaosKing]

32 float input crashes vsedit.
Smaller resolutions have a green border

clip = core.std.BlankClip(format=vs.YUV420P8, width=480, height=480, length=500)
clip = core.neo_vd.VagueDenoiser(clip)

Tested clang version x64 on win10 ryzen 2600

EDIT green border is only with opt=4 or 5 visible => AVX stuff.

[MeteorRain]

Please try r1v2.

[Atak_Snajpera]

Originally Posted by StainlessS

Right from the beginning, my favourtite spatial denoiser, thanks very much.

EDIT: To below. yip, will do, again thanx

Too bad that it introduces reduction of resolution.

Original


neo_vd(threshold=10.0, nsteps=6, y=3, u=3, v=3)


KNLMeansCL(d=1, a=2, s=4, h=6, device_type="GPU", device_id=0)



One thing this filter does best is simulation of compression artefacts

threshold=25.0

[StainlessS]

Dear me, never tried a threshold anywhere near as high as 25.0 or even 10.0.

My reminder thingy

# VagueDenoiser:- YUY2, YV12
# threshold:- filtering strength. 1-1.5 light : 2-3 strong)
#   -ve NO LUMA SMOOTHING
#   0 = Automatic estmimation (DEFAULT)
# ChromaT = Chroma thresholding
#   -ve NO Chroma SMOOTHING
#   0 = Automatic estmimation (DEFAULT)
# interlaced:- Process interlaced fields seperately. YV12 Only else ignored.
#VagueDenoiser(threshold=0.8,method=1,nsteps=6,chromaT=0,interlaced=false)  # EDIT: These are what I would use as starting values.

I dont have a machine that is fast enough for that KNLMeansCL() whotsit. [I dont care how long it takes, but I do have my limits ]

EDIT: I also have little interest in cartoons.

[ChaosKing]

Originally Posted by MeteorRain

Please try r1v2.

All good now

[real.finder]

Finally, thanks

Atak_Snajpera
this filter also good for remove the bad ugly dither https://i.postimg.cc/tTBKJLbL/title0...-eng002928.png

with convertbits(16).neo_vd().convertbits(8) https://i.postimg.cc/sDT48smF/title0...eng002928v.png

[tormento]

Originally Posted by MeteorRain

[Neo] Vague Denoiser

Are you the same Neo who did Neo AviSynth or your "Neo" is just a prefix to the filters?

If you were the same person, I'd be begging you to port all this to CUDA or OpenCL.

[real.finder]

Originally Posted by tormento

Are you the same Neo who did Neo AviSynth or your "Neo" is just a prefix to the filters?

If you were the same person, I'd be begging you to port all this to CUDA or OpenCL.

no, the one who made avs neo is nekopanda (I think he don't even has doom9 id)

you should say OpenCL or CUDA cuz OpenCL work even with cpu only (not all cpus though)

[tormento]

Originally Posted by real.finder

no, the one who made avs neo is nekopanda

We need to do some recruiting for OpenCL and CUDA programming. Some filters definitely needs performance boost.

[FranceBB]

Works fine on Windows XP.
Thanks!

Originally Posted by MeteorRain

it transforms each frame from the video input into the wavelet domain, using Cohen-Daubechies-Feauveau 9/7.

It does indeed.

Originally Posted by MeteorRain

Then it applies some filtering to the obtained coefficients. It does an inverse wavelet transform after. Due to wavelet properties, it should give a nice smoothed result, and reduced noise, without blurring picture features.

The Wavelet transform is one of the transform I like, although it's not my favorite.
It sure has a different approach when it comes to processing 'cause instead of dividing the image in blocks and macroblocks of arbitrary sizes (as long as they're square) like other transform, it processes the whole picture as a whole single block thus avoiding classic edge artifacts. Whether it's useful on denoise as well other than encoding I don't know, but the thing is that the last time I used this denoiser was a very long time ago and I didn't really plan to use the old Vague Denoiser in any modern footage, but since you updated it, I downloaded it, tested it and kept it in my sacred plugins folder 'cause, you know, it's just nice to have.

Originally Posted by StainlessS

I also have little interest in cartoons.

Well, perhaps until your grandchildren will ask you to watch them with them; in that case you'll either like them or hate them for the rest of your life xD (just joking, just joking)
As a matter of fact, I began learning about AVS in 2006 only because of anime (i.e cartoons for adults), but I've encoded less and less of them as I grew up, mostly because of my job concerning only real life stuff and... also because I kinda grew up; still from time to time, although rarely, I still help the fansub I started with years ago. :')
If someone asks me something like "Hey, let's watch Your Name", I'm still keen to watch it and I enjoy it.
Of course, I would NEVER watch stuff like cartoons for children that air on Cartoon Network or stuff like that.
Fun story: there was a time in 2016 when I had to QC all of them after encoding (it was my job T_T) and unfortunately I had to watch this kind of crap for children that I hated from the bottom of my hearth. But it was my job... I couldn't do anything about it...

[feisty2]

don't you guys differentiate cartoon (comics in the US) and anime (comics in Japan)?

[FranceBB]

Originally Posted by feisty2

don't you guys differentiate cartoon (comics in the US) and anime (comics in Japan)?

We do, but anime nowadays are way different.
We can think about them as cartoons but for adults: they are very well developed and they have very good scripts, capable of describing in detail how characters grow up, thus sharing important messages about life, about friendship and so on...
Back when StainlessS was young, however, japanese anime were mainly about giant robots fighting against each other, which many people didn't find very appealing for obvious reasons...
He's from a completely different generation

[tormento]

This thread has definitely gone to hell.

[real.finder]

Originally Posted by tormento

This thread has definitely gone to hell.

why?

Originally Posted by FranceBB

We do, but anime nowadays are way different.
We can think about them as cartoons but for adults: they are very well developed and they have very good scripts, capable of describing in detail how characters grow up, thus sharing important messages about life, about friendship and so on...
Back when StainlessS was young, however, japanese anime were mainly about giant robots fighting against each other, which many people didn't find very appealing for obvious reasons...
He's from a completely different generation

not all USA cartoons for children, there are many for adults like South Park

but most cartoons don't has attractive drawing as most Japanese Animes


@MeteorRain

I note 16bit output not same as 8bit, is it normal or there are some bug?

[tormento]

Originally Posted by real.finder

why?

I was laughing on my own about misconceptions about anime/cartoons.

Some of the most quoted "anime" aired now are written, produced and drawn in other countries than Japan. Not because it costs less but because they are trendy and other country studios are interested to produce their own.

On the 1st best 10 anime aired now, 2/3 are chinese and chinese spoken.

Personally I trained my ear to japanese during these years and it's really hard to listen to them in mandarin.

Please keep also in mind that the so called "anime" or "manga" are the same as "cartoon" or "stripe", just with a different style.

Italian stripes, for examples, have worldwide recognized artists like Milo Manara or Hugo Pratt, with their unique style, completely different from american ones, with deep introspection of characters and stellar graphics. More modern artists, such as Zerocalcare, has chosen to go to a more "manga" style stripe, because it's what people want now, and he uses that style to spot life dilemmas, always in a bittersweet mood.

So, IMHO there is no difference between anime or cartoons, there are differences in the style and the cultural influence of every single nation.

[real.finder]

Originally Posted by real.finder

@MeteorRain

I note 16bit output not same as 8bit, is it normal or there are some bug?

It is very clear with luma_histogram

[MeteorRain]

A minimal script please.

I tried the below and they look the same.

convertbits(16).rel_neo_vd().convertbits(8).luma_histogram()
rel_neo_vd().luma_histogram()