Avisynth+ - Page 75

stax76 · 25th April 2016, 19:23

It can be represented in ANSI charset and therefore should work with AviSynth (which don't support Unicode), if you like you can post a sample to the StaxRip thread.

Reel.Deel · 25th April 2016, 19:32

Quote:

Originally Posted by Groucho2004

Is there even a 64 bit version of avspmod?

Indeed there is: http://forum.doom9.org/showthread.ph...55#post1733655

Leinad4Mind · 25th April 2016, 19:38

Quote:

Originally Posted by Reel.Deel

Indeed there is: http://forum.doom9.org/showthread.ph...58#post1733655

I Love you man :P I didn't know about the x64 version.

Now it works! Thanks for all folks!

pinterf · 25th April 2016, 19:38

It there any specific reason, why Avisynth lacks unicode support?
It's by design or just nobody complained so far?

stax76 · 25th April 2016, 19:43

here is a thread about it:

http://forum.doom9.org/showthread.php?t=110467

yup · 25th April 2016, 20:25

Hi pinterf!

I get error

Code:

---------------------------
VirtualDub Error
---------------------------
Avisynth read error:
CAVIStreamSynth: System exception - Access Violation at 0xae1fc65
---------------------------
ОК   
---------------------------

previous version work fine.
If I comment line with Colormatrix a get other message

Code:

---------------------------
VirtualDub Error
---------------------------
Out of memory (unable to allocate 7116224 bytes)
---------------------------
ОК   
---------------------------

yup.

pinterf · 25th April 2016, 21:48

Quote:

Originally Posted by yup

Hi pinterf!
previous version work fine.
If I comment line with Colormatrix a get other message

Code:

VirtualDub Error
Out of memory (unable to allocate 7116224 bytes)

yup.

What happens if you set default mt mode to 3?
If it works, then one of the filters possibly cannot run in mode 2, only mode 3, (this is serialized mode).

Edit:
For me it works from avsmeter, though max memory consumption is 1860MB (see when set memory max to 2400).
YUY2 conversion inside QTGMC is eating a lot of memory, and speed.
Using SetMemoryMax(1536) it really uses around 1500M but it's not optimal.

mcjordan · 26th April 2016, 06:01

Little sample of plugin including (in StaxRip):
Scripting Editor -> Misc ->
Loadplugin("C:\Portable Apps\StaxRip\Apps\Plugins\avs\MSharpen\msharpen.dll")MSharpen(threshold = 10, strength=100, highq=true, mask=false)

LigH · 26th April 2016, 08:02

Is there no linebreak in the middle?

stax76 · 26th April 2016, 13:32

The profile editor supports multiline:

Code:

parentMenu | profileName =
    Loadplugin("C:\Portable Apps\StaxRip\Apps\Plugins\avs\MSharpen\msharpen.dll")
    MSharpen(threshold = 10, strength=100, highq=true, mask=false)

pinterf · 26th April 2016, 13:42

@yup

This is my script that worked. I had no YUY2 source so I converted to YUY2 right after the source filter.

Code:

SetMemoryMax(2400) # or SetMemoryMax(1536)
SetFilterMTMode("DEFAULT_MT_MODE",2)
SetFilterMTMode("AviSource",3)
Edibob=Avisource("dv_avi_sd_test.avi").ConvertToYUY2()
#Edibob=AVISource("pre14last.avi")## source YUY2 50 fps bobbed
Edibob=Edibob.AssumeTFF()
Edibob.SeparateFields().SelectEvery(4,0,3).Weave().AssumeTFF()
QTGMC(Tuning= "DV-SD",preset="Slow", Ediext=Edibob, Edithreads=1, EZDenoise=6, Denoiser="dfttest", ChromaNoise=true, DenoiseMC=true, NoiseTR=2,dct=5, search=5)
nnedi3_rpow2(rfactor=2,nns=2, qual=1, fwidth=1004, fheight=752,cshift="Spline36Resize").Crop(22,16,-22,-16)
unsharp(varY=465,varC=232,strength=0.3,U=3,V=3)
ConvertToYV12(interlaced=false)
ColorMatrix(mode="Rec.601->Rec.709")
Prefetch(8)

This is the result after the first 3000 frames

Code:

AVSMeter 2.2.2 (x86)
AviSynth+ 0.1 (r1849, MT-pfmod, i386) (0.1.0.0)

Number of frames:               139381
Length (hh:mm:ss.ms):     01:32:55.240
Frame width:                       960
Frame height:                      720
Framerate:                      25.000 (25/1)
Colorspace:                       YV12

Frame (current | last):         3349 | 139380
FPS (cur | min | max | avg):    21.09 | 9.361 | 26.31 | 18.52
Memory usage (phys | virt):     1868 | 1894 MiB
Thread count:                   67
CPU usage (current | average):  87% | 89%

When I converted the source back to YV12 right after the YUY2 simulated source filter, it became much faster and consumed 1000MB less memory.

Code:

Edibob=Avisource("dv_avi_sd_test.avi").ConvertToYUY2().ConvertToYV12()

Code:

AVSMeter 2.2.2 (x86)
AviSynth+ 0.1 (r1849, MT-pfmod, i386) (0.1.0.0)

Number of frames:               139381
Length (hh:mm:ss.ms):     01:32:55.240
Frame width:                       960
Frame height:                      720
Framerate:                      25.000 (25/1)
Colorspace:                       YV12

Frames processed:               3320 (0 - 3319)
FPS (min | max | average):      5.220 | 52.07 | 31.33
Memory usage (phys | virt):     824 | 844 MiB
Thread count:                   69
CPU usage (average):            91%

You can try SetMemoryMax(1000).
It will continously shrink the memory demand, less caching, thus the speed is lower (13.6 vs 18.5 fps) compared to the non-memory limiting version.

Code:

AVSMeter 2.2.2 (x86)
AviSynth+ 0.1 (r1849, MT-pfmod, i386) (0.1.0.0)

Number of frames:               139381
Length (hh:mm:ss.ms):     01:32:55.240
Frame width:                       960
Frame height:                      720
Framerate:                      25.000 (25/1)
Colorspace:                       YV12

Frames processed:               3270 (0 - 3269)
FPS (min | max | average):      7.503 | 18.69 | 13.63
Memory usage (phys | virt):     1212 | 1250 MiB
Thread count:                   67
CPU usage (average):            75%

Two remarks
- SetMemoryMax as we can see is not a 100% limit, setting it to 1000 still uses 1000-1200 MB, minor overshoot is possible.
- Seems that YUY2 is not the optimal format for processing

TheFluff · 26th April 2016, 16:42

Quote:

Originally Posted by pinterf

It there any specific reason, why Avisynth lacks unicode support?
It's by design or just nobody complained so far?

It's the standard Avisynth thing. It didn't support Unicode in 2001, everything must be backwards compatible all the way to 2001 and therefore you can't ever change anything, or if you do you have to jump through a bunch of hoops to make it backwards compatible which makes it so complex that it never gets done. It's not a huge deal, just another one of the countless minor irritations about it. Most people just rename their files if they need to.

real.finder · 27th April 2016, 00:30

Quote:

Originally Posted by pinterf

@yup

This is my script that worked. I had no YUY2 source so I converted to YUY2 right after the source filter.

Code:

SetMemoryMax(2400) # or SetMemoryMax(1536)
SetFilterMTMode("DEFAULT_MT_MODE",2)
SetFilterMTMode("AviSource",3)
Edibob=Avisource("dv_avi_sd_test.avi").ConvertToYUY2()
#Edibob=AVISource("pre14last.avi")## source YUY2 50 fps bobbed
Edibob=Edibob.AssumeTFF()
Edibob.SeparateFields().SelectEvery(4,0,3).Weave().AssumeTFF()
QTGMC(Tuning= "DV-SD",preset="Slow", Ediext=Edibob, Edithreads=1, EZDenoise=6, Denoiser="dfttest", ChromaNoise=true, DenoiseMC=true, NoiseTR=2,dct=5, search=5)
nnedi3_rpow2(rfactor=2,nns=2, qual=1, fwidth=1004, fheight=752,cshift="Spline36Resize").Crop(22,16,-22,-16)
unsharp(varY=465,varC=232,strength=0.3,U=3,V=3)
ConvertToYV12(interlaced=false)
ColorMatrix(mode="Rec.601->Rec.709")
Prefetch(8)

This is the result after the first 3000 frames

Code:

AVSMeter 2.2.2 (x86)
AviSynth+ 0.1 (r1849, MT-pfmod, i386) (0.1.0.0)

Number of frames:               139381
Length (hh:mm:ss.ms):     01:32:55.240
Frame width:                       960
Frame height:                      720
Framerate:                      25.000 (25/1)
Colorspace:                       YV12

Frame (current | last):         3349 | 139380
FPS (cur | min | max | avg):    21.09 | 9.361 | 26.31 | 18.52
Memory usage (phys | virt):     1868 | 1894 MiB
Thread count:                   67
CPU usage (current | average):  87% | 89%

When I converted the source back to YV12 right after the YUY2 simulated source filter, it became much faster and consumed 1000MB less memory.

Code:

Edibob=Avisource("dv_avi_sd_test.avi").ConvertToYUY2().ConvertToYV12()

Code:

AVSMeter 2.2.2 (x86)
AviSynth+ 0.1 (r1849, MT-pfmod, i386) (0.1.0.0)

Number of frames:               139381
Length (hh:mm:ss.ms):     01:32:55.240
Frame width:                       960
Frame height:                      720
Framerate:                      25.000 (25/1)
Colorspace:                       YV12

Frames processed:               3320 (0 - 3319)
FPS (min | max | average):      5.220 | 52.07 | 31.33
Memory usage (phys | virt):     824 | 844 MiB
Thread count:                   69
CPU usage (average):            91%

You can try SetMemoryMax(1000).
It will continously shrink the memory demand, less caching, thus the speed is lower (13.6 vs 18.5 fps) compared to the non-memory limiting version.

Code:

AVSMeter 2.2.2 (x86)
AviSynth+ 0.1 (r1849, MT-pfmod, i386) (0.1.0.0)

Number of frames:               139381
Length (hh:mm:ss.ms):     01:32:55.240
Frame width:                       960
Frame height:                      720
Framerate:                      25.000 (25/1)
Colorspace:                       YV12

Frames processed:               3270 (0 - 3269)
FPS (min | max | average):      7.503 | 18.69 | 13.63
Memory usage (phys | virt):     1212 | 1250 MiB
Thread count:                   67
CPU usage (average):            75%

Two remarks
- SetMemoryMax as we can see is not a 100% limit, setting it to 1000 still uses 1000-1200 MB, minor overshoot is possible.
- Seems that YUY2 is not the optimal format for processing

yes, YUY2 will be slow because:-

1- more data than yv12

2- processing hack (Interleaved to Planar or reverse) if we have yv16 support for all filters it will be faster and less memory processing

yup · 27th April 2016, 19:52

pinterf!

Increasing SetMemoryMax increase fps, when using avsmeter, but during open in VirtualDub I get error, also I am try using ffmpeg for conversion to AVI I see frame with green and pink bars.
All problem gone when Prefetch place after QTGMC call, may be unsharp (when I am replaced nnedi3_rpow2 and unsharp), but not lower (appear color bars in output video).
Folowing script work fine in VirtualDub

Code:

SetMemoryMax(2400) # or SetMemoryMax(1536)
SetFilterMTMode("DEFAULT_MT_MODE",2)
SetFilterMTMode("AviSource",3)
Edibob=AVISource("pre14last.avi")#.ConvertToYV12(interlaced=false)
#.Trim(0,10000)
Edibob=Edibob.AssumeTFF()
Edibob.SeparateFields().SelectEvery(4,0,3).Weave().AssumeTFF()
QTGMC(Tuning= "DV-SD",preset="Slow", Ediext=Edibob, EZDenoise=6, Denoiser="dfttest", ChromaNoise=true, DenoiseMC=true, NoiseTR=2,dct=5, search=5)
#QTGMC(Tuning= "DV-SD",preset="Slow", Ediext=Edibob, Edithreads=1, EZDenoise=6, Denoiser="dfttest", ChromaNoise=true, DenoiseMC=true, NoiseTR=2,dct=5, search=5)
unsharp(varY=310,varC=155,strength=0.15,U=3,V=3)
#unsharp(varY=465,varC=232,strength=0.3,U=3,V=3)
ConvertToYV16(interlaced=false)
Prefetch(8)
nnedi3_rpow2(rfactor=2,nns=2, qual=1, fwidth=1004, fheight=752,cshift="Spline36Resize").Crop(22,16,-22,-16)
#unsharp(varY=465,varC=232,strength=0.3,U=3,V=3)
ConvertToYV12(interlaced=false)
ColorMatrix(mode="Rec.601->Rec.709")
#Prefetch(8)

I am agree that problem may be related with YUY2 colorspace, but my source YUY2 and I want save chroma planes before ConvertToYV12().
yup.

qyot27 · 27th April 2016, 21:21

Prefetch must be placed at the end of the script.

Also, make sure the latest version of the MT modes .avsi file (linked to from here) is in the plugin autoload directory.

ismail0100 · 28th April 2016, 00:09

Why does not support all character say utf8 etc.

pinterf · 28th April 2016, 08:03

Quote:

Originally Posted by stax76

here is a thread about it:

http://forum.doom9.org/showthread.php?t=110467

Thanks. Extremely problematic if we want 100% backward compatibility.

LigH · 28th April 2016, 09:22

@ ismail0100: Because it seems to be more complicated than expected...

Quote:

Originally Posted by stax76

here is a thread about it:

http://forum.doom9.org/showthread.php?t=110467

MysteryX · 2nd May 2016, 07:44

OK I'm doing some tests with AVS+.

Here's my script.

Code:

P="Encoder\"
LoadPlugin(P+"LSMASHSource.dll")
LoadPlugin(P+"KNLMeansCL.dll")
LoadPlugin(P+"Shaders\Shader.dll")
Import(P+"Shaders\Shader.avsi")
LoadPlugin(P+"nnedi3.dll")
LoadPlugin(P+"FTurn.dll")
Import(P+"edi_rpow2.avsi")
LoadPlugin(P+"svpflow1.dll")
LoadPlugin(P+"svpflow2.dll")
Import(P+"InterFrame2.avsi")
Import(P+"ResizeX.avsi")

SetFilterMTMode("DEFAULT_MT_MODE",2)
SetFilterMTMode("LWLibavVideoSource",3)
SetFilterMTMode("LWLibavAudioSource",3)
SetFilterMTMode("KNLMeansCL",3)

#SetMTMode(3,8)
file="F:\NaturalGrounding\2002 Rahtree\Original\Meu-Ayw-Tua-Lae-Tur.mpg"
LWLibavVideoSource(file, cache=false, threads=1)
AudioDub(LWLibavAudioSource(file, cache=false))
Crop(0, 0, -8, -0)
ConvertToYV24()
#SetMTMode(5)
KNLMeansCL(D=1, A=2, h=2.1, cmode=true, device_type="GPU", device_id=0)
#SetMTMode(2)
ConvertToYV12()
SuperRes(2, 0.6, 0, """edi_rpow2(2, nns=4, cshift="Spline16Resize", Threads=2)""", MatrixIn="601")
InterFrame(Cores=8, Tuning="Smooth", NewNum=60, NewDen=1, GPU=true)
SuperRes(2, 0.6, 0, """edi_rpow2(2, nns=4, cshift="Bicubic", a1=0, a2=.75, fWidth=1012, fHeight=778, Threads=2)""")
ResizeX(1004, 768, 0, 5, -8, -5, kernel="Bicubic", a1=0, a2=.75)

Prefetch(8)

With AviSynth 2.6 MT

Code:

AVSMeter 2.1.6 (x86)
AviSynth 2.60, build:Feb 20 2015 [03:16:45] (2.6.0.5)

Number of frames:                13726
Length (hh:mm:ss.ms):     00:03:48.767
Frame width:                      1004
Frame height:                      768
Framerate:                      60.000 (60/1)
Colorspace:                       YV12
Active MT Mode:                      2

Frames processed:               338 (0 - 337)
FPS (min | max | average):      2.133 | 1000000 | 10.07
Memory usage (phys | virt):     885 | 1236 MB
Thread count:                   311
CPU usage (average):            37%

Time (elapsed):                 00:00:33.563

With AviSynth+ MT

Code:

AVSMeter 2.1.6 (x86)
AviSynth+ 0.1 (r1847, MT-pfmod, i386) (0.1.0.0)

Number of frames:                13726
Length (hh:mm:ss.ms):     00:03:48.767
Frame width:                      1004
Frame height:                      768
Framerate:                      60.000 (60/1)
Colorspace:                       YV12

Frames processed:               508 (0 - 507)
FPS (min | max | average):      1.103 | 1000000 | 8.148
Memory usage (phys | virt):     738 | 1109 MB
Thread count:                   345
CPU usage (average):            41%

Time (elapsed):                 00:01:02.344

I tried it several times. With AVS 2.6, the speed remains at ~10.3fps. With AVS+, it starts at 11 and then drops at 8.8, and dropped all the way to 8fps. There is something causing the speed to drop over time.

MysteryX · 2nd May 2016, 07:58

I also tried replacing KNLMeansCL with xNLMeans.

Documentation says: "XNLMeans is a MT_NICE_FILTER for Avisynth_MT or Avisynth+, but without SIMD instructions or GPU acceleration."

This works

Code:

SetFilterMTMode("xNLMeans",2)

If I change to this, the script never loads.

Code:

SetFilterMTMode("xNLMeans",1)

25th April 2016, 19:23	#1481 \| Link
stax76 Registered User Join Date: Jun 2002 Location: On thin ice Posts: 6,837	It can be represented in ANSI charset and therefore should work with AviSynth (which don't support Unicode), if you like you can post a sample to the StaxRip thread. __________________ https://github.com/stax76/software-list https://www.youtube.com/@stax76/playlists

25th April 2016, 19:43	#1485 \| Link
stax76 Registered User Join Date: Jun 2002 Location: On thin ice Posts: 6,837	here is a thread about it: http://forum.doom9.org/showthread.php?t=110467 __________________ https://github.com/stax76/software-list https://www.youtube.com/@stax76/playlists

26th April 2016, 08:02	#1489 \| Link
LigH German doom9/Gleitz SuMo Join Date: Oct 2001 Location: Germany, rural Altmark Posts: 6,784	Is there no linebreak in the middle? __________________ New German Gleitz board MediaFire: x264 \| x265 \| VPx \| AOM \| Xvid

26th April 2016, 13:32	#1490 \| Link
stax76 Registered User Join Date: Jun 2002 Location: On thin ice Posts: 6,837	The profile editor supports multiline: Code: parentMenu \| profileName = Loadplugin("C:\Portable Apps\StaxRip\Apps\Plugins\avs\MSharpen\msharpen.dll") MSharpen(threshold = 10, strength=100, highq=true, mask=false) __________________ https://github.com/stax76/software-list https://www.youtube.com/@stax76/playlists

2nd May 2016, 07:58	#1500 \| Link
MysteryX Soul Architect Join Date: Apr 2014 Posts: 2,559	I also tried replacing KNLMeansCL with xNLMeans. Documentation says: "XNLMeans is a MT_NICE_FILTER for Avisynth_MT or Avisynth+, but without SIMD instructions or GPU acceleration." This works Code: SetFilterMTMode("xNLMeans",2) If I change to this, the script never loads. Code: SetFilterMTMode("xNLMeans",1) __________________ FrameRateConverter \| AvisynthShader \| AvsFilterNet \| Natural Grounding Player with Yin Media Encoder, 432hz Player, Powerliminals Player and Audio Video Muxer

25th April 2016, 19:38	#1484 \| Link
pinterf Registered User Join Date: Jan 2014 Posts: 2,314	It there any specific reason, why Avisynth lacks unicode support? It's by design or just nobody complained so far?

26th April 2016, 06:01	#1488 \| Link
mcjordan Registered User Join Date: Nov 2010 Posts: 124	Little sample of plugin including (in StaxRip): Scripting Editor -> Misc -> Loadplugin("C:\Portable Apps\StaxRip\Apps\Plugins\avs\MSharpen\msharpen.dll")MSharpen(threshold = 10, strength=100, highq=true, mask=false)

27th April 2016, 21:21	#1495 \| Link
qyot27 ...? Join Date: Nov 2005 Location: Florida Posts: 1,420	Prefetch must be placed at the end of the script. Also, make sure the latest version of the MT modes .avsi file (linked to from here) is in the plugin autoload directory.

28th April 2016, 00:09	#1496 \| Link
ismail0100 Registered User Join Date: Dec 2015 Posts: 38	Why does not support all character say utf8 etc.