MT 0.7(+custom avisynth)a filter to run filters multithreaded. Usefull for SMP or HT

[squid_80]

Originally Posted by lych_necross

I think its a lack of interest thats preventing further development. Or maybe severe procrastination.

If you're going to speculate, at least pick some decent reasons:
- All work on avisynth is done on a volunteer basis
- Most programmers have full-time jobs
- Some programmers even have families (so I've heard)

There's three reasons off the top of my head that I find a lot more believable (and less offensive) than your thinly veiled accusation of laziness.

[Zep]

Originally Posted by Quark.Fusion

For separate process you can use TCPserver/TCPsource, but they will eat some CPU time. And you still need 64-bit OS to use >3.5GB of memory.

yes I know but 2 gigs VS 3 (.5 for XP) is a nice increase. and why I brought it up. I hit the 2 gig wall on most of my encodes.

[Zep]

Originally Posted by Quark.Fusion

Just use last parameter, that not in size, but you usually don't know how much memory avisynth will use before running test pass. Use Width()*Height()*1.5*frames for cache size for YV12.

I assume that was directed towards me. Anyway, I tried that long ago and it is much slower and prone to crashing.

[pitch.fr]

hi there,

I've never managed to get SetMTMode() working in ffdshow, but apparently that's because I need to use ffdshow_source() after using it....as it needs to be the first line of the script or it won't work.

anyone knows why it says "invalid arguments to function LSF" please ?

SetMtmode(1,4)
source=ffdshow_source()
LimitedSharpenFaster(ss_x=1.0,ss_y=1.0,strength=40)
Distributor()

I've tried with all the MTmodes available..

this works perfectly fine :

MT("LimitedSharpenFaster(ss_x=1.0,ss_y=1.0,strength=40)",4)

thanks,

[Gavino]

Originally Posted by pitch.fr

anyone knows why it says "invalid arguments to function LSF" please ?

SetMtmode(1,4)
source=ffdshow_source()
LimitedSharpenFaster(ss_x=1.0,ss_y=1.0,strength=40)

Use simply:
ffdshow_source()

[pitch.fr]

great, thanks for the fast reply!

and what should I replace it by to do benchmarks in VirtualDub ?

it crashes if I remove ffdshow_source(), and If I also remove Distributor() it's single threaded.

I'd like to see whether it's faster than MT()

here's my test script for benchmarks in VDUB, that IanB gave me :

SetMemoryMax(512) # Adjust value as required

ColorBars(1280, 720, pixel_type="YV12") # Size and pixel type as appropriate

# Insert Code under test here
SetMtmode(2,4)
LimitedSharpenFaster(ss_x=1.0,ss_y=1.0,strength=40)
Distributor()

# Throw away most of the image we are not testing VD's i/o
Crop(0, 0, 16, 16)

[MADAJ]

hi there

I have an Intel(R) Core(TM)2 Quad CPU

and I am trying to apply this filter to my AVS script

loadplugin("F:\dgmpgdec150rc5\DGDecode.dll")
mpeg2source("ep3.d2v")
MT(4,2)

Crop(2,0,-2,-2)
tfm.tdecimate
LanczosResize(740,480)

but I get an error which is ..

Script error: Invalid arguments to function MT

I placed avisynth.dll to system32
and MT.dll to my AVS plugin

have I done something wrong??


thanks in advance

[Quark.Fusion]

RTFM (syntax in first post in THIS topic)

[MADAJ]

Originally Posted by Quark.Fusion

RTFM (syntax in first post in THIS topic)

sorry if I misunderstood the 1st post, but after seeing some people's scripts, I come up with this one.

SetMTmode(4,4)
loadplugin("F:\dgmpgdec150rc5\DGDecode.dll")
mpeg2source("ep3.d2v")
MT(4,4)
Crop(2,0,-2,-2)
tfm.tdecimate
LanczosResize(740,480)

I says "there is no function "SetMTmode"



Please tell me what I am missing.

[halsboss]

Originally Posted by MADAJ

after seeing some people's scripts, I come up with this one

Look a bit closer at them You're thinking of SetMTmode, not MT ... RTFM means read the forgoodnessake manual. Don't forget to "install" the modified avisynth. Take a look at the parameters for MT - you're missing the critical one.

See Wiki info at http://avisynth.org/mediawiki/MT_support_page and http://avisynth.org/mediawiki/MT_modes_explained

[MADAJ]

thanks halsboss...

I don't an error with this one

SetMTMode(2,4)
loadplugin("F:\dgmpgdec150rc5\DGDecode.dll")
mpeg2source("ep3.d2v")
MT("blur(0.2)",4,2)
Crop(2,0,-2,-2)
tfm.tdecimate
LanczosResize(740,480)

but it gives me the same speed whether I use it or I don't.

sorry for that guys.

[halsboss]

You're using a combination of MT mode 2 and MT ... if your source interlaced ? I suggest you have a look at the examples again and the text that goes with them. You should get a lot better than "the same".

[mgh]

If I load my plugins and then
setmtmode(2,0)
and then load my video and filters (other than builtin, the only ones i use are dfttest and shockwave, both of which are sloooow). There is no problem, cpu loading on my four cores is 95%+ and speed is 90% frames encoded in real time as long as i am not exceeding D1 resolution.
If i go to double D1 resolution using EEDI2 or tdeint, the encode crashes at completion or does not load. I need to change it to setmode(5,0) to avoid that. Only about 40 to 45% of the cores are used and encoding is about 1/6th frames in real time.
On a hunch, tried to use setmtmode (2,0) to start and put setmode(5,0) just before resizing(which i do at the end). success! no crash, cpu loading 95%+ and encoding speed was half the frames in real time.

[halsboss]

IIRC setMTmode needs to be 5 before the file open mpeg2source, and then changed after or bad things can happen. I'm sure there's posts on it somewhere. I've used TDEINT no worries although I use the "other" resizing method now.

[mgh]

did more trials
setmtmode(2,0) before loading the video file works where final encoded resolution is at the most 720x480 (NTSC DVD), also works with vcds blown up to double the resolution.
setmtmode(5,0) before loading the video file and setmtmode(2) afterwards works for higher encoded resolution (including PAL DVD 720x576!)
with my quad 2400 Mhz 2GB RAM XP SP2

[superuser]

tsp can be shed more light about Script Clip and in regards to MT?

Offtopic: which other known avisynth plugins use scriptclip functionality?

...
...

Reason I am asking about this coz I was running into errors with SRestore when using with MT:

Originally Posted by krieger2005

Before you start to test with MT i would ask the developer if MT support ScriptClip-Enviroments yet. I don't think so. MT is still in development...

Thanks in advance

[rkalwaitis]

TSP or anyone else in the know

I tried using the following settings and I do not think Ive done it correctly. Does the below look right?

I have an AMD Athlon(tm) Dual Core Processor 4200+ 2.20GHz

Im peaking at about 4.73fps, I know that fftd3filter is not fast by nature.

SetMTMode(2,0)
DGDecode_mpeg2source("C:\VTS_08_1.d2v",info=3)
ColorMatrix(hints=true)
crop( 8, 64, -8, -64)
MT("YToUV(fft3dfilter(sigma=3, plane=1).UToY,\
fft3dfilter(sigma=3, plane=2).VToY,\
fft3dfilter(sigma=2, plane=0))
FFT3DFilter(bt=-1, sharpen=0.8)
fastlinedarkenmod(thinning=0, strength=25)")

not using the MT filter I peak at about 5.15fps

like this..

DGDecode_mpeg2source("C:\VTS_08_1.d2v",info=3)
ColorMatrix(hints=true)
crop( 8, 64, -8, -64)
YToUV(fft3dfilter(sigma=3, plane=1).UToY,\
fft3dfilter(sigma=3, plane=2).VToY,\
fft3dfilter(sigma=2, plane=0))
FFT3DFilter(bt=-1, sharpen=0.8)
fastlinedarkenmod(thinning=0, strength=25)

not sure what im doing wrong or if Im even using the fft3filter optimally.

thanks guys, your knowledge is valued.

[rkalwaitis]

SetMTMode(2,0)
DGDecode_mpeg2source("C:\Users\Baba-Nator\Desktop\Movies\Zoolander\VTS_08_1.d2v",info=3)
ColorMatrix(hints=true)
crop( 8, 64, -8, -64)

MT("fft3dfilter(sigma=3, sigma2=5, sigma3=10, sigma4=20, plane=0, bt=3, bw=16, bh=16, ow=8, oh=8, sharpen=0.3, smin=20, smax=1000, wintype=2, kratio=1.0, measure=true, interlaced=false, degrid=1)")

This way gets 5.65fps


DGDecode_mpeg2source("C:\Users\Baba-Nator\Desktop\Movies\Zoolander\VTS_08_1.d2v",info=3)
ColorMatrix(hints=true)
crop( 8, 64, -8, -64)

fft3dfilter(sigma=3, sigma2=5, sigma3=10, sigma4=20, plane=0, bt=3, bw=16, bh=16, ow=8, oh=8, sharpen=0.3, smin=20, smax=1000, wintype=2, kratio=1.0, measure=true, interlaced=false, degrid=1)

This way gets 6.06 fps

[Adub]

Pick one or the other here. You are using both SetMTmode and MT. My guess is that you only want to thread fft3dfilter here, especially since the other filters are already fast enough. So just us MT and see if that fixes it. Remove your "SetMTMode(2,0)" line.

[rkalwaitis]

Thanks Ill give it a shot. I knew I was dorking something up