MCTemporalDenoise [v1.4.20 - Update 2010/07/02]

[LaTo]

All is working, no problem on my side.

Seriously, it looks like a "source" problem... Replace FFVideoSource by something else.

[asarian]

Originally Posted by LaTo

All is working, no problem on my side.

Seriously, it looks like a "source" problem... Replace FFVideoSource by something else.

Thanks for your time, LaTo.

FFVideoSource, eh? Hmm, if that's true, then I'm having a problem, as I replace DirectShowSource with FFVideoSource calls, these days, because the former is frame-consistent (and DirectShowSource is not!).

So, is there anything else out there, besides FFVideoSource, which is frame consistent? With a heavy script like MCTemporalDenoise, I really need frame-consistency. :(

[LaTo]

I haven't FFVideoSource on my PC, so for testing I have replaced this one by DirectShowSource in your script.
No ghosting at all, maybe a bug in your version of FFVideoSource?

Try with DGAVCIndex or DGNVTools, the problem should be solved.

[asarian]

Originally Posted by LaTo

I haven't FFVideoSource on my PC, so for testing I have replaced this one by DirectShowSource in your script.
No ghosting at all, maybe a bug in your version of FFVideoSource?

Try with DGAVCIndex or DGNVTools, the problem should be solved.

Thanks, LaTo; I'll have a look at Neuron2's DG NV tools. :)

[asarian]

I wonder, if I have a really grainy source, could I just double the MCTemporalDenoise line? Like so:

MCTemporalDenoise(settings="medium")
MCTemporalDenoise(settings="medium")
GradFun2DBmod(thr=1.8,thrC=1.0,mode=0,str=2.4,strC=0.0,temp=50,adapt=64,mask=false,show=false)

Instead of using 1x MCTemporalDenoise(settings="high").

Or does that mess up the lookahead functionality of MCTemporalDenoise?

Reason I ask, is that MCTemporalDenoise(settings="high") takes incredibly long on HD material (several hundred hours on my i7 980x). So maybe just doubling is the way to go.

[LaTo]

Originally Posted by asarian

I wonder, if I have a really grainy source, could I just double the MCTemporalDenoise line? Like so:

MCTemporalDenoise(settings="medium")
MCTemporalDenoise(settings="medium")
GradFun2DBmod(thr=1.8,thrC=1.0,mode=0,str=2.4,strC=0.0,temp=50,adapt=64,mask=false,show=false)

Instead of using 1x MCTemporalDenoise(settings="high").

Or does that mess up the lookahead functionality of MCTemporalDenoise?

Reason I ask, is that MCTemporalDenoise(settings="high") takes incredibly long on HD material (several hundred hours on my i7 980x). So maybe just doubling is the way to go.

Try with MCTemporalDenoise(settings="high",stabilize=false,bwbh=32,owoh=16).
It should be a good speed boost

[asarian]

Originally Posted by LaTo

Try with MCTemporalDenoise(settings="high",stabilize=false,bwbh=32,owoh=16).
It should be a good speed boost ;)

Thanks. :) Good tips.

I guess the real issue is still that I can't get MCTemporalDenoise to utilize the CPU properly. At 'high' CPU usage drops tp about 8% (over all 12 logical cores). And an MT"" call, or using any of the SetMTMode calls, makes MCTemporalDenoise crash; at least on my Highlander Blu-Ray.

P.S. Callimg MCTemporalDenoise twice in a row, btw, doesn't seem to work: it uses CPU, but x264 never starts up; so I guess it just hangs at initializong things, or gets into a loop of some sort; or twice 'medium' is simply even slower than 1x 'high'. :)

[tormento]

Originally Posted by asarian

I guess the real issue is still that I can't get MCTemporalDenoise to utilize the CPU properly.

AFAIK horizontal/threads and vertical/threads must be multiple of 4. Check it out.

[skaleton]

Hello,
Where can I download MCTemporalDenoise?
The link in avisynth.org does not work anymore.

[poisondeathray]

Originally Posted by skaleton

Hello,
Where can I download MCTemporalDenoise?
The link in avisynth.org does not work anymore.

Look on the very 1st page of this thread

[skaleton]

Thanks poisondeathray
I saw the link but yesterday I didn't know what to do with it. I expected a zip or something like most other filters.
Thanks to another post of yours

most .dlls are autoloading if put into the avisynth\plugins directory
.avsi are autoloading scripts if put into the plugins directory
.avs are manually loaded - use Import("path\script.avs") . You can rename extension to .avsi to autoload

I just saved the avsi file.

What is not clear to me is what do you do about the required filters?
Do you need to load the 15 filters before loading the avsi? Should you make a script so that they are all loaded in one go?

[poisondeathray]

The prerequisite filters are listed at the top of the script. You have to get them (not included)

If the prereq's are .dll's most are autoloading if placed in the plugins folder. Otherwise use LoadPlugin() , or you can make your own custom .avsi file . But beware the more autoloading filters you have, the slower and more memory consumption . Once you start accumulating a bunch of filters, it can make a difference

The reason why a static .zip file is not provded, is the filters are always being updated . You should get them from the original source, with original documentation. People sometimes modify filters. This way no mixups or filter version errors occur when debugging

You don't need all the pre-req's for this one . Only if you use some of the PP functions. It will tell you what one you are missing if you try to use it.

[skaleton]

Thank you poisondeathray

So if I understand correctly,
Only the most frequently used .dll's and .avsi's should remain in the plugins folder.
When in another folder, should a .avsi be loaded with "loadplugin" or with "import" like a .avs or should it be renamed .avs?

For this script, I don't need to load all pre-req filters,
the MCTemporalDenoise script will tell me which one I am missing and then I can incorporate it in my .avs
and although it may be easier, as I was asking before, to make a .avs that would contain all the loadplugin/import of the pre-req filters
The first solution would be more efficient in the long run.

Am I correct?

[poisondeathray]

Originally Posted by skaleton

When in another folder, should a .avsi be loaded with "loadplugin" or with "import" like a .avs or should it be renamed .avs?

you can rename it .avs and leave it in the plugins folder and it won't load until you use Import()

For this script, I don't need to load all pre-req filters,
the MCTemporalDenoise script will tell me which one I am missing and then I can incorporate it in my .avs
and although it may be easier, as I was asking before, to make a .avs that would contain all the loadplugin/import of the pre-req filters
The first solution would be more efficient in the long run.

Am I correct?

you can organize it however you like

some people load everything with loadplugin or import at the top of each and every script

you can make your own avsi that autoloads everything if you want

[aand]

Any chance of this getting a bit of multithreading? Using GPU is a big boost (0.9 to 1.5 fps). Two instances don't work.

Also I think post-TTempSmooth is broken (i added vis_blur=1 inside the scrip but nothing happened).

[asarian]

I'm having trouble with MCTemporalDenoise 'hanging' at times. Well, it doesn't really hang, in the sense of not responding any more; it just doesn't output anything any more, like being caught in a loop somehow. Here's a good example of a video fragment (5 MB) causing this, from the movie 'Push':

Push fragment

Processed as follows:

DSS2("c:\video\push_test.m2ts", fps=24).ConvertToYV12()

Crop(0, 132, 0, -132)

MCTemporalDenoise(settings="low")
GradFun2DBmod(thr=1.4,thrC=1.0,mode=0,str=1.2,strC=0.0,temp=50,adapt=64,mask=false,show=false)

It happens with more movies (Stargate); but this sample is nice, as it occurs directly from the start.

I would really like to know what's causing this; and how to fix it, of course.

Thanks.

Originally Posted by asarian

DSS2("c:\video\push_test.m2ts", fps=24).ConvertToYV12()

Use a different source filter, DSS2 is pretty bad at direct M2TS ...

Index it first for a much better chance at success (I know indexing is stable, I tried a few source filters on BD M2TS files and DSS2 was the least likely to complete the encode ... I use DGDecNV to consistently run 30GB M2TS's thru MCTemporalDenoise() for the compression boost) ...

7ek

[asarian]

Originally Posted by 7ekno

Use a different source filter, DSS2 is pretty bad at direct M2TS ...

Index it first for a much better chance at success (I know indexing is stable, I tried a few source filters on BD M2TS files and DSS2 was the least likely to complete the encode ... I use DGDecNV to consistently run 30GB M2TS's thru MCTemporalDenoise() for the compression boost) ...

7ek

Indexing is not really the issue here, I think. I tried it with FFVideoSource too (which I didn't use in this case, as I need to set the fps; FFVideoSource just assumes 23.976).

Mind you, I use MCTemporalDenoise a lot (~300GB a week, as I'm reprocessing my now vast Blu-Ray collection). Mostly it goes very well. There's just a few films where the process gets stuck somehow, like with 'Push'.

EDIT: I'll be d*amned. :) Finally bought a license for DGDecNV (about time; no point in spending $1,000 on a i7 980x CPU, only to skimp out on this cheap decoder license), and now it actually works. :) Guess FFVideoSource isn't at good at indexing as it thinks. I should have done this much earlier!

P.S. DGDecNV is also the only decoder, so far, that gets the framerate right without external help.

[Usedocne]

Originally Posted by asarian

I'm having trouble with MCTemporalDenoise 'hanging' at times. Well, it doesn't really hang, in the sense of not responding any more; it just doesn't output anything any more, like being caught in a loop somehow. Here's a good example of a video fragment (5 MB) causing this, from the movie 'Push':

Push fragment

Processed as follows:

DSS2("c:\video\push_test.m2ts", fps=24).ConvertToYV12()

Crop(0, 132, 0, -132)

MCTemporalDenoise(settings="low")
GradFun2DBmod(thr=1.4,thrC=1.0,mode=0,str=1.2,strC=0.0,temp=50,adapt=64,mask=false,show=false)

It happens with more movies (Stargate); but this sample is nice, as it occurs directly from the start.

I would really like to know what's causing this; and how to fix it, of course.

Thanks.

Hmm... maybe mt_masktools-25.dll could be the issue? As both MCTemporalDenoise and GradFun2DBmod seem to call it. Possibly causing a conflict.

[kypec]

Is there anybody out there who successfully runs this script in MT mode?
I mean, though I've an Intel i7-920 (quad core+HT = 8 threads) I can't make it to use more than 13% of CPU (which effectively means that only 1 thread is always running).
Here's my AVS script:

PHP Code:

# Initialize variable with path to my A/V tools
global avdir="C:\Program Files (x86)\AVTools\"
SetMTMode(2,2)
# Load all the plugins that will be used in the script
LoadPlugin(avdir + "DGDecNV\DGDecodeNV.dll")
Loadplugin(avdir + "plugins\mvtools2.dll")
Loadplugin(avdir + "plugins\mt_masktools-25.dll")
Loadplugin(avdir + "plugins\FFT3DFilter.dll")
Loadplugin(avdir + "plugins\TTempSmooth.dll")
Loadplugin(avdir + "plugins\RemoveGrainSSE2.dll")
Loadplugin(avdir + "plugins\RepairSSE2.dll")
Loadplugin(avdir + "plugins\deblock.dll")
Loadplugin(avdir + "plugins\DctFilter.dll")
Loadplugin(avdir + "plugins\EEDI2.dll")
Loadplugin(avdir + "plugins\SangNom.dll")
Loadplugin(avdir + "plugins\gradfun2db.dll")
Loadplugin(avdir + "plugins\AddGrainC.dll")

Import(avdir + "plugins\LSFmod.v1.9.avsi")
Import(avdir + "plugins\Deblock_QED.avsi")
Import(avdir + "plugins\GradFun2DBmod.v1.5.avsi")
Import(avdir + "plugins\MCTemporalDenoise.v1.4.20.avsi")

SetMTMode(5)
# Open source video clip
DGSource("300_raw_bd.dgi")

SetMTMode(2)
MCTemporalDenoise(settings="medium")

SelectRangeEvery(FrameCount/12, Round(FrameRate*5), 2400) 


I can't select more than 2 threads in initial SetMTMode(2,2) because I'm using only 32-bit Avisynth and any more threads would just crash (tested).
Any suggestions of proven solutions are welcome, quality of LaTo's script is outstanding but not being able to utilize the full power of my CPU efficiently is just so frustrating
Maybe 64-bit MT Avisynth build is needed? But are there all required plugins available in 64-bit then?