Avisynth port of TemporalCleaner

[vlad59]

Hi all,

I made an avisynth port of Jim Casaburi's TemporalCleaner.

This filter is a simple temporal denoiser but it's real aim is to help compressibility as it will gave you a first pass size 10-20% lower for almost no speed penalties.

With this first release you have to use a mod4 width otherwise it may crash.

Next version will include pixel lockers and maybe a specific YV12 dll.

happy testing.

TemporalCleaner (http://membres.lycos.fr/tempask/TemporalCleaner.zip)

@Defiler

May I ask you to host this filter as well. Thanks in advance.

[ajp]

E-e-e-xcellent! I will try it out right away on some shorter clips! :)

Thanks again,

@jp

[Zarxrax]

Yay! :D

[Niño]

This filter works great, but there was a green line on the left of my clip.
The script was this:

#
LoadPlugin("C:\Avisynth\TemporalCleaner.dll")
mpeg2source("C:\Niño\Documents\Con_Air\Con_air.d2v")
#
crop(0,70,718,434)
#
TemporalCleaner(6,10)
#
LanczosResize(640,272)
#

[Dark-Cracker]

hi,

try to use some crop value divisible (yes my english is crap) by 4
(use value like 716 our 720 for height and 432 or 436 ) i think this will solve your problems.

++

[Milkman Dan]

Vlad SPECIFICALLY said to use a horizontal resolution that was mod4...meaning divisible evenly by 4.


Originally posted by Niño
This filter works great, but there was a green line on the left of my clip.
The script was this:

#
LoadPlugin("C:\Avisynth\TemporalCleaner.dll")
mpeg2source("C:\Niño\Documents\Con_Air\Con_air.d2v")
#
crop(0,70,718,434)
#
TemporalCleaner(6,10)
#
LanczosResize(640,272)
#

[Niño]

Sorry, you're right, :(
Thanks

[JohnMK]

Could someone recommend a good, all-around, general-purpose setting for this, or small-range of settings?

[vlad59]

I must admit I only made tests on anime and I used safe setting :
5, 10

I think that if you use it on normal movie then you should use settings like :
3, 8

But it's untested. I'll remake a test with Excalibur tonight.

[Koepi]

Heya Vlad,
thx for this nice filter, I waited long time for an avisynth port :)

How about this:
{quote]
3 - Current limitations or known problems : .
- Work only with YUV2, CHECKED.
[/quote]

Do you plan to port it to avisynth2.5/YV12? ;)

Best regards
Koepi

[ajp]

Vlad,

only had time to test it on a few short clips but inital impressions are very good! It really cleans up my digital cable caps, removes any flickering and dct blocks. I haven't tried it on an analogue cap yet but I will tonight. I suspect they are so noisy I will have to use it in combination with Peachsmoother or something...

Speed is also very good... :)

Thanks!

@jp

[vlad59]

Originally posted by Koepi
Do you plan to port it to avisynth2.5/YV12? ;)



Don't tell anyone about this but it's already done ..... ;)
Just some little thing to check and ....



@all

Can somebody post some speed bench as I only tested it on my old PIII500 so it was hard to compare speed.

Thanks in advance.

[ajp]

Converting a testclip took 0.7x realtime without Temporalcleaner (without using Avisynth at all), using Avisynth and Temporalcleaner (4,8) it took 1.1x realtime... not very scientific but still... :)

Convolution3D is still no 1 when it comes to quality but also quite a lot slower, Temporalcleaner is often good enough on less noisy clips and does it in half the time... :)

I tried combining them but I have a feeling that's completely unnecessary?

[MaTTeR]

Originally posted by vlad59

Don't tell anyone about this but it's already done ..... ;)
Just some little thing to check and ....
Oh man, your teasing us:) Yep, the speed is very good; definitely faster than Convolution3D though. I don't have any hard benchmarks but could post some if needed. Nice work as always Vlad.

[jarthel]

will compare to 2dcleaner and temporalsmoother :)

jayel

[jarthel]

initial feedback even without encoding the anime (previewing in vdub). 2DCleaner is better. TemporalCleaner is not as smooth and clean as 2Dcleaner. So I opted not to test it cause it uncompressed is not good. I would assume that compressed file would be worse. :)

[Zarxrax]

Um... 2d cleaner and temporal cleaner are COMPLETELY different types of filters. You cant say one is better than the other :rolleyes:

[jarthel]

isn't 2dcleaner a temporal smoother?

[ErMaC]

No, it's 2d - meaning it operates on a single 2d still frame. It's a spatial smoother.

[vlad59]

One thing I totally forgot to say :

As stated in the doc, this filter use feedback, that it use the already processed previous frame (not the unprocessed one). So if you want to make test on a specific frame (in Vdub) :
go 4 or 5 frame before your test frame and then use the right arrow to reach your frame.

Sorry for forgetting this one.

Another thing, luma and chroma threshold are linked : for a pixel if luma différence is above luma threshold (so we keep current luma) then chroma is also kept.

So if you use this script :
TemporalCleaner (1, 25) or TemporalCleaner (0, 255)
don't be surprised if the filter don't make anything.

I think that's all I've forgotten.

@Jarthel

No you can't say that if the result with TemporalCleaner don't seem as clean as the result with 2Dcleaner -> then the compressed one will follow. Also the TemporalCleaner should keep more details that 2DCleaner.

It depends of your second pass size, of your compressibility.

You could try to run a complete full pass with both scripts and compare the first pass size.


Hope this helps

[jarthel]

I'll try your suggestion. As I previously said, I thought 2DCleaner is also a temporal smoother. I apologize for my mistake. :)

Here's the script for reference. I will try it on Record of Lodoss War TV.
----------
body=mpeg2source("d:\dvdrips\lodoss14\lodoss14.d2v").trim(0,40176).temporalcleaner(5,10).Telecide(Guide=1,Gthresh=40,Threshold=20,Chroma=True,dthreshold=10,Post=true).Decimate(cycle=5).crop(14,4,692,472)._2DCleanYUY2().lanczosresize(640,480)

return body
------------

jayel

[vlad59]

In my opinion TemporalCleaner should come after Telecide and Decimate for maximum speed and quality.
But I never worked with NTSC movies.

[MaTTeR]

Originally posted by vlad59
In my opinion TemporalCleaner should come after Telecide and Decimate for maximum speed and quality. Agreed, not very effecient to filter borders which will be cut away later:confused:

The only thing to use before cropping is IVTC or Deinterlace filters IMO.

[manono]

And in jarthel's case, he can even stick Telecide-Decimate after cropping also (but before the smoothers), and gain a bit more speed. So can anyone else if you abide by the "Horizontal Crop must be divisible by 4" rule.

[vlad59]

@manono

Ooooops you got me.
I totally forgot about this "know problem". This problem is already fixed in the YV12 version (should be release in 2 or 3 days).

I'm afraid I won't have any time to fix it in YUV2 till the end of the week.

Sorry for this.

[jarthel]

I compared both temporalcleaner with 2DCleaner and temporalsmoother with 2DCleaner and temporalsmoother w/ 2DCleaner has a lot smaller filesize. Temporalcleaner w/ 2Dcleaner is 2mb smaller than jus using 2DCleaner.

Here are the 2 scripts:

------------ using temporalcleaner ------------
body=mpeg2source("d:\dvdrips\lodoss14\lodoss14.d2v").trim(0,40176).temporalcleaner(5,10).Telecide(Guide=1,Gthresh=40,Threshold=20,Chroma=True,dthreshold=10,Post=true).Decimate(cycle=5).crop(14,4,692,472)._2DCleanYUY2().lanczosresize(640,480)
return body
-------------------------------------------------

------------ using temporalsmoother ------------
body=mpeg2source("d:\dvdrips\lodoss14\lodoss14.d2v").trim(0,40176).Telecide(Guide=1,Gthresh=40,Threshold=20,Chroma=True,dthreshold=10,Post=true).Decimate(cycle=5).crop(14,4,692,472).temporalsmoother(5)._2DCleanYUY2().lanczosresize(640,480)
return body
-------------------------------------------------
jayel

[jarthel]

Originally posted by vlad59
In my opinion TemporalCleaner should come after Telecide and Decimate for maximum speed and quality.
But I never worked with NTSC movies.

FYI, Record of Lodoss War TV is an anime. :)

jayel

[vlad59]

Originally posted by jarthel
FYI, Record of Lodoss War TV is an anime. :)

jayel

I should have said NTSC source ;)
Because I knew about Record of Lodoss War, I encoded them a year ago and it was a pain in *** due to blend fields (bad NTSC->PAL conversion). Very good anime :)

[jarthel]

Originally posted by vlad59
I should have said NTSC source ;)
Because I knew about Record of Lodoss War, I encoded them a year ago and it was a pain in *** due to blend fields (bad NTSC->PAL conversion). Very good anime :)

The NTSC version has blended fields too. :(

jayel

[ajp]

Still one of my favourite filters, any updates planned? Only filter I've tried except Conv3d that reduces flickering/blocks in my digital tv-caps, only it does it much faster... :)

Thanks,

@jp

[vlad59]

I'm currently working on a YV12 version but for now it's slower :( .

I'm working on that.

[ajp]

Not that the current version doesn't work fine so far, it does. I just don't want the filter to die, it's such a great one. Conv3d and temporalcleaner are the ones I use the most... :)

I don't think I will try AVS 2.5 until it goes beta anyway.... ;)

Cheers,

@jp

[vlad59]

New Avisynth 2.5 version.

It will work with YUV2 and YV12 colorspace. YV12 processing is only a little faster (better than nothing ;) ).
When processing yv12 there shouldn't be any restriction on width (at least I haven't had any problem with it).

Another interesting feature is you can only process luma if you want (just put cthresh=0).

Hope you'll like it (http://membres.lycos.fr/tempask/TemporalCleanerYV12.zip)

[ajp]

Ooooh, that was quick! Now that there are YV12 versions of both Conv3d and TemporalCleaner I can switch to AVS 2.5... :)

I only convert DV to mpeg2 though so I will probably lose speed instead? Sometimes I feel that 2.5 is geared too much towards DivX/Xvid... :(

EDIT: I get an access violation in Avisynth when trying it in YV12 and in YUY2 I get a message saying it's YV12 only? Could be me, I've just installed AVS 2.5...

[vlad59]

Oooops it's my fault I messed up with debug and release build you can redownload the filter on the same link and it should work.

Sorry for this.

[ajp]

No worries! I will post some feedback later tonight...

Thanks! :)

@jp

[MaTTeR]

Woohoo...YV12 port appears to be working quite well here. I just finished a full first pass and noticed the speed is comparable to that of Conv3D_SMP. If anything, Temporal Cleaner might be about 1-2 FPS slower than Conv3D_SMP but that's like comparing apples to oranges I guess.

[ajp]

TemporalCleaner has always been quite a lot faster than Conv3D (non-SMP) for me...

[vlad59]

@MaTTeR

It isn't too surprising (Convolution3D is fast with SMP). With this filter working in YV12 colorspace is really harder than in YUV2.
If you got some time (I know, I know ;)) Can you try it with :
ConvertToYUY2()
TemporalCleaner ()
ConvertToYV12()

Just to check if YV12 is not slower than YUV2 for this case

Thanks in advance.

[MaTTeR]

vlad59,

I've got the tests setup in my queue, they should be finished by the time arrive back from work:) I agree with you though, I wasn't too surprised to see that C3D_SMP was indeed faster on my machines.

[Wilbert]

New Avisynth 2.5 version. It will work with YUV2 and YV12 colorspace.

I'm updating the faq. I'm very tired so I could easily have missed it, but where can I download this version?

[vlad59]

Hi Wilbert,

There is little "it" hiding the URL

[cult]

or here
http://membres.lycos.fr/tempask/TemporalCleanerYV12.zip

[MaTTeR]

From vlad59- ConvertToYUY2()
TemporalCleaner ()
ConvertToYV12()

vlad59,
It occured to me that I need to be present in order to really watch the performance so my testing proved useless yesterday. It might take me some time since I'm not always sitting here:)

Just to clarify, you did want 3 different tests with the above functions right?

[TheUnforgiven]

hi vlad,
link is down for the temporalcleaner_yv12.

[vlad59]

I'll post a new binary tonight.

Thanks for the feedback.

[Dali Lama]

Hi guys,

Does anyone have a copy of Temporal Cleaner for Avisynth 2.07?

The Link is down.

Thanks,

Dali

[vlad59]

Here we are, I just attached a zip with the latest avisynth2.0X and avisynth 2.5 version of TemporalCleaner (with of course the source updated).

As I'm currently at work I only was able to recompile it (no tests was done).

There's two dll in the zip
TemporalCleanerOld -> Avisynth 2.0X
TemporalCleaner -> Avisynth 2.5

Let me know if you have any problems with this.

[jarthel]

Any updates? Thanks vlad. :)

jayel

[unimatrixzer0]

is there a working link for this filter?