Ultimate cartoon denoising.

[Neoze]

Here the result of my experiment about denoising.
I have read a lot, make a lot of tests and now its working.
It's useless for a criscal clear source like dvd, but ideal for divx ou vhs conversion.

My source was divx, so the first step is to forget the divx codec, but install ffdshow
http://www.divx-digest.com/software/ffdshow.html
(ffdshow is better for postprocessing.)
If put the postprocessing option to the max.

For the filter my choise is the virtualdub filter:
2d cleaner optimized 0.9 from jim casaburi
smart smoother HiQuality 2.11 from klaus post
xsharpen (1.0 beta 2) from donald graft

for the resize I use the lanczos3 filter from kazuhiro mogi (thejam)

And now the script:

directShowSource("C:\_movie\a.avi",25)
trim(495,496).converttoRGB32()
crop(2,2,540,396)
LoadVirtualDubPlugin("2dcleanopt_p3.vdf","cl")
LoadVirtualDubPlugin("SmoothHiQ.vdf","sm")
LoadVirtualDubPlugin("xsharpen.vdf","xs")
LoadVirtualDubPlugin("lanczos3.vdf","lz")
cl(0, 12, 3, 3)
sm(5, 50, 0, 254, 1, 0, 1, 0)
xs(200, 40)
lz(448,542)
AddBorders(16,17,16,17)

Here the original picture

[Neoze]

I could not attach a file :confused:


If you want to see the original divx picture before and the one using ffdshow and the filter I can mail it.

Question:
How to insert a picture in a reply? It's a right defined per user?

Forum Rules:HTML code if OFF <- is it possible to activate?

[Dark-Cracker]

simply attach your .jpg or .png file to your post and wait the moderator accept the attachement to see the picture or the link.

but it seems to me the lanczos filter was not very designed for the anime. and xsharpen was not a denoiser filter only a sharp filter that avoid to increase to much the noise.

++

[Neoze]

xsharpen is not denoiser but for anime, the perceptual quality increase, because of less blur.

Here the picture after

[OUTPinged_]

2dc, sshq, xs...

Nice denoisers you use here.

How about keeping picture close to source?


The idea of denoising is to "remove noise and not *** up the picture", not "alter a picture to the extent where you dont see the noise".

[Kaiousama]

The idea of denoising is to "remove noise and not *** up the picture", not "alter a picture to the extent where you dont see the noise".

I agree to this concept only if the source is good enough, if the denoising process has to be too strong to mantain the 99% the original picture conformation, in my opinion it's acceptable to lose a bit in picture fidelity to gain picture clearness.

Another question is: "2dClean, SmartSmoothHQ, Xsharp" what's the speed of your encoding O_o o_O

why not use WarpSharp instad of Xsharpen to regain good lined margins?

[Neoze]

>How about keeping picture close to source?
I have made a lot a test on a bad picture, with a lot of compression artifact. The combination and thresold of the script appear to be the best.

>why not use WarpSharp instead of Xsharpen to regain good lined margins?
I have tried WarpSharp too. It run in virtualdub but in my script like:
LoadVirtualDubPlugin("warpsharp.vdf","ws")
ws(102)
I get an error:
Avisynth read error: Unsupported VBitmap method: BitBlt

>speed.
Yesterday I have encoded a 7 minutes anime divx with avisource in 2 hour on my athlon 1Gh
With ffdshow the result is better, because of better postprocessing, but maybee a bit slower? But I have a problem to run directShowSource on my athlon for now.

[jarthel]

Originally posted by Neoze
directShowSource("C:\_movie\a.avi",25)


was the source originally from vobs then encoded to huffyuv or something similar? or maybe the original source is really .avi?

Thanks

[Neoze]

>was the source originally from vobs
No it was a Pal Divx 5.02.

[pandv]

I have tried WarpSharp too. It run in virtualdub but in my script like:
LoadVirtualDubPlugin("warpsharp.vdf","ws")
ws(102)
I get an error:
Avisynth read error: Unsupported VBitmap method: BitBlt

You need a modified warsharp version. You can get it in
http://shelob.mordor.net/dgraft/warpsharp.zip

pandv

[Guest]

@Neoze

Two things about WarpSharp. You get the problem with the VirtualDub version because you are not using the Avisynth-compatible version. Get that from my web site.

But better, use the Avisynth native version that has recently been discussed on another thread.

[Bulletproof]

That source image is way too easy for a denoiser to work with. Most modern day animation has much more detail. If you use those sort of settings on some modern day animation it will end up blurring everything out.

[Metalazzo]

the result is quite blured already...

[Neoze]

@pandv
@neuron2

Thanks for the warpsharp tweak, I will made some experimetns with.

[OUTPinged_]

Let me guess.

Soon we will hear "ultimate combo of warpsharp+sshq".

Use postprocessing on a source picture.

Filter it after that.

[Neoze]

Two more samples.

Original picture:

[Neoze]

And the one filtered (new script)

[Metalazzo]

DirectShowSource("c:\mahoromatic2ep1.avi",23.976) doesn't seem to work for me
it's a divx5 raw and i have ffdshow installed (don't want to install divx5)
I have an unrecognized exeption when i open the avs in nandub
somebody has an idea why ?

[Neoze]

I have the same error on an athlon computer, but it run fine on my pIII

[Metalazzo]

i tried once with a *.asf and it worked fine (at that time i had a duron cpu)
my cpu is now an athlon xp

[Belgabor]

Dumb question, did you try without giving fps? Iirc you only need that for asf files.

Cheers
Belgabor

[Piper]

What was the script you used for your last comparison? Can you post it?

[Fenris]

DirectShowSource (avisynth 2.05+) doesn't work on my computer either (AthlonXP) with or without fps. Tested with a divx3 avi, xvid avi and a standard mpeg1.

Edit:
Tested on a Duron system and DirectShowSource (avisynth 2.05+) worked fine.

[SILICON]

Use avisynth 2.06. It have less bugs.
Install FFDSHOW. Work well for me.
Use this:

DirectShowSource("C:\FILM.AVI", 30)

[Metalazzo]

even try with fps=23.976 and it didn't work
i installed avisynth 2.06 yesterday and it still doesn't work :(
i'll test again on my duron (well not mine anylonger) system...

[sh0dan]

Could you try to open the file in Zoomplayer / mplayer 6.4, and post ALL the filters used?

edit: also, what DirectX version are you using, and which directshow capable filters have you installed?

[Metalazzo]

when i open it in wmplayer 6.4 it gives me a nice black screen with unrecognized exception written in red :D
i only use DirectShowSource("c:\mahoromatic2ep1.avi",23.976) in my avs...
i just wanted to know if it worked without installing divx5.02 (this codec overrides the 3.11 alpha on my pc and i have not lots of time to play with it)...seems not on my comp :(

[sh0dan]

No - I meant the file you're trying to open (c:\mahoromatic2ep1.avi)

[Metalazzo]

default directsound device
ffdshow
mpeg layer 3 decoder
video renderer

it's all i have in properties under wmp6.4
sorry for the previous post :D

[Fenris]

Using version 2.06 DirectShowSource is still broken on my AthlonXP. OS is Windows 2000 with service pack 2, DirectX 8.1a.
For the mpeg1 clip media player 6.4 lists the following.
Default DirectSound Device
MPEG Audio Decoder
MPEG Video Decoder
Video Renderer
Hopefully this will help find the problem.

[jarthel]

do I need to use .avi file before I use ffdshow?

Thanks