PDA

View Full Version : undot+deen+mftoon --> excellent combo!


Alxemi
27th June 2004, 17:07
Hi people. Iīm preparing my backup of AKIRA... it is my first experience with bad quality anime so i decided to do an intensive testing & search in the forum.
I tried everything: c3d, fluxsmooth, mipsmooth, sharpresize, deen, edeen, mftoon, many sharpeners... weeks of work!!

Now that i have my "final avs version" i would like to share it with all of you who helped me (in one way or another) to create it and for future searchers. Iīm still open to suggestions!!


normal script:

LoadPlugin("C:\ARCHIV~1\GORDIA~1\AviSynthPlugins\dgdecode.dll")
mpeg2source("E:\akira\p1.d2v")
crop(8,4,704,568)
LanczosResize(608,336)


filtered script:

LoadPlugin("C:\ARCHIV~1\GORDIA~1\AviSynthPlugins\dgdecode.dll")
LoadPlugin("C:\ARCHIV~1\GORDIA~1\AviSynthPlugins\UnDot.dll")
LoadPlugin("C:\ARCHIV~1\GORDIA~1\AviSynthPlugins\warpsharp.dll")
LoadPlugin("C:\ARCHIV~1\GORDIA~1\AviSynthPlugins\masktools.dll")
LoadPlugin("C:\ARCHIV~1\GORDIA~1\AviSynthPlugins\awarpsharp.dll")
LoadPlugin("C:\ARCHIV~1\GORDIA~1\AviSynthPlugins\deen.dll")

import("C:\ARCHIV~1\GORDIA~1\AviSynthPlugins\mfToon-v0.52.avs")

mpeg2source("E:\akira\p1.d2v")
crop(8,4,704,568)
Undot()
deen()
LanczosResize(608,336)
Undot()
mftoon()


Some Screenshots: normal, filtered:


http://img28.imageshack.us/img28/6784/16770normal.png
http://img39.imageshack.us/img39/7019/16770deenmf.png
http://img27.imageshack.us/img27/7493/24429normal.png
http://img27.imageshack.us/img27/1426/24429deenmf.png
http://img36.imageshack.us/img36/5907/110564normal.png
http://img36.imageshack.us/img36/1294/110564deenmf.png
http://img36.imageshack.us/img36/8513/135328normal.png
http://img36.imageshack.us/img36/6213/135328deemf.png
http://img39.imageshack.us/img39/9152/153463normal.png
http://img39.imageshack.us/img39/8105/153463deenmf.png

If you want to notice well the big difference, i recommend to download the imagen and make some zooms :)
Now i face to make a good xvid work (2cds)...

take care people!!

ssjkakaroto
27th June 2004, 23:41
Alxemi is using undot() twice really necessary?

Corran
28th June 2004, 02:54
Those still seem a bit noisy. How about this?

The following images are between 66-80 percent the filtered counterparts you posted above.

http://www.corranproductions.com/filtertests/akira16770.png
http://www.corranproductions.com/filtertests/akira24429.png
http://www.corranproductions.com/filtertests/akira110564.png
http://www.corranproductions.com/filtertests/akira135328.png
http://www.corranproductions.com/filtertests/akira153463.png

In the first scene I think I may have lost a little detail...
Here is the script I used.
mpeg2source("C:\Documents and Settings\Corran1\Desktop\akira.d2v")
telecide(order=1,post=0)
decimate(cycle=5)
assumefps(24)
Crop(2,0,-2,0)
lanczos4resize(608,336)
Convolution3d(1,8,8,8,8,3,0)
deen("a2d",2,5,7)
mftoon()
msmooth(strength=2,threshold=3,mask=false)
ColorYUV(gain_u=7)
tweak(sat=1.2,cont=1.1)

jorel
28th June 2004, 05:28
@ Alxemi
i believe that was needed weeks for tests,sometimes i do the same testing.i see only a little more bright(maybe gamma) in the pictures with filters but the general results is very cool! :)

@ Corran...excuse me but :o
all your pictures posted are with differents matizes comparing with the pictures from the source posted by Almexi,it's easy to see.
your script need little corrections i think!

Corran
28th June 2004, 06:11
Originally posted by jorel
all your pictures posted are with differents matizes comparing with the pictures from the source posted by Almexi,it's easy to see.
your script need little corrections i think!

Matizes? I'm sorry I'm not sure what that means and the forum search isn't giving me anything. I guess I'm still learning a lot so ignore my post until I can figure out what I'm missing.

jorel
28th June 2004, 06:58
ok Corran,i was unclear! matizes are like "hue" or color tons.see the color of the faces(easy to see) and the overall colors in your pictures are differents from the source.

i was forgoten: welcome in forum! :)

zettai
28th June 2004, 10:00
@jorel

well, yes... ColorYUV(gain_u=7) and Tweak tend to change the color :P

(although it might partly be being used to compensate for msmooth's odd coloring effect when used in YV12 and partly just to "improve" the colors)

Alxemi
28th June 2004, 23:34
Corran:
I really like your screenshots!! i think mines have better color, but yours has less noise and keep very good detail :)
They remember me the tests i did with mipsmooth animelq, could you please post the frame 25935??

original 25935
http://img17.imageshack.us/img17/6238/25935normal.png

25935 with mipsmooth (animelq)
http://img2.imageshack.us/img2/5122/25935mip.png

25935 with mipsmooth (animehq)
http://img2.imageshack.us/img2/8411/25935miphq.png

25935 with deen
http://img34.imageshack.us/img34/3066/25935deen.png

With deen i keep some noise, but mipsmooth was too much bluring for me, look at the leg of the guy who is the last one sitted, also the brown cloth of the guy in the middle..
BTW, your avs was for compress with XviD? Iīm trying a good encode but I canīt!! i have tested everything, with and without every single xvid setting, and i couldnīt keep the dots and mosquito away.
Hum, now i remember that Fox Home Entertaiment at q=2 did it quite well, but maybe we are talking then of using a DVDR xDD

more: corran if you want to show your screenshots in the screen use the IMG button!!

The following images are between 66-80 percent the filtered counterparts you posted above.
dunno understand... what do you mean?

ssjkakaroto:
I usually use double undot as default to remove the dots created by the resize filter (not a lot but they exists). Maybe is not necessary but for sure that is harmless.

Chainmax
29th June 2004, 00:19
I already asked this on a previous thread but didn't get much of answer:

Is it a good idea to use aWarpSharp+SSXSharpen or should I just use mfToon instead?

Chainmax
29th June 2004, 00:21
Crap, I can't edit.

The question is geared towards Futurama/Simpsons-type cartoons.

Corran
29th June 2004, 03:58
@ jorel

:) Thanks. Also, what Zettai is saying is true. Looking back though I guess I didn't really need any color correction for akira..

@ Alxemi

Actually I haven't tried backing up a dvd before. I'm just an AMV creator that is intersted in making the source I edit with look better than the DVDs they were derived from. BTW I know how to post images. :) I was just under the impression people didn't like large images loading. Oh well:

With the script I posted above (218KB):
http://www.corranproductions.com/filtertests/akira25935tweak.png

With the script I posted minus the tweak and colorYUV filters (213KB):
http://www.corranproductions.com/filtertests/akira25935notweak.png

My attempt to keep more detail in the brown jacket (http://www.corranproductions.com/filtertests/akiradetail.txt)(245KB):
http://www.corranproductions.com/filtertests/akira25935detail.png


Originally posted by Alxemi
Originally posted by Corran
The following images are between 66-80 percent the filtered counterparts you posted above.dunno understand... what do you mean?
What I was refering to here was that the size of the png images I posted were smaller than the images you posted. It is possible however we were using a different compression strength for our images, but I doubt it.

Prettz
29th June 2004, 04:48
The problem with Akira is that there is so much detail that even at 3 CDs you will be hard pressed to have enough bitrate to encode it all. I've tested this movie obsessively and I've found that trying to completely eliminate all noise is not worth it. In roughly half of the movie, any attempt at heavy denoising loses too much detail.

Also, when you completely eliminate noise and ringing, you still probably won't have enough bitrate to encode all the cel edges without substantial ringing. Removing all the noise in the center of the cel areas only makes the ringing far more apparent during playback. I've decided to leave a fair amount of noise in the movie when I encode it (still haven't had time to finish it). Deblock+Dering does most of my work.

I've found that C3D and VagueDenoiser are totally useless on this movie; they does absolutely nothing against the noise and ringing. MipSmooth I couldn't get to be very effectual without heavy ghosting. Unfilter works miracles at eliminating noise noise in this movie, but is also extremely dangerous. I use Unfilter in a few scenes with extremely heavy noise and little or no movement.

That said, here's the filter chain I have applied to most of the movie:

MPEG2Source("C:\Akira\akira_full_01.d2v",idct=7)

Telecide(chroma=true,post=false) #postprocessing interprets skyscrapers as interlace artifacts
Decimate(cycle=5,mode=2,ovr="decimate_override.txt") #only found 1 scene where Decimate fails so far

BlindPP(quant=2,cpu=4,moderate_h=20,moderate_v=40)
BlindPP(quant=2,cpu2="ooooxo",moderate_h=22,moderate_v=46)
FluxSmooth(12,16) #16 is absolute max for temporal senstivity before you get ghosting
Undot()

Crop(0,0,-2,0)
BicubicResize(640,368) #after crop, 2.0% aspect error

My whole script is hideously complicated, with 11 (and counting) different filter chains (some only being used in a single scene).

DarkNite
29th June 2004, 08:40
Akira seems like it would be the perfect candidate for bilateral filtering seeing as it's riddled with film grain, and almost completely void of large gradients.

*sighs*

Now I'll have to go buy this DVD for the third time... :angry: This time I'm making a backup immediately.

Boulder
29th June 2004, 09:37
Originally posted by Prettz

FluxSmooth(12,16) #16 is absolute max for temporal senstivity before you get ghosting


Actually the temporal threshold is 12 in this case. For some odd reason, SansGrip put temporal first, then spatial. Don't ask me how long it took before I noticed that myself:D

Sirber
29th June 2004, 13:30
Originally posted by Prettz
The problem with Akira is that there is so much detail that even at 3 CDs you will be hard pressed to have enough bitrate to encode it all. I've tested this movie obsessively and I've found that trying to completely eliminate all noise is not worth it. In roughly half of the movie, any attempt at heavy denoising loses too much detail.You could try RealVideo on it, it's excellent with anime source :D

vigi_lante
29th June 2004, 16:07
I always use this to remove noise from analog TV capture of cartoon/anime.

UnDot()
cnr2()
edeen(7,14,21,2,3,true)
TemporalCleaner(6,12)
aWarpSharp()
mfToonLite()

It works with a decent speed and really removes all noise. Worth a check.

Prettz
30th June 2004, 02:56
Originally posted by Boulder
Actually the temporal threshold is 12 in this case. For some odd reason, SansGrip put temporal first, then spatial. Don't ask me how long it took before I noticed that myself:D
Oh dear you're right. Now I have to figure out whether or not I knew this when I first started using those values (which was a long time ago, as I took a break from working on Akira for several months at one point). I know that at one point I realized that my normal settings for it were still producing minor ghosting in dark scenes and I adjusted it. More work for me I guess...

edit: I forgot to mention in my first post that my D2V also uses +13 Gain and +13 Offset. Helps video quality immeasurably in dark scenes.

SansGrip
23rd July 2004, 07:08
Originally posted by Boulder
Actually the temporal threshold is 12 in this case. For some odd reason, SansGrip put temporal first, then spatial. Don't ask me how long it took before I noticed that myself:D
My evil elves did their work well.