Help cleaning up old cartoon source

[TwoToad]

Hello all,

I'm trying to clean up a really bad dvd source and I think I almost have it...

Here's what I have for a script so far:

dgdecode_Mpeg2Source("video.d2v",info=3)
ColorMatrix(hints=true,interlaced=true)

Complicated deinterlaceing from YATTA

RemoveDirt()

deen("a3d",4,5,8,3)
SPresso()
LUTDeRainbow()

vmtoon(strength=128)

Crop(8,0,-8,-2)
LanczosResize(640,480)

The removedirt finally got rid of all the lint from the celluloid to dvd transfer. I tried SeeSaw, but that made things blockier. I might need to sharpen things up a bit too...

All I really have to fix now is some color shifting/bleeding. How would I go about fixing this?

I know I can't make this into a 100% perfect encode, but any comments on how to improve things is appreciated.

[Chainmax]

A screenshot won't be of much use for asessing the state of the source. Cut a <1min vob sample with DGIndex and upload it someplace like RapidShare. Here's a couple of general advices though:

- For most sources, YATTA will be way overkill. Using TIVTC with TDeint as a postprocessor will work wonderfully and eliminates even the smallest leftover combing artifacts in mouths.

- Deen removes too much detail. I'd recommend you to try DeGrainMedian as it removes a fair amount of noise and also has a bonus side-effect of reducing dotcrawl and blocking if there's any in the source. The default call is very good, but if you want to tweak it, its readme is very easy to understand.

- For DeRainbowing I recommend you to start with BiFrost at default settings, read its readme in ordertoknow where to put it. If that's not enough, also add DeCross before MPEG2Source. Finally, if that doesn't get rid of the rainbowing, which only would happen on cases with extremely strong rainbowing, also use FFT3DFilter on the chroma planes with a sigma of 3 or higher after MPEG2Source.

[TwoToad]

Thank you for the advice Chainmax. I thought deen was a bit strong too. I'll try the other filters out to see the difference.

Here's a rapidshare link to about 1 min of the video. You can see that it's really cruddy... hehe Let me know what you come up with...

http://rapidshare.com/files/13121740/Test.demuxed.m2v.html

[Chainmax]

Heh, by <1min I meant something like 10s, 20s tops. I should have been more specific, my bad :o. I'm downloading it now and will fiddle with it as soon as I can.

[TwoToad]

hehe whoops =) oh well, you get to see all the crud in the scene anyway...

[kiwisrgreen]

yeah... don't use deen.

try
hqdn3d()
and Undot() is always useful

[TwoToad]

I take it deen is just too strong of a filter? When is it appropriate to use deen then?

[martino]

I take it deen is just too strong of a filter? When is it appropriate to use deen then?
It is strong, but the point is that it gets rid of too much detail that should stay in the picture.

There are other filters which are even stronger than Deen, but leave the detail intact. Combos of cleaning filters can work wonders when configured correctly.

[TwoToad]

So I know I'm getting a little off topic of this thread, but I have to ask while we're at it...

What are some good combos of filters for anime/cartoons, clean dvd's, or bad quality dvd's? Also, when is SeeSaw or Spresso appropriate? I admit I don't know a lot about those two scripts except that SeeSaw uses your denoiser of choice and maintains sharpness, right?

There are so many helpful scripts out there like Didee's scripts, LUTDeRainbow, FastSharpen, etc. I think I've gotten myself confused and don't know what they all do, or when to use them over just plain filters...

@Chainmax: I tried TIVTC and did not like the results. Double images during movement (example: someone raises their hand and you see the hand in the down position AND the upward position... )

[Chainmax]

I made an encode from a preliminary filterchain, you can download it from here:

http://rapidshare.com/files/13411692/fox264.mp4.html

I didn't remove the spots and scratches because I never dealt with those and don't know how to. Someone knowledgeable with DeSpot will be able to help you more.

[TwoToad]

Ah much sharper than I had before. The RemoveDirt() function will do a very good job of removing the spots, scratches, and lint from the video, so I'm not to worried about that...

I see you were having some issues with the color bleeding as well. I may just have to live with it.

Can I ask what your .avs file looks like? I'm still learning, and I learn by example best =)

[Chainmax]

IIRC, RemoveDirt can remove actual image detail unless carefully tweaked, so I'd advise you to try DeSpot and/or DeScratch. The script used on the encode is this:

ColorMatrix(hints=true,interlaced=true)

AssumeTFF()
Deinted=TDeint(order=1,field=1,type=1)
TFM(d2v="X:\wherever\oldcart.d2v",order=1,mode=6,PP=7,slow=2,mChroma=false,Clip2=Deinted)
TDecimate(mode=1)

DeGrainMedian()

DeHalo_Alpha()

Crop(8,0,706,478,align=true)

Spline36Resize(640,480)

aWarpSharp(depth=16,cm=1)

dull=last
sharp=dull.LimitedSharpenFaster(SMode=4,Strength=150)
Soothe(sharp,dull,25)

[TwoToad]

Thank you, thank you! This gives me some ideas and new tools to play with. You are a great help, Chainmax!

[Chainmax]

I'm glad to be of help :).

[Chainmax]

I didn't keep an eye out for color bleeding, but if there are any then maybe FixChromaBleeding (http://forum.doom9.org/showthread.php?t=77074) (be sure to apply Didée's suggestion for extra speed) will solve it.