Strange dot crawls and small rainbow effects

[AeroZ]

First of all my main problem: In my file I have strange dot crawls. I think they are dot crawls but the strange thing is no filter work on them and they are only visible in text (shown in my sample). The rest of my source is clean without dot crawls.

Sample (http://rapidshare.com/files/130127878/sample.m2v.html)

Here is my script, maybe theres something wrong?

LoadPlugin("D:\Programme\AviSynth 2.5\Filters\DGDecode.dll")
LoadPlugin("D:\Programme\AviSynth 2.5\Filters\De.dll")
LoadPlugin("D:\Programme\AviSynth 2.5\Filters\TDeint.dll")
LoadPlugin("D:\Programme\AviSynth 2.5\Filters\mt_masktools.dll")
LoadPlugin("D:\Programme\AviSynth 2.5\Filters\TIVTC.dll")
LoadPlugin("D:\Programme\AviSynth 2.5\Filters\SangNom.dll")
LoadPlugin("D:\Programme\AviSynth 2.5\Filters\RepairS.dll")
LoadPlugin("D:\Programme\AviSynth 2.5\Filters\TemporalCleaner.dll")
LoadPlugin("D:\Programme\AviSynth 2.5\Filters\Deen.dll")
LoadPlugin("D:\Programme\AviSynth 2.5\Filters\TTempSmooth.dll")
LoadPlugin("D:\Programme\AviSynth 2.5\Filters\gradfun2db.dll")
LoadPlugin("D:\Programme\AviSynth 2.5\Filters\asharp.dll")
LoadPlugin("D:\Programme\AviSynth 2.5\Filters\FFT3DFilter.dll")
LoadPlugin("D:\Programme\AviSynth 2.5\Filters\aWarpSharp.dll")

import("D:\Programme\AviSynth 2.5\Functions\Mrestore.avs")
import("D:\Programme\AviSynth 2.5\Functions\FastLineDarken.avs")
import("D:\Programme\AviSynth 2.5\Functions\aaf.avs")
import("D:\Programme\AviSynth 2.5\Functions\Colorbleeding.avs")

MPEG2Source("D:\Test\VTS_01_1.d2v")

DeDot()

ord= 1
tdeint(order=ord,mode=1,type=2)
mrestore(numr=600,denm=1001)

cwarpw()

Deblock(25, 2, 4)

Temporalcleaner(3,6).Deen("a2d",3,5,7)
TTempSmoothF(maxr=1)
FFT3DFilter(Sigma=3,plane=4,wintype=1)

aaf("repair",aas=-0.7)
FastLineDarken(strength=70,thinning=0)
Repair(last.sharpen(1),last,16)
asharp(0.8,2,0.25,true)

gradfun2db(thr=1.6)

crop(12,0,-10,-4)
Lanczos4Resize(720,576)

The other problem are some small rainbow effects. You don't notice them so much, but I would like to remove them completely.
My video also have some little colorbleed effects. I have already found a script that removes the colorbleedes perfectly. I can't remember where I found it. Strangely it removes the rainbows almost completely too.

Example pic (http://img155.imageshack.us/img155/1125/vfihj7uup1.jpg) (I tried to zoom on the rainbows for better view) First screenshot shows the rainbows without the colorbleed script. The second one uses the script against colorbleeds. But there is still some yellow on the outlines. How can I remove it?

And here is the script: As I said I found it somewhere. But I have no idea where I got it xD

function CwarpW(clip clip, float "wrp1"){
wrp1 = default(wrp1, 40)
lumma=clip.isYV12() ? clip : clip.converttoyv12
ccon=clip.isYV12() ? clip : clip.converttoyv12
croma=ccon.aWarpSharp(depth=wrp1,blurlevel=1,cm=1)
lumma.Mergechroma(croma) }

function CwarpS(clip clip, float "wrp1", float "wrp2"){
wrp1 = default(wrp1, 34)
wrp2 = default(wrp2, 36)
lumma=clip.isYV12() ? clip : clip.converttoyv12
ccon=clip.isYV12() ? clip : clip.converttoyv12
croma=ccon.bicubicresize(width(lumma)/2,height(lumma)/2).\
aWarpSharp(depth=wrp1,blurlevel=1,cm=1).bicubicres ize(width(lumma),height(lumma))
worrk=lumma.Mergechroma(croma)
croma2=worrk.aWarpSharp(depth=wrp2,blurlevel=1,cm= 1)
lumma.Mergechroma(croma2) }


Thanks in advance

[2Bdecided]

The aWarpsharp based functions (and they look a lot more complicated than they really are) are just warp sharpening the chroma to the luma. They're not "filtering", but they will obliterate small areas of chroma without matching luma boundaries - i.e. your unwanted problems in this case.

Cheers,
David.

[AeroZ]

I'm not really sure how to use aWarpsharp against this problem. I tried some functions, but none of them can solve the problem with the dot crawls and when I use aWarpsharp the edges are always rounded a lot and sometimes frames are deformed in some parts.

[martino]

Uhm, 2Bdecided just said that those functions are just simply aWarpSharp scripts to fix the problem. I don't know why you are saying that you don't know how to use aWarpSharp against the problem, because you used it in those scripts to fix it, to some extent anyway.

It just seems to be a more complicated MergeChroma(aWarpSharp(something)).

You could also try something like:
str=10 #change this to vary the strength
FFT3DFilter(sigma=3,sigma2=3,sigma3=str,sigma4=3,plane=3,bw=32,bh=32,bt=3,ow=16,oh=16)

[AeroZ]

I don't really know how this functions work because I simply found the script and tested it. The author of the script also said that it works against colorbleeds therefore why should it work against those dot crawls?
The script you posted did the same strange deforming in some frames that I had before.

[Nightshiver]

Please do not use deen. Ever. It's old and there are many better sharpening filters out there. FFT3D, LSF, fft3dgpu, etc. Derainbow() is good for removing rainbow effects. To make it stronger or weaker, just enter a number, such as Derainbow(15). I also think your scripts waaay to busy. You've got temporalcleaner, deen, ttempsmoothf, asharp, warpsharp, and fft3d.

[AeroZ]

I thought Deen is for denoise? When I remove denoise my video is a lot more noisier as when I use it. I'm a bit surprised because you said I shouldn't use the filter but it works really good for the image quality.

I tried DeRainbow but I always get an error: Invalid arguments to function "msharpen", how can I fix that?

You've got temporalcleaner, deen, ttempsmoothf, asharp, warpsharp, and fft3d
What do you suggest for remove? When fft3d is a good filter then I should leave it in. Deen is doing a really good job although you said I shouldn't use it.

[martino]

The source has barely any detail. If it's like that all the way through then there should be nothing wrong with using Deen. But be a bit wary when using it with high-detail sources.

[Nightshiver]

The reason I said to not use deen is because it is outdated and does not work as well as many newer sharpening filters. Unfortunately, I am on vacation and do not have my workhorse desktop with me to test some settings on it. I'll say this, just experiment. I know it sounds irritating, but it's what I had to do to figure out the way filters work and to get them to do what I wanted them to. Try different combinations of the filters or go one by one. I'll be back home around August 1 or 2, but by then this thread may be dead or you might have foud a solution. As for the Derainbow problem, be sure to use the latest verison of Avisynth and the latest Masktools. You also need msharpen to make the filter work. Using fft3d with derainbow is a good combination. If you want some more reading up on how to remove rainbows, check out these threads:

Here (http://forum.doom9.org/showthread.php?t=64432)
Here (http://forum.doom9.org/showthread.php?t=103191)
and Here (http://forum.doom9.org/showthread.php?t=102162)

[Blue_MiSfit]

Deen is useful (or so I hear) when used in conjunction with other filters in a complex script. You would never use it on its own, unless you had some really detail-free stuff to encode ;)

~MiSfit

[AeroZ]

Ok, you're right, I looked close again at my source and deen is really removing too much detail so I leave it out. I removed some unnecessary filters too and now the script is working much faster. DeRainbow is finally working for me.

Now I only need to remove those dot crawls. Any ideas how to fix it?

[Nightshiver]

If it's dot crawl, try using Dedot() or Guavacomb. But it might be haloing, and if so, dehalo_alpha should work fine.

[Blue_MiSfit]

I use checkmate() a lot - give it a try..

[AeroZ]

I´m not sure if it is really dot crawl because it's not in the whole source, only in text and till now no Filter worked. Dedot, Guavacomb and checkmate showed no effect too. Here's my link to my Sample (http://rapidshare.com/files/130127878/sample.m2v.html) again. Maybe you know what is it? It looks like dot crawl but I'm trying to remove it since months without succes.

[Nightshiver]

Yeah, I forgot about checkamte >.<
Meh, it looks like dot crawl O.o Then I guess I'm stumped.

[AeroZ]

Does nobody have any idea? It's really important for me, please. I need to remove those dot crawls.

[neuron2]

Is it always the yellow text? If so, then a filter could be made to smooth such yellow areas only.

[AeroZ]

Yes, but what filter do you mean? A whole new filter with an .dll? Is there really no filter that can fix this at the moment?

[neuron2]

I mean a filter could easily be written to smooth the yellow areas only.

[AeroZ]

And how would this work? Because I have no clue how to write such a filter.

[neuron2]

Perform a spatial and/or temporal smoothing only on areas whose average color is close to the color of the text. Do you know how to write Avisynth filters?

[*.mp4 guy]

That is dotcrawl, but it has been removed to a very large degree, by what I would guess is a very high quanlity spatial comb filter. The filter has changed the dot crawl to the extent that most simple dotcrawls removal filters will no longer be able to recognize it. It seams likely that the entire source is infact composite video, and that the yellow text was the only area where whatever comb filter they used was not completely succesful.

[AeroZ]

@neuron2
No, as I said I have no clue how to write such a filter.:confused:

@*.mp4 guy
Where do I get a spatial comb filter? I tried but I can't find such a filter.

[*.mp4 guy]

Why do you want one? the good ones are usually sold as very expensive pieces of dedicated hardware.

[AeroZ]

Why do you want one? To remove the dot crawls of course. And why are those filters sold? I thought all Avisynth filters are free?

[Leak]

To remove the dot crawls of course. And why are those filters sold? I thought all Avisynth filters are free?
Because your average television doesn't run AviSynth... (http://en.wikipedia.org/wiki/Comb_filter#Applications)

np: Spooky - Little Bullet (Part One) (Gargantuan)

[AeroZ]

Ah now I understand. The comb filter is from my DVD-Recorder then? So theres no possibility to remove those dot crawls because of this filter?

[neuron2]

As I said earlier, it is possible to make a special filter to smooth just those areas.

[AeroZ]

But I don't know how to write such a filter so this is no possibility for me.

[neuron2]

Unless you persuade someone to write one for you, it appears that you've exhausted your options.