TComb - dotcrawl removal issue (but QTGMC remove it)

[KingLir]

As someone quite new to VapourSynth (and AviSynth for that matter), I found some dotcrawl in TV animation that I can't remove with TComb (with VIVTC following it).
But when I QTGMC 2x the video - it's being removed successfully.
Maybe it's another type of artifact (not dotcrawl) and I just mix things up. If so, how can I remove it ?

Here is the sample. You can see it in the left eye of the character (right from viewer perspective) before and during the zoom in.

https://mega.nz/#!ggxF0bxA!IksjCkXKATd1VOS3ps4NrgV91p1k6YdQIRYcyvIyowY

[Myrsloik]

As someone quite new to VapourSynth (and AviSynth for that matter), I found some dotcrawl in TV animation that I can't remove with TComb (with VIVTC following it).
But when I QTGMC 2x the video - it's being removed successfully.
Maybe it's another type of artifact (not dotcrawl) and I just mix things up. If so, how can I remove it ?

Here is the sample. You can see it in the left eye of the character (right from viewer perspective) before and during the zoom in.

https://mega.nz/#!ggxF0bxA!IksjCkXKATd1VOS3ps4NrgV91p1k6YdQIRYcyvIyowY

Definitely looks like dotcrawl but as holywu said, it's moving too much. Try using dotkill (https://forum.doom9.org/showthread.php?t=173029) since it's a spatial only filter.

[KingLir]

Thank you HolyWu and Myrsloik.
How does QTGMC 2x manage to remove the dotcrawl ? can't I use just that part from QTGMC 2x ?

Myrsloik- about dotkill, I need a macOS build - wrote you in that thread.

[Mystery Keeper]

Against dotcrawl and rainbows use temporal denoising with luma-only analyzis in interlaced mode.

[Sharc]

I can't help you with vaporsynth. However, you can preprocess your source in VirtualDub using the plugin from here (http://home.earthlink.net/~tacosalad/video/dotcrawl.html) (you are lucky as it works only on NTSC sources).
You will get a pretty clean source now, which you can IVTC the usual way in a second step afterwards.

[KingLir]

Against dotcrawl and rainbows use temporal denoising with luma-only analyzis in interlaced mode.

Thanks. How to do it ? Now I am doing:

clip = core.bifrost.Bifrost(clip, interlaced=False)
clip = core.tcomb.TComb(clip=clip, mode=0)
clip = core.vivtc.VFM(clip=clip, order=1)
clip = core.vivtc.VDecimate(clip=clip)

I also tried these, but no effect. If anyone have time to test my small sample above - it will be best.

clip = haf.SMDegrain(clip, RefineMotion=True, prefilter=1)
clip = mvf.BM3D(clip, sigma=[3,3,3], radius1=0)

[KingLir]

I can't help you with vaporsynth. However, you can preprocess your source in VirtualDub using the plugin from here (http://home.earthlink.net/~tacosalad/video/dotcrawl.html) (you are lucky as it works only on NTSC sources).
You will get a pretty clean source now, which you can IVTC the usual way in a second step afterwards.

Thanks, but I am on macOS and no VirtualDub. Can you test my small sample above and see if the artifacts I mentioned (in the character eye) have been cleaned ?

[Sharc]

Not 100% cleaned, but significantly reduced.
Even QTGMC (2x) does not fully clean the pictures.

[KingLir]

Not 100% cleaned, but significantly reduced.
Even QTGMC (2x) does not fully clean the pictures.

Can you please upload the outcome from DotCrawl Comb Filter ? How can I even load it to VirtualDub ? It doesn't let me load MPEG2 videos....

[Sharc]

You can load it to VirtualDub via avisynth script (use your usual source filter)

Edit:
Here the fixed file. (http://www.mediafire.com/file/zolhu8u4adszf7u/test_mk1_fixed.avi)

[KingLir]

You can load it to VirtualDub via avisynth script (use your usual source filter)

Edit:
Here the fixed file. (http://www.mediafire.com/file/zolhu8u4adszf7u/test_mk1_fixed.avi)

Thank you but sorry this removes too much details - the entire image becomes super smooth. Also, it removes some frames.

Anyone can direct me what it the best approach to achieve what Mystery Keeper wrote ? I mean, what code lines should I use ?
... temporal denoising with luma-only analyzis in interlaced mode.

[VS_Fan]

Try this variations:
#clip = core.bifrost.Bifrost(clip, interlaced=True)
clip = core.tcomb.TComb(clip=clip, mode=2)
clip = core.vivtc.VFM(clip=clip, order=1)
clip = core.vivtc.VDecimate(clip=clip)
clip = mvf.BM3D(clip, sigma=8.0)
clip = haf.SMDegrain(clip, tr=1, thSAD=640)
Explanation:

if Bifrost is used before IVTC, then you need Interlaced=True
TComb: mode=2 processes both luma and chroma
BM3D with radius = 0 is the default: Spatial only, better before SMDegrain, instead of prefiltering inside SMDegrain
BM3D: The default for sigma is 10.0, you can try 10.0 or less if you see you're losing too much details
SMDegrain: To increase the threshold for degrain, comparable to what QTGMC does (Temporal binomial smoothing radius, to remove deinterlacing shimmer (http://avisynth.nl/index.php/QTGMC#Algorithm_Details)), it's safer to use radius=1, so you won't lose much details. You could use lower values for thsad if you see you're losing too many details

[ShogoXT]

Sorry for late response.

I was working on some early season anime DVDs that needed dotcrawl and rainbow removal badly. On vapoursynth there were few spacial and temporal filters, only temporal ones it seemed.

TComb didnt seem to provide decent results for me no matter how much I tried to tweak the settings or even step them up little by little. It would either not do enough, or completely destroy lines and other detail.

Ended up using the loadplugin avs line to make checkmate work:
core.avs.LoadPlugin(path='C:/checkmate.dll')
core.avs.checkmate(clip)


Used that with bifrost, lutdecrawl, and lutderainbow for good measure. Havsfunc really has a lot of good tools. :D

Also I read that QTGMC isnt good for animated sources. In my case it would leave ghosting.

[KingLir]

Sorry for late response.


Thanks!
So, for dotcrawl removal only, you used checkmate and lutdecrawl together ? one after another ?

[KingLir]

Try this variations:Explanation:

TComb: mode=2 processes both luma and chroma


Thank you. Why use mode 2 if we already remove rainbows with bifrost ?

[VS_Fan]

Thank you. Why use mode 2 if we already remove rainbows with bifrost ?Use just one of them. That's what I commented out bifrost

Also: for anime it's better to keep BM3D with a lower threshold: Start with 5.0 or a little less, so you won't lose much details

[KingLir]

Use just one of them. That's what I commented out bifrost


Thanks. Tcomb is consider better at removing rainbows than bifrost ?