halobuster - high quality halo remover

[feisty2]

the filter is very high quality and almost harmless to details
cuz, it picks NLMeans, an advanced denoising algorithm instead of stuff like, blurring, minblur, destructive anyways as the dehalo kernel

Function HaloBuster (clip input, bool "lsb", int "a", float "h", float "thr", float "elast")
{
lsb = Default(lsb, False)
a= Default (a, 32)
h = Default(h, 6.4)
thr = Default(thr, 1.0)
elast = Default(elast, 1.5)
gray = lsb ? input.converttoy8 () : input.converttoy8 ().Dither_convert_8_to_16()
gray = stackvertical (dither_get_msb (gray).padding (a, a, a, a),dither_get_lsb (gray).padding (a, a, a, a))
clean = knlmeanscl (gray, d=0, a=a, s=0, h=h, lsb_inout=True)
mask = TCannyMod (converttoyv12 (clean.ditherpost (mode=-1)), sigma=1.5, mode=1, gmmax=50)
mask = mask.converttoy8 ()
mask = mt_lut (mask, "x 255 / 0.24 - 3.2 * 0.0 max 1.0 min 255 *")
mask = mt_expand (mask)
mask = mt_inflate (mask)
merge  = dither_merge16_8 (gray, clean, mask)
limit = Dither_limit_dif16 (gray, merge, thr=thr, elast=elast)
crop = Dither_crop16 (limit, a, a, -a, -a)
luma = lsb ? crop : crop.ditherpost (mode=-1)
final = input.IsY8 () ? luma : ytouv (input.utoy8 (), input.vtoy8 (), luma)
return final
}

Function Padding (clip input, int "left", int "top", int "right", int "bottom")
{
w = input.width ()
h = input.height ()

output = input.PointResize (w+left+right, h+top+bottom, -left, -top, w+left+right, h+top+bottom)

return output
}

parameters:
lsb --- clip is stacked 16bits or not (8bits)
h --- filtering strength
thr --- threshold, 0-255 scale, return pixel from the source clip if the difference < thr, otherwise, return pixel from the processed clip
elast --- softness of the threshold

only luma will be processed, chroma will be copied from the source clip

demo:
before





after

HaloBuster ()

[Groucho2004]

Had a quick look, nice.

1.2 frames/second on SD material (i5 2500K @4GHz) - yikes.

[feisty2]

Originally Posted by Groucho2004

Had a quick look, nice.

1.2 frames/second on SD material (i5 2500K @4GHz) - yikes.

I don't really give a shoot about performance
I care about quality, my one and only goal

[Groucho2004]

Originally Posted by feisty2

I don't really give a shoot about performance

Yeah, you're young, lots of time left. We old geezers need things done faster or we'll be pushing up daisies by the time the job is done.

[Reel.Deel]

I know this won't increase performance by much but you could use TCannyMod over TCanny. Also how about making padding optional? If the source has black borders (just like your sample) it's useless to add padding since you're essentially padding black borders.

I have some DVDs from the early 2000's, they have massive halos from extreme EE. I wonder how HaloBuster will handle such halos?

Edit: I didn't know mastertapes had halos .

Originally Posted by Groucho2004

Yeah, you're young, lots of time left. We old geezers need things done faster or we'll be pushing up daisies by the time the job is done.

A few years ago I had the same mentality, fortunately I've gotten most of my priorities straight since then, plus I pay the light bill .

[creaothceann]

Originally Posted by feisty2

demo:

ftfy

[feisty2]

Originally Posted by Reel.Deel

I know this won't increase performance by much but you could use TCannyMod over TCanny. Also how about making padding optional? If the source has black borders (just like your sample) it's useless to add padding since you're essentially padding black borders.

I have some DVDs from the early 2000's, they have massive halos from extreme EE. I wonder how HaloBuster will handle such halos?

Edit: I didn't know mastertapes had halos .



A few years ago I had the same mentality, fortunately I've gotten most of my priorities straight since then, plus I pay the light bill .

1. not sure why, but, tcannymod gives me quite different result from tcanny, guess that's something related to "gmmax" (this parameter from tcanny just, vanished in tcannymod), so please stick to tcanny
and about padding, maybe you should crop the clip first, didn't crop my test clip cuz I'm sure everyone knows I'm lazy like hell
2. maybe it will work, just did some insane tests to see how it performs in extreme cases
so I just sharpened the already full of halo clip, now it's... no comment

sharpen (1)

sharpen (1)
HaloBuster (h=32)

guess it works, you'll need a very large "h"
3.I "make" mastertapes, that means I distribute the "final results" without ANY sacrifice to quality, but the material clips might be... not so nice

edit: I think I just typed "materiel"...

[feisty2]

Originally Posted by creaothceann

ftfy

thx, man!
u no gurl, ain't ya

[johnmeyer]

This works extraordinarily well with the subtle halos in your original. It will be interesting to see if it can be tweaked to remove some of the really huge halos that happen with oversharpening of old SD material, like VHS. I look forward to playing around with it.

[Dreamland]

This is my first post..
ciao from Italy
very good interesting thread
excuse me for my bad english ..i'm trying to import avs halo remover but there are problems

win8.1 32bit Avisinth 2.6 final







I've installed Visual C++ Redistributable Package for Visual Studio 2015 (x86) in my system , but doesnt' work!

Help me !!

thx a lot!

[Bloax]

Originally Posted by Groucho2004

Had a quick look, nice.

1.2 frames/second on SD material (i5 2500K @4GHz) - yikes.

The biggest performance bottleneck is this:

knlmeanscl (gray, d=0, a=32, s=0, h=h, lsb_inout=True)

'a' values over 15 are basically unusable for non-stillimage purposes due to the enormous calculation complexity put on the GPU. (Not the CPU!)
Consequently the performance could be greatly improved by lowering this value, likely at the slight cost of quality.

Function HaloBuster (clip input, bool "lsb", float "h", float "thr", float "elast", int 'a')
{
lsb = Default(lsb, False)
avalue = Default(a, 32)
h = Default(h, 6.4)
thr = Default(thr, 1.0)
elast = Default(elast, 1.5)
gray = lsb ? input.converttoy8 () : input.converttoy8 ().Dither_convert_8_to_16()
gray = stackvertical (dither_get_msb (gray).padding (32, 32, 32, 32),dither_get_lsb (gray).padding (32, 32, 32, 32))
clean = knlmeanscl (gray, d=0, a=avalue, s=0, h=h, lsb_inout=True)
mask = TCanny (converttoyv12 (clean.ditherpost (mode=-1)), sigma=1.5, mode=1)
mask = mask.converttoy8 ()
mask = mt_lut (mask, "x 255 / 0.24 - 3.2 * 0.0 max 1.0 min 255 *")
mask = mt_expand (mask)
mask = mt_inflate (mask)
merge  = dither_merge16_8 (gray, clean, mask)
limit = Dither_limit_dif16 (gray, merge, thr=thr, elast=elast)
crop = Dither_crop16 (limit, 32, 32, -32, -32)
luma = lsb ? crop : crop.ditherpost (mode=-1)
final = ytouv (input.utoy8 (), input.vtoy8 (), luma)
return final
}

Function Padding (clip input, int "left", int "top", int "right", int "bottom")
{
w = input.width ()
h = input.height ()

output = input.PointResize (w+left+right, h+top+bottom, -left, -top, w+left+right, h+top+bottom)

return output
}

To translate that to human speak, just run HaloBuster(blah,blah,a=18) to make performance less glacial at some kind of hit to quality. Even lower might work.
Because let's not forget that we're talking about the same person who absolutely insists on stupendous amounts of colorspace precision (int32 because int16 isn't enough!!) for something that is so extremely destructive in its nature that it would not benefit from it at all (MVTools).

[Groucho2004]

Originally Posted by Dreamland

I've installed Visual C++ Redistributable Package for Visual Studio 2015 (x86) in my system , but doesnt' work!

Help me !!

thx a lot!

You need Visual C++ Redistributable Package for Visual Studio 2013 for this plugin.

[creaothceann]

Originally Posted by johnmeyer

It will be interesting to see if it can be tweaked to remove some of the really huge halos that happen with oversharpening of old SD material, like VHS.

Like this? :]

[Dreamland]

Originally Posted by Groucho2004

You need Visual C++ Redistributable Package for Visual Studio 2013 for this plugin.

now works!! thx a lot!

[*.mp4 guy]

...but why aren't you removing all of the halos?

[feisty2]

I'm all ears, any more specific suggestions?

[Reel.Deel]

Originally Posted by feisty2

1. not sure why, but, tcannymod gives me quite different result from tcanny, guess that's something related to "gmmax" (this parameter from tcanny just, vanished in tcannymod), so please stick to tcanny

Updated TCannyMod with "gmmax" parameter. Thanks Chikuzen!

[feisty2]

updated

[Reel.Deel]

@feisty2

Change the following to support Y8 input:

final = input.IsY8() ? luma : ytouv (input.utoy8 (), input.vtoy8 (), luma)

[feisty2]

done.