InpaintDelogo - advanced logo removal & hardcoded subtitles extraction

[Guilbert]

Strangely, no images were extracted (on the whole movie).

https://i.ibb.co/pjHTRHM/Capture-d-cran-2024-02-11-234232.png

[VoodooFX]

It extracted all subtitles from your sample.

[Guilbert]

Indeed. Thank you, it helped a lot!

[HeinrichI]

Hello. Can you give me some advice? Launched analysis by command:
InpaintDelogo( mask="Unfabulous\Unfabulous.bmp", Automask=1, Loc="450,0,150,174")
4 files were created:
https://i.ibb.co/yXZ8x0c/Files.png
But when I run the preview after, with the command
InpaintDelogo( mask="Unfabulous\Unfabulous.bmp", Loc="450,0,150,174", Mode="Deblend") then instead of removing the logo, colored spots appeared:
https://i.ibb.co/pyTB92k/2024-03-14-132153.png
The logo itself:
https://i.ibb.co/KNfb4Fw/2024-03-14-132627.png

[kedautinh12]

You need show your mask image

[HeinrichI]

You need show your mask image
Unfabulous.bmp:https://i.ibb.co/kK0CFvd/Unfabulous.png
Unfabulous_AutomaskTemp_A2.bmp:https://i.ibb.co/t87G3V6/Unfabulous-Automask-Temp-A2.png

[VoodooFX]

Launched analysis by command:
InpaintDelogo( mask="Unfabulous\Unfabulous.bmp", Automask=1, Loc="450,0,150,174")
4 files were created:

ebmp file is not created by Automask=1.

But when I run the preview after, with the command
InpaintDelogo( mask="Unfabulous\Unfabulous.bmp", Loc="450,0,150,174", Mode="Deblend") then instead of removing the logo, colored spots appeared:

Because logo is not transparent, so there is nothing to deblend.

[kalehrl]

Any advice how to create a mask for this kind logo:

https://i.ibb.co/MZjYxSp/Untitled.png (https://imgbb.com/)

It is faint and the resulting automask is no good because I just get a jumbled mask like this:

https://i.ibb.co/tMNDDLZ/output3-Automask-Temp-A2.png (https://imgbb.com/)

I used this command:
InpaintDelogo(mask="D:\Videos\Encodes\output3.bmp", Automask=1, Analyzeth=70, Loc="1800,908,-36,-0", Mode="Inpaint")

[HeinrichI]

ebmp file is not created by Automask=1.

How to create ebmp? I still don’t understand it from the description in the script.
Because logo is not transparent

The logo is still slightly transparent, as you can see in this shot.
https://i.ibb.co/VCccTW1/102-Unfabulous-The-Secret-avi-20240314-165255-211-2.png

[VoodooFX]

How to create ebmp? I still don’t understand it from the description in the script.

It's created automatically by analysis on the first deblend delogo run.

The logo is still slightly transparent, as you can see in this shot.

Probably not transparent enough for video compression level. Or maybe you are doing something wrong.

[VoodooFX]

Any advice how to create a mask for this kind logo:

https://i.ibb.co/MZjYxSp/Untitled.png (https://imgbb.com/)

I've no idea what "this kind" means.
This image looks like any other random image.

[kalehrl]

I don't known how to describe it. It's very transparent and faint. The whole video file is pretty dark and automask fails to create a proper mask using the default values. Are there any advanced options which may help?

[VoodooFX]

Can you share the video?

[kalehrl]

It's 47 minutes long. How much video do you need? I need to cut it because my upload speed is slow.
EDIT: Link removed.
I hope it's enough.

[VoodooFX]

Use Analyze=1 or Analyze=2 with NoBorderAt="bottom".

Then for high transparency logos you want to use higher aMix when getting basemask.

[kalehrl]

Thank you. Those extra options did the trick.
One more question. You noticed that the video has 2 logos.
How can I create 2 masks with automask?

[kedautinh12]

Thank you. Those extra options did the trick.
One more question. You noticed that the video has 2 logos.
How can I create 2 masks with automask?

Make a mask first, do the second later

[kalehrl]

I did it that way but then I end up with 2 masks which significantly slow down the encoding.
I think having 1 mask with 2 logos will result in faster encoding.

[HeinrichI]

On another episode of the series, where I'm trying to remove the logo, the transparency is better, and the removal works, but at times there is colored noise, how can I reduce it?
https://i.ibb.co/NyxxtPd/2024-03-15-002328.png
https://i.ibb.co/4dyj4Vw/2024-03-15-002830.png

[VoodooFX]

On another episode of the series, where I'm trying to remove the logo, the transparency is better, and the removal works, but at times there is colored noise, how can I reduce it?

Try these:
Inflate=2, Optimize2=2, dPP=-5

Btw, if resolution is same then you can use these masks on that previous episode too.

[VoodooFX]

I think having 1 mask with 2 logos will result in faster encoding.

No, it wouldn't.

[VoodooFX]

Unfabulous_AutomaskTemp_A2.bmp:https://i.ibb.co/t87G3V6/Unfabulous-Automask-Temp-A2.png

You didn't left enough space at the right side, and other sides have too large borders. This can have negative impact on generation of ebmp masks.

Remove 30 pixels at left.
Add 6 pixels at right.
Remove 16 pixels at top.
Remove 40 pixels at bottom.

[Floatingshed]

I am getting an error message repeatedly, I don't understand.
"Source clip must have at least two frames for alpha computation"
Clip is over 18000 frames...

[VoodooFX]

I am getting an error message repeatedly, I don't understand.
"Source clip must have at least two frames for alpha computation"
Clip is over 18000 frames...

Share your full avs script and mask. And cut video sample if possible.

[Floatingshed]

Thanks for the offer of help.
Script, mask and video clip here:
https://wetransfer.com/downloads/bbd19d832769a6d3353b944c10e4afc220240409133239/eb7ce3760c7f831b0d7c00f53b234f6820240409133239/19bad1?trk=TRN_TDL_01&utm_campaign=TRN_TDL_01&utm_medium=email&utm_source=sendgrid

[VoodooFX]

Thanks for the offer of help.
Script, mask and video clip here:

You didn't left at least 10 pixels around logo in Loc.
The basemask is not good.
Video quality is crap - you'll have crap deblend result.

[TrickyTrix]

InpaintDelogo is a fantastic tool for removing logos, but I failed to create masks for some videos below and I don't know why
https://mega.nz/folder/AsUWGaZJ#NzqG_wzzmw_BYZvd2KgPJg
I used InpaintDelogo(automask=1, mask="C:\xy\logomask.bmp", Loc="376,16,-26,-318")
but all I get is black rectangle for e10, e12, e13, e14, e15 and e16.
But interestingly enough, for e11 I get a perfect mask and I don't see any visual difference between e11 and those other e1x videos.
What could be the problem and is there a way to fix it?

[VoodooFX]

but I failed to create masks for some videos below and I don't know why


Short clips don't have enough suitable frames to build a good mask, as all those clips have exact same logo you should joint all them in script and then build the masks.

[TrickyTrix]

They are 7 minute cartoons with semi transparent Boomerang logo from 1st till the last frame, it doesn't make any sense for InpaintDelogo not to create the mask.
I tried the good mask I got on other cartoons, but since it is a logo from a TV, logo is not always in the same exact position pixel wise, so the final results are very bad.

[VoodooFX]

Oh I see, logo in e11 video looks like normal "blend":

https://i.imgur.com/UFmEo32.png

When logos in the other videos looks like "add blend" or whatever:

https://i.imgur.com/HyeC9Lw.png

[TrickyTrix]

But logo is still static and located in the same place. So, I still don't understand why InpaintDelogo won't produce a mask for it.

[Floatingshed]

How do we deal with a logo that fades in after the start of the programme?
If InpaintDelogo is active on pictures without logo it creates a logo.
Which 'appears' to fade out as the logo actually fades in...

[VoodooFX]

But logo is still static and located in the same place. So, I still don't understand why InpaintDelogo won't produce a mask for it.

It won't because InpaintDelogo is for normal logo blends, not for any other blend effects (https://en.m.wikipedia.org/wiki/Blend_modes).
Later I'll show you how to remove "add" blend logo.


How do we deal with a logo that fades in after the start of the programme?

Use inpaint mode on those fadein/out frames. Btw, and don't analyze such frames with animations.

[VoodooFX]

@TrickyTrix Here is how manually deblend those "add blend" logos:



# Video with "add" blend. (Not the normal blend!)
o=LWLibAvVideoSource("D:\e10.avi")

# Here we find frame with logo in solid background
m=o.trim(11267,-1).ConvertToY8

# Measure background brightness value and subtract it from the frame so background is ~0 to get the "add" mask:
addmask=m.Tweak(bright=-18, coring=false)

# Here we get the black and white basemask for PP (postprocess):
basemask=m.mt_binarize(25).crop(376,16,-26,-318)

# Here we subtract addmask from video as it's opposite of "add":
o.Overlay(addmask, x=0, y=0, mode="subtract", opacity=1)

# Hack to PP the logo remnants with InpaintDelogo
# YAlphaTweak=-255, UVAlphaFromY=1 to ensure that InpainDelogo's deblend process has no effect on the video
InpaintDelogo(mask=basemask, Loc="376,16,-26,-318", mode="deblend", YAlphaTweak=-255, UVAlphaFromY=1)


Original, Subtracted, PP:

https://i.imgur.com/esz1cxc.png https://i.imgur.com/7iPJoda.png https://i.imgur.com/iTHA57F.png

EDIT:
For the script to work get 3.8-test3 version from the test branch -> https://github.com/Purfview/InpaintDelogo/tree/test

[TrickyTrix]

@TrickyTrix Here is how manually deblend those "add blend" logos:



# Video with "add" blend. (Not the normal blend!)
o=LWLibAvVideoSource("D:\e10.avi")

# Here we find frame with logo in solid background
m=o.trim(11267,-1).ConvertToY8

# Measure background brightness value and subtract it from the frame so background is ~0 to get the "add" mask:
addmask=m.Tweak(bright=-18, coring=false)

# Here we get the black and white basemask for PP (postprocess):
basemask=m.mt_binarize(25).crop(376,16,-26,-318)

# Here we subtract addmask from video as it's opposite of "add":
o.Overlay(addmask, x=0, y=0, mode="subtract", opacity=1)

# Hack to PP the logo remnants with InpaintDelogo
# YAlphaTweak=-255, UVAlphaFromY=1 to ensure that InpainDelogo's deblend process has no effect on the video
InpaintDelogo(mask=basemask, Loc="376,16,-26,-318", mode="deblend", YAlphaTweak=-255, UVAlphaFromY=1)


Original, Subtracted, PP:

https://i.imgur.com/esz1cxc.png https://i.imgur.com/7iPJoda.png https://i.imgur.com/iTHA57F.png

EDIT:
For the script to work get 3.8-test3 version from the test branch -> https://github.com/Purfview/InpaintDelogo/tree/test

Thank you for pointing out different blending effects and showing me how to do this new deblending in new InpaintDelogo plugin.
Please tell me how would I measure background brightness value (I used your value for all these videos)?

Since it's a test branch it might be of use to report that on e12 you can see a gray Boomerang logo on frames around 680 and 1222, but it might be a completely normal artefact from this type of deblending, I wouldn't know.

[VoodooFX]

...showing me how to do this new deblending in new InpaintDelogo plugin.
InpaintDelogo doesn't do any deblending in that script... The line with "Overlay" does actual delogo.


Please tell me how would I measure background brightness value (I used your value for all these videos)?

AvsPmod (https://forum.doom9.org/showthread.php?t=175823) shows values of pixel at the bottom of the preview screen, you need the first value of "yuv".


Since it's a test branch it might be of use to report that on e12 you can see a gray Boomerang logo on frames around 680 and 1222, but it might be a completely normal artefact from this type of deblending, I wouldn't know.

It's normal artifact for such low quality videos as these.
You can use stronger postprocess settings -> "dPP=-5" & "Optimize2=2", best would be to use them only on the frames with those stronger artifacts.
Here is how to apply the different settings on the different parts of the video:


o=LWLibAvVideoSource("D:\e12.avi")

m=o.trim(10979,-1).ConvertToY8
addmask=m.Tweak(bright=-20,coring=false)
basemask=m.mt_binarize(27).crop(376,16,-26,-318)

d=o.Overlay(addmask, x=0, y=0, mode="subtract", opacity=1)

a1=d.Trim(0, 645).InpaintDelogo(mask=basemask, Loc="376,16,-26,-318", mode="deblend", YAlphaTweak=-255, UVAlphaFromY=1)
a2=d.Trim(646, 1353).InpaintDelogo(mask=basemask, Loc="376,16,-26,-318", mode="deblend", YAlphaTweak=-255, UVAlphaFromY=1, dPP=-5, Optimize2=2)
a3=d.Trim(1354, 0).InpaintDelogo(mask=basemask, Loc="376,16,-26,-318", mode="deblend", YAlphaTweak=-255, UVAlphaFromY=1)

a1++a2++a3

[Enthusiast]

First of all, I would like to express my gratitude for this delightful instrument. And secondly, I would like to ask for help.

I have a video with an animated black logo in the center. In some parts of the video, it is clearly visible, in some, it is not. If it were stable I could just make a mask and inpaint it. But it is moving and black as some parts of the frame. Could I somehow delete it from the video?

https://i.postimg.cc/cHgnLz0w/test-video-mp4-00-00-01-2024-08-14-12h15m53s770.jpg
https://i.postimg.cc/76FTGNZc/test-video-mp4-00-00-02-2024-08-14-12h16m28s996.jpg


Here is the sample https://file.io/pBiZAcI8d5vf

[VoodooFX]

But it is moving and black as some parts of the frame.

And I don't see a pattern in logo movements. Avisynth doesn't have object tracking tool...

Try Premiere or some AI tool.

[Enthusiast]

And I don't see a pattern in logo movements. Avisynth doesn't have object tracking tool...

Try Premiere or some AI tool.

Is it possible to use an animated mask with Inpaint Delogo?

[VoodooFX]

Is it possible to use an animated mask with Inpaint Delogo?


Yes, for example if mask has same dimensions as video:

m=LWLibAvVideoSource("D:\mask.mkv")
InpaintDelogo(mask=m, Loc="0,0,-0,-0")

[Enthusiast]

Yes, for example if mask has same dimensions as video:

m=LWLibAvVideoSource("D:\mask.mkv")
InpaintDelogo(mask=m, Loc="0,0,-0,-0")

Amazing, I thought it only understands BMP files!

[kalehrl]

Yes, for example if mask has same dimensions as video:

m=LWLibAvVideoSource("D:\mask.mkv")
InpaintDelogo(mask=m, Loc="0,0,-0,-0")

Is there an option to automatically create video like automask?

[VoodooFX]

Is there an option to automatically create video like automask?

Read the manual about DynMask.

[Floatingshed]

Read the manual about DynMask.

Are there any dynamic logo removal examples?

[VoodooFX]

Are there any dynamic logo removal examples?

For example: https://forum.doom9.org/showthread.php?p=1980298#post1980298

Search the thread.

[Floatingshed]

For example: https://forum.doom9.org/showthread.php?p=1980298#post1980298

Search the thread.

Yes, I did that before asking. I'm afraid I didn't find it very enlightening, it assumes a lot.
I am trying to remove, or at least mitigate, a very intrusive burned-in timecode. Can you please give me some easy to follow pointers?

Thanks.

[VoodooFX]

Yes, I did that before asking. I'm afraid I didn't find it very enlightening, it assumes a lot.
I am trying to remove, or at least mitigate, a very intrusive burned-in timecode. Can you please give me some easy to follow pointers?

There are 5 dynamic mask examples in that post, what's more to give?

Can you share a sample of your video?

[dot75]

Hello, can you help me? I would like to erase this logo. I can't make it transparent, the red is still visible.


https://i.postimg.cc/bSspcvM7/00624.png (https://postimg.cc/bSspcvM7)

https://i.postimg.cc/d0dT10gL/mask.png (https://postimages.org/)


InpaintDelogo( mask="C:\temp\Test\SubP2\eva4\eva5\mask.bmp",
\ Automask=0, aMix=-30,Loc="482,652,-0,-30",
\ Mode="inpaint",
\ Analyze=-3, FrW=642, FrS=0,dPP=0,Show=0, Inflate=0)

[VoodooFX]

InpaintDelogo( mask="C:\temp\Test\SubP2\eva4\eva5\mask.bmp",
\ Automask=0, aMix=-30,Loc="482,652,-0,-30",
\ Mode="inpaint",
\ Analyze=-3, FrW=642, FrS=0,dPP=0,Show=0, Inflate=0)

The mask doesn't look right.
Can you explain what dPP is doing there?
Btw, logo doesn't even fit into Loc.

Share the video.

[dot75]

The mask doesn't look right.
Can you explain what dPP is doing there?
Btw, logo doesn't even fit into Loc.

Share the video.

https://www.swisstransfer.com/d/1043a6d8-e81a-4080-9d45-1d53e635764d