InpaintDelogo - advanced logo removal & hardcoded subtitles extraction

[Maznak81]

Hello. I need help. I can Loc or "Crop" the logo without problems. But when I'm opening the AVS script I get an error:

I don't know what 'color_white' means
InpaintDelogo.avsi (line1817)

Here's the script:

LoadPlugin("C:\MeGUI-64 bit\tools\dgindexnv\DGDecodeNV.dll")
DGSource("K:\TEST.dgi")
InpaintLoc(Loc="90,26,-1092,-636")
InpaintDelogo(mask="K:\xxx.bmp", Automask=1, Analyze=2, aMix=0, Loc="90,26,-1092,-636")
InpaintDelogo(mask="K:\xxx.bmp", Loc="90,26,-1092,-636", Mode="Inpaint")


Thank you very much for your response.

[VoodooFX]

Moved Logo Database to GitHub, you can add your logos there -> https://github.com/Purfview/InpaintDelogo/tree/main/Logo%20Database

Hello. I need help. I can Loc or "Crop" the logo without problems. But when I'm opening the AVS script I get an error:

I don't know what 'color_white' means
InpaintDelogo.avsi (line1817)

That means that "colors_rgb.avsi" is missing, it should be installed with Avisynth. Anyway, I've removed this dependency in pre-release version ["test" branch on GitHub].

Btw, remove or comment out InpaintLoc and the first instance of InpaintDelogo in your script.
And if your video is interlaced then you need to deinterlace it before delogo.

[Maznak81]

Thank you very much for your help !!! It works now!

[doctorkhv]

Hello VoodooFX
Help me get rid of spots in a quick scene.
InpaintDelogo( mask="X:\01amask.png", Loc="0,0,0,0", Inflate=0)
01amask.png and 01a.mov https://drive.google.com/drive/folders/1BZHQ74laF1rt_UYZYaN-u3FvgPBwan4f?usp=share_link
https://i.imgur.com/egyvIoH.png

[drunksunk]

How can I remove the white watermark on top right? https://i.imgur.com/4TvFxKq.jpg

[VoodooFX]

Hello VoodooFX
Help me get rid of spots in a quick scene.
Hi, try Turbo=-1.

[VoodooFX]

How can I remove the white watermark on top right? https://i.imgur.com/4TvFxKq.jpg

Did you read the first post, where did you stuck?

This is veeery big opaque logo, delogo wouldn't look nice, something like this:
https://thumbs2.imgbox.com/46/aa/aPuoz6Iq_t.jpg (https://images2.imgbox.com/46/aa/aPuoz6Iq_o.jpg)

https://thumbs2.imgbox.com/e6/ca/YbbysKn3_t.jpg (https://images2.imgbox.com/e6/ca/YbbysKn3_o.jpg)

[doctorkhv]

Hi, try Turbo=-1.

InpaintDelogo( mask="X:\01amask.png", Loc="0,0,0,0", Inflate=0, Turbo=-1)
does not help, the same defects remain

[drunksunk]

Did you read the first post, where did you stuck?

This is veeery big opaque logo, delogo wouldn't look nice, something like this:
https://thumbs2.imgbox.com/46/aa/aPuoz6Iq_t.jpg (https://images2.imgbox.com/46/aa/aPuoz6Iq_o.jpg)

https://thumbs2.imgbox.com/e6/ca/YbbysKn3_t.jpg (https://images2.imgbox.com/e6/ca/YbbysKn3_o.jpg)

This is the result I obtained with HitPaw (it seems less noticeable): https://streamable.com/dexf0a

Regarding the tool, I don't know the installation procedure aside from having AviSynth installed on my computer. I don't know which paramaters of the command I would need to run then, how you get the square box pixel coordinates within your images, if you need to create a mask file of the part you want to remove and that's an alternative of using the pixel coordinates, etc.

[Alexkral]

I'm having trouble getting this to work (at all) for subtitle removal. The subtitles are very large and opaque, with a thick dark halo. The video is Full HD, this is a sample:

https://imgur.com/a/ZWKPdFy

So with show=0 no matter what I do I can't get rid of the black border. Using different values for Dyntune and DynMask4H, there seems to be some inpainting inside the subtitles, but the result is bad, darker and different than the background. The only thing that helps is DynInflate=7, but then the result is very distorted. The other parameters don't seem to make any difference.

Using show=6 I can't see the black border on the black background, so I don't know how it can be useful for finetune DynMask4H. With show=4 the mask is perfectly visible and has hardly any artifacts.

I'm not sure if I should try a different DynMask, because reading the manual I don't think it's easy to find a clearer example of subtitles with a dark halo.

[VoodooFX]

I'm having trouble getting this to work (at all) for subtitle removal.
The only thing that helps is DynInflate=7, but then the result is very distorted.

These two sentences contradicts each other. Looks like you got it working but you didn't liked the result.
What did you expected to see inpainted in a such big hole?
Usually people remove subtitles from a higher quality video by using a lower quality unsubtitled video.

[drunksunk]

These two sentences contradicts each other. Looks like you got it working but you didn't liked the result.
What did you expected to see inpainted in a such big hole?
Usually people remove subtitles from a higher quality video by using a lower quality unsubtitled video.

Hello, did you see my message above?

[VoodooFX]

Hello, did you see my message above?
Yes, I did but didn't had time to look at your sample posted... still I don't understand where you stuck, what you are asking is written in the first post, and whole manual is in the script aka avsi file.
Do you understand basics of Avisynth? Can you see your video using AvS?

Btw, your shared frame image is 4K, when your HitPaw delogoed video sample is 1280x512. Maybe share your original video sample on Mega or Wetransfer.
That HitPaw delogo looks like simple deKafka kind of delogo, there are few AvS scripts with such effects.

[Alexkral]

These two sentences contradicts each other. Looks like you got it working but you didn't liked the result.
What did you expected to see inpainted in a such big hole?
Usually people remove subtitles from a higher quality video by using a lower quality unsubtitled video.

lol, what did I expect from something called InpaintDelogo? Obviously not a distorted mess, you can blame me for that.

Actually, I wouldn't say that something works because I like the result, but because I find it useful, which is clearly not the case. So there's no contradiction.

State-of-the-art AI inpainting algorithms are easily capable of inpainting much larger objects, so with each passing day there are fewer things related to inpainting that can't be expected.

[drunksunk]

0) Read help/manual (at the top of the script) about parameters mentioned below.

Which script?

[VoodooFX]

If DynInflate=7 is not enough and it still picks edges of a halo, then you can expand a mask this way:

v=LWLibAvVideoSource("D:\videofile.mkv")
x=v.InpaintDelogo(..., DynInflate=7, Show=4).mt_expand().mt_expand() # one mt_expand() expands by one pixel
v.InpaintDelogo(..., mask=x, DynMask=1, Show=4)


lol, what did I expect from something called InpaintDelogo? Obviously not a distorted mess, you can blame me for that.
What you expect me to inpaint into my fantasy without a sample and a script? For me, "distorted mess" is description of inpainting. :)


Actually, I wouldn't say that something works because I like the result, but because I find it useful, which is clearly not the case. So there's no contradiction.
Actually, it works when it does what it's meant to do, not if you find it useful.

[VoodooFX]

Which script?
InpaintDelogo.avsi, it's a text file, you can open it with Notepad.

[drunksunk]

InpaintDelogo.avsi, it's a text file, you can open it with Notepad.

For a noob like me, it doesn't tell me how to get the coordinates of the square box in your video frame. Also it doesn't provide some example commands explaining what they do so that you can copy parts of thtem and remove the arguments you don't need.

Making a black/white mask with Photoshop would result in better result? And then there are so many parameters I have no clue if better to use or not.

Could you tell me which command you run so that I can try it out on my side?

[VoodooFX]

For a noob like me, it doesn't tell me how to get the coordinates of the square box in your video frame.
I use Crop() (http://avisynth.nl/index.php/Crop) to get coords, as alternative you can use InpaintLoc(Loc="100,100,-100,-100") too if you like it, sometimes I get them just from AvsPmod's screen.
I see you mentioned Photoshop, you can get coords there too.


Also it doesn't provide some example commands explaining what they do so that you can copy parts of thtem and remove the arguments you don't need.
But it does, it's at the very end (https://github.com/Purfview/InpaintDelogo/blob/3dea6e23f0a6c5156c312d480f2524a5fb7a2c03/InpaintDelogo.avsi#L1145) of the manual there, and arguments have "explainings" there too.


Making a black/white mask with Photoshop would result in better result?
Depends from a logo and video.


And then there are so many parameters I have no clue if better to use or not.
Yes, there are more than hundred arguments, I think some of them are pointless, but users said that they need them.
Understanding comes with experience. Usually you need to use just the few parameters and leave others with the defaults.



Could you tell me which command you run so that I can try it out on my side?
That depends from a logo, I don't really know much about the logo you are trying to remove, it looks like opaque but I'm not sure.
Example of a command is in the first post and in the manual too.

[drunksunk]

Crop() isn't for resizing/cutting your video resolution?

So inside the extracted "InpaintDelogo-main" folder I need to create a file with unknown extension like "test-script", and I paste this code inside it

InpaintDelogo( mask="D:\mask.bmp", Automask=0, aMix=0, Loc="100,100,-100,-100", Mode="Inpaint")


And then how do you run it? How does it know on which target file to run the script?

[VoodooFX]

Crop() isn't for resizing/cutting your video resolution?

So inside the extracted "InpaintDelogo-main" folder I need to create a file with unknown extension like "test-script", and I paste this code inside it

And then how do you run it? How does it know on which target file to run the script?

Ha, I asked you if you understand what Avisynth is...
You need to start with Avisynth basics first before doing anything else.
Start from there: http://avisynth.nl/index.php/Main_Page [some stuff there is outdated]

You can run avs scripts with any program supporting them. You load videos in avs scripts with the source plugins.

For example you can use AvsPmod (https://forum.doom9.org/showthread.php?t=175823) like a GUI for things.

[drunksunk]

Ha, I asked you if you understand what Avisynth is...
You need to start with Avisynth basics first before doing anything else.
Start from there: http://avisynth.nl/index.php/Main_Page [some stuff there is outdated]

You can run avs scripts with any program supporting them. You load videos in avs scripts with the source plugins.

For example you can use AvsPmod (https://forum.doom9.org/showthread.php?t=175823) like a GUI for things.

I found this video from 2008 and that's it: https://www.youtube.com/watch?v=RXByaCFgIHc

I guess your file needs to call your file from Powershell using Avisynth exe?

[doctorkhv]

Hi, try Turbo=-1.
InpaintDelogo( mask="X:\01amask.png", Loc="0,0,0,0", Inflate=0, Turbo=-1) defects are the same

What to change in the script?

[VoodooFX]

InpaintDelogo( mask="X:\01amask.png", Loc="0,0,0,0", Inflate=0, Turbo=-1) defects are the same

What to change in the script?

But that is not true. :)

Your shared pic of frame 253 with "defects":

https://thumbs2.imgbox.com/7a/4a/rfJC7Ord_t.jpg (https://images2.imgbox.com/7a/4a/rfJC7Ord_o.jpg)

"Turbo=-1" [upper "defect" looks OK now]:

https://thumbs2.imgbox.com/b6/4c/bCjfTIkP_t.jpg (https://images2.imgbox.com/b6/4c/bCjfTIkP_o.jpg)

Customized inpainting setting to Sharpness=100, preBlur=0.01, postBlur=4, Radius=12 ["defects" are gone]:
Read the Note there (https://github.com/Purfview/InpaintDelogo/blob/3dea6e23f0a6c5156c312d480f2524a5fb7a2c03/InpaintDelogo.avsi#L899)carefully.

https://thumbs2.imgbox.com/50/d1/Nja117H7_t.jpg (https://images2.imgbox.com/50/d1/Nja117H7_o.jpg)

"mShow=3" [for reference, your mask with the holes overlaid ]:
(Changed the holes' color to red from black in latest commit to the test branch in GitHub.)

https://thumbs2.imgbox.com/95/da/2tFYhDXk_t.jpg (https://images2.imgbox.com/95/da/2tFYhDXk_o.jpg)

EDIT:
If you have many holes in your mask then set "Optimize1=0", because very likely there won't be anything to optimize, script runs slower for nothing.

EDIT2:
I looked at original video, I don't see any blemishes in most of those "holes" in frame 253.
You don't need to inpaint there... in those "defects" places.

[VoodooFX]

I found this video from 2008 and that's it: https://www.youtube.com/watch?v=RXByaCFgIHc

I guess your file needs to call your file from Powershell using Avisynth exe?

No, that's not how it works.

InpaintDelogo plugin and other plugins goes to Avisynth's plugins folder, you "call" them in your script.
Your script [AKA an user script] you save as .avs file.
Those .avs files you can open with the programs supporting Avisynth.
There is no such thing as "Avisynth.exe".

EDIT:
Actually you can open them in the programs not supporting Avisynth, but let's not go there atm, because you'll be even more confused.

EDIT2:
I've looked at Youtube, there I found Deinterlacing with AVISynth and QTGMC Tutorial (https://www.youtube.com/watch?v=C4PyyQoz6eo).
It's about QTGMC plugin, but should help you to grasp the principles of Avisynth.

[drunksunk]

No, that's not how it works.

InpaintDelogo plugin and other plugins goes to Avisynth's plugins folder, you "call" them in your script.
Your script [AKA an user script] you save as .avs file.
Those .avs files you can open with the programs supporting Avisynth.
There is no such thing as "Avisynth.exe".

EDIT:
Actually you can open them in the programs not supporting Avisynth, but let's not go there atm, because you'll be even more confused.

EDIT2:
I've looked at Youtube, there I found Deinterlacing with AVISynth and QTGMC Tutorial (https://www.youtube.com/watch?v=C4PyyQoz6eo).
It's about QTGMC plugin, but should help you to grasp the principles of Avisynth.
I copied all InpaintDelogo content into plugins64+, create a test folder with a file called script.avs, put the video.mp4 in same folder and now?

[VoodooFX]

I copied all InpaintDelogo content into plugins64+, create a test folder with a file called script.avs, put the video.mp4 in same folder and now?
"all InpaintDelogo content" is only one .avsi file.
You don't need to move your video files.
Open your .avs file with a program of your preference, for example: AvsPmod.

[drunksunk]

"all InpaintDelogo content" is only one .avsi file.
You don't need to move your video files.
Open your .avs file with a program of your preference, for example: AvsPmod.

That's just a text editor like any other right? So what code should I put in my .avs script and from where should I call it?

[VoodooFX]

That's just a text editor like any other right?
Not just a text editor, you can turn on the video preview there to see what you are doing in your script and many other things.
You can detach the preview window in the settings somewhere there.

So what code should I put in my .avs script
Whatever you like, read there: http://avisynth.nl/index.php/Main_Page

and from where should I call it?
I don't understand what you meant by this.

[drunksunk]

I get an error: https://imgur.com/Lfsr4Q3

Also I don't quite understand how you add a video in AvsPmod. I tried to drag and drop and that would add a "DirectShowSource()" line.

Could you please provide a working command so that I can test it on my end?

[VoodooFX]

I get an error: https://imgur.com/Lfsr4Q3
Error in red means that you don't have InpaintDelogo in plugins folder.
Dunno what that error in the window means. What is version of AvsPmod?

Also I don't quite understand how you add a video in AvsPmod. I tried to drag and drop and that would add a "DirectShowSource()" line.
Yep, that's how you can add it.
DirectShowSource() filter is outdated, I recommend LWLibAvVideoSource(), it comes from LSMASHSource plugin.

Could you please provide a working command so that I can test it on my end?

Here you go:
Version()
What it shows for you?

This one should work too:
ColorBarsHD()

[StainlessS]

VX, I noticed that you added a software to produce Subtitles from audio using AI, in subtitles forum.
Is you gonna add AI thingy to InpaintDelogo (or a new delogo whotsit), possible or no ?

Whisper - AI auto-transcription-translation :- https://forum.doom9.org/showthread.php?t=184859

https://i.imgur.com/BNVNKKg.png

EDIT: What kind of speed can one expect (I downed the 170MB-ish CPU version, 1.6-ish GB for GPU ver$ is a bit rich for me, is that much faster ?) ?.
EDIT: I got GTX 1070 Foundation Edition, 8GB Ram.

[VoodooFX]

VX, I noticed that you added a software to produce Subtitles from audio using AI, in subtitles forum.
Is you gonna add AI thingy to InpaintDelogo (or a new delogo whotsit), possible or no?
Last time I checked [end of the last year] few AI delogo implementations, there were some deal braking issues, but results were very promising, probably stuff needs to be touched by the right hands. [I don't plan to touch it... maybe, in unforeseeable future]


...or a new delogo whotsit
If I'll be not too sober tonight I can write some new whotsit for you, I always thought that deKafka, xLogo & ect. should be better, shouldn't be hard to improve those, no? :)


Whisper....

EDIT: What kind of speed can one expect (I downed the 170MB-ish CPU version, 1.6-ish GB for GPU ver$ is a bit rich for me, is that much faster ?) ?.
EDIT: I got GTX 1070 Foundation Edition, 8GB Ram.

If you have decent 4 real cores CPU you can achieve ~nearly real time on "medium" model, but that depends from audio content. I don't have GPU with CUDA, people say GPU is ~5x faster.

EDIT:
Actually I've GPU similar to your, but it's collecting dust in the boxroom, together with the desktop...
For English run "medium.en" model.
Transcription improvement in "medium" vs "large" model is pretty small, imo.

EDIT2:
Btw, in that screenshot there are no errors, despite that main Swedish actor talks rapidly in funky accent, even punctuation is perfect.
Actually, "No, sure." should be "Yes, sure.", but he pronounced something like "Yo" or German "Ja".

[StainlessS]

I only have the one GPU (I'm not really counting the crappy GT 520 [I think] in my No 2 machine).
However, I have accumulated 5 of the 1Litre tiny/mini/micro (Lenovo/HP/Dell) machines in the last few months,
and also a fanless dual Lan Industrial PC with 4 comms ports. (Advantech ARK-2250, maybe gonna try get pfsense Firewall on it).
I'm also sorta looking for uses for the tiny machines, maybe could use one for CPU based AI Subs extraction.
I dont have any AMD machines, but I think that the HP AMD Mini machines have a dedicated GPU.

[drunksunk]

Error in red means that you don't have InpaintDelogo in plugins folder.
Dunno what that error in the window means. What is version of AvsPmod?


Yep, that's how you can add it.
DirectShowSource() filter is outdated, I recommend LWLibAvVideoSource(), it comes from LSMASHSource plugin.



Here you go:
Version()
What it shows for you?

This one should work too:
ColorBarsHD()

I have InpaintDelogo in "plugin64+" folder so it should be detected. I change the code in the script to "Version()" but how do I run it?

[VoodooFX]

I change the code in the script to "Version()" but how do I run it?
There is a "triangle" button at the bottom left to toggle the preview window.
A mouse click on preview refreshes it if script was changed.

[StainlessS]

Btw, in that screenshot there are no errors, despite that main Swedish actor talks rapidly in funky accent, even punctuation is perfect.
Actually, "No, sure." should be "Yes, sure.", but he pronounced something like "Yo" or German "Ja".
I guess that you will be adding AI powered spoken language translation to the subs thingy too :)

EDIT:
I downed the 170MB-ish CPU version, 1.6-ish GB for GPU ver$ is a bit rich for me, is that much faster ?
I'll down the GPU ver$ in the pub for free.

EDIT: Sorry, I should maybe have posted in the Sutitles forum thread.

[VoodooFX]

I guess that you will be adding AI powered spoken language translation to the subs thingy too :)

There is translation option already.

Sorry, I should maybe have posted in the Sutitles forum thread.Yep.

[doctorkhv]

Hi, try Turbo=-1.

But that is not true. :)

Customized inpainting setting to Sharpness=100, preBlur=0.01, postBlur=4, Radius=12 ["defects" are gone]:
Read the Note there (https://github.com/Purfview/InpaintDelogo/blob/3dea6e23f0a6c5156c312d480f2524a5fb7a2c03/InpaintDelogo.avsi#L899)carefully.

"mShow=3" [for reference, your mask with the holes overlaid ]:
(Changed the holes' color to red from black in latest commit to the test branch in GitHub.)


VoodooFX thanks a lot for the very detailed answer!
Creating a PNG with a mask of any color and transparency with border feathering is not a problem. One can also share this long scene, but by what criteria?
What should be the script?
InpaintDelogo( mask="X:\01amask.png", Loc="0,0,0,0", Optimize1=0, Sharpness=100, preBlur=0.01, postBlur=4, Radius=12, Inflate=0, Turbo=-1)

[VoodooFX]

Creating a PNG with a mask of any color and transparency with border feathering is not a problem. One can also share this long scene, but by what criteria?
I don't understand what you meant here.



What should be the script?
InpaintDelogo( mask="X:\01amask.png", Loc="0,0,0,0", Optimize1=0, Sharpness=100, preBlur=0.01, postBlur=4, Radius=12, Inflate=0, Turbo=-1)

Not sure what you are asking here too.
Btw, Turbo is predefined presets for those inpainting parameters, you shouldn't be able to use Turbo when you change them from defaults.

[drunksunk]

So I click the triangle and I see nothing: https://i.imgur.com/3Tni56q.png

Does anyone know which is the best command to remove the top right watermark on this video (https://drive.google.com/drive/folders/1AnXe4TYFfPYwJTW08DU4np30WI60y56W)?

[VoodooFX]

So I click the triangle and I see nothing: https://i.imgur.com/3Tni56q.png

Does anyone know which is the best command to remove the top right watermark on this video (https://drive.google.com/drive/folders/1AnXe4TYFfPYwJTW08DU4np30WI60y56W)?

Not nothing, you can see version of Avisynth+ in the preview window at the bottom.
Add your video to the script to see your video.
Later I'll check your video.

[drunksunk]

Not nothing, you can see version of Avisynth+ in the preview window at the bottom.
Add your video to the script to see your video.
Later I'll check your video.

Any update with the video?

[VoodooFX]

Does anyone know which is the best command to remove the top right watermark on this video (https://drive.google.com/drive/folders/1AnXe4TYFfPYwJTW08DU4np30WI60y56W)?
Why do you want to remove logos from some youtube gaming videos?

Any update with the video?

Yes:


# Here you import your video:
LWLibAvVideoSource("D:\test4k.mp4")

# Here we crop black borders from video:
Crop(0,250,0,-250)

# Here I located logo coords [+20 pixels from logo edges]:
# Crop(3300,0,-240,-1466)

# Here we do delogo [first run with Automask=1 to get a basemask automatically, then set it to 0 to do analyze and delogo]
InpaintDelogo(Loc="3300,0,-240,-1466", mask="D:\mask.bmp", Automask=0, aMix=-2, NoBorderAt="top", AnalyzeTh=30, mode="Deblend", dPP=-5, Interp=3, Optimize2=2)

Before:
https://thumbs2.imgbox.com/41/86/U5e2foxL_t.png (https://images2.imgbox.com/41/86/U5e2foxL_o.png)

After:
https://thumbs2.imgbox.com/d8/4c/QUsBWdu0_t.png (https://images2.imgbox.com/d8/4c/QUsBWdu0_o.png)

[drunksunk]

Any clue what are these errors I keep having whenever opening AvsPmod? https://i.imgur.com/0E3vuga.png

Anyway "mask file not found" obviously, how did you generate that?


And I'd like to suggest that you add all dependencies to your repo on GitHub, it took me some time after every restart to see the errors and add the extra plugins.

[VoodooFX]

Any clue what are these errors I keep having whenever opening AvsPmod? https://i.imgur.com/0E3vuga.png
Ask in AvsPmod's thread.

Anyway "mask file not found" obviously, how did you generate that?
Read my previous post.

And I'd like to suggest that you add all dependencies to your repo on GitHub, it took me some time after every restart to see the errors and add the extra plugins.
All dependencies are posted there already. :confused:

[RidgeShark]

A bit late with this, but thank you VoodooFX!

[drunksunk]

First got error that it was missing, then I added the plugin but I get this: https://i.imgur.com/SLn2f8h.png

[kedautinh12]

You can download FFTW-3.3.10-DLLs.rar here:
https://forum.doom9.net/showthread.php?p=1965537#post1965537

Copy and paste 32bit to SysWOW64, 64bit to System32

[drunksunk]

Ok, now I can play the video with the changes, but it doesn't get exported.