InpaintDelogo - advanced logo removal & hardcoded subtitles extraction

[kedautinh12]

I was tried removed all logo from this video. I think this very good but can you suggest if this can better, VX? (If had other way). Thanks

example: https://drive.google.com/file/d/19xu...ew?usp=sharing

Applied Scripts: https://drive.google.com/file/d/1E4Z...ew?usp=sharing

Scripts:

LWLibavVideoSource("C:\Users\ADMIN\Downloads\Gen Hoshino - Kigeki [1440x1080i MPEG2 M-ON! HD].ts", fpsnum=24000, fpsden=1001)

a0=trim(0,49)
b0=trim(50,5488).InpaintDelogo(mask="C:\mask5.bmp", Automask=0, aMix=0, Loc="50,40,-1186,-910", Mode="Inpaint")
c0=trim(5489,5563)
a0++b0++c0

a1=trim(0,53)
b1=trim(54,119).InpaintDelogo(mask="C:\mask1.bmp", Automask=0, aMix=0, Loc="60,880,-1094,-50", Mode="Inpaint", Analyze=3)
c1=trim(120,5477).InpaintDelogo(mask="C:\mask1.bmp", Automask=0, aMix=0, Loc="60,880,-1094,-50", Mode="Deblend")
d1=trim(5478,5491).InpaintDelogo(mask="C:\mask1.bmp", Automask=0, aMix=0, Loc="60,880,-1094,-50", Mode="Inpaint", Analyze=3)
e1=trim(5492,5563)
a1++b1++c1++d1++e1

a2=trim(0,25)
b2=trim(26,37).InpaintDelogo( mask="C:\mask2.bmp", Automask=0, aMix=0, Loc="1292,908,-60,-50", Mode="Inpaint", Analyze=3)
c2=trim(38,5526).InpaintDelogo( mask="C:\mask2.bmp", Automask=0, aMix=0, Loc="1292,908,-60,-50", Mode="Deblend")
d2=trim(5527,5538).InpaintDelogo( mask="C:\mask2.bmp", Automask=0, aMix=0, Loc="1292,908,-60,-50", Mode="Inpaint", Analyze=3)
e2=trim(5539,5563)
a2++b2++c2++d2++e2

propSet("_FieldBased",0)
deep_resize(1920,1080)

[Reel.Deel]

Video without logo: https://www.youtube.com/watch?v=D_Oyplmhhv0

v1 = DGSource("Gen Hoshino - Kigeki [1440x1080i MPEG2 M-ON! HD].dgi").TFM().Tdecimate().Trim(3,0).Spline36Resize(1920,1080)
v2 = DGSource("Gen Hoshino – Comedy.dgi")
msk = v1.ExtractY().Trim(5460,5460).mt_binarize(24).mt_expand().mt_expand().mt_expand().mt_expand().mt_expand()

mt_merge(v1, v2, msk, luma=true)

Result: https://imgsli.com/MTI4ODcw

The mask can be improved, should be really easy to draw it yourself.

[Dogway]

@kedautinh12: For live video opaque delogo is not very good, I think in this case InpaintDelogo just does a passthrough to AVSInpaint which is spatial only. I tried to improve it with temporal compensation, it does improve a little but needs more work.

[kedautinh12]

Originally Posted by Dogway

@kedautinh12: For live video opaque delogo is not very good, I think in this case InpaintDelogo just does a passthrough to AVSInpaint which is spatial only. I tried to improve it with temporal compensation, it does improve a little but needs more work.

Hi, any suggestions scripts for temporal compensation?? Thanks

[johnmeyer]

Originally Posted by kedautinh12

Hi, any suggestions scripts for temporal compensation?? Thanks

Mcompensate, from MVTools2:

http://avisynth.org.ru/mvtools/mvtools2.html#functions

[kedautinh12]

Originally Posted by Reel.Deel

Video without logo: https://www.youtube.com/watch?v=D_Oyplmhhv0

v1 = DGSource("Gen Hoshino - Kigeki [1440x1080i MPEG2 M-ON! HD].dgi").TFM().Tdecimate().Trim(3,0).Spline36Resize(1920,1080)
v2 = DGSource("Gen Hoshino – Comedy.dgi")
msk = v1.ExtractY().Trim(5460,5460).mt_binarize(24).mt_expand().mt_expand().mt_expand().mt_expand().mt_expand()

mt_merge(v1, v2, msk, luma=true)

Result: https://imgsli.com/MTI4ODcw

The mask can be improved, should be really easy to draw it yourself.

sr for noob answer, why msk use trim(5460,5460) and why use many mt_expand()??

[Reel.Deel]

Trim(5460,5460) because that frame is all black with just the logo and text, perfect for creating a mask. mt_expand() is used to grow the mask outward. The text on the bottom left has a black outline and since frame #5460 is all black there no way to get the outline. Like I said, the mask can be improved but it took me just a few minutes to do that and the result was very good.

[kedautinh12]

Originally Posted by Reel.Deel

Trim(5460,5460) because that frame is all black with just the logo and text, perfect for creating a mask. mt_expand() is used to grow the mask outward. The text on the bottom left has a black outline and since frame #5460 is all black there no way to get the outline. Like I said, the mask can be improved but it took me just a few minutes to do that and the result was very good.

Ok, thanks. Got it

[VoodooFX]

# Version 3.00 :  Fixed: A frame selection scan result wasn't saved properly when "Automask=1" and "Inpaint" mode,
#                        now the deblending masks generation is up to twice faster in this scenario.
#                 New feature: Easy use of the ebmp masks on other videos, you can input them directly with "Mask" parameter.
#                              Ebmp format is changed, the masks from older versions are not compatible.
#                 New feature: Twice faster subtitles extraction with auto intermediate file.
#                              It's activated by negative "Extract" values.
#                              Requirements: LSMASH, TWriteAVI, x264vfw.
#                              New params: "ReExtract", "FourCC".
#                 New feature: Adjustable subs detection window, useful if video has non-middle subs alignment.
#                              New params: "DetWinPercW", "DetWinPercH", "DetWinHoPos".
#                              With "Show=12" you can see the subs detection window and correlation coefficient [CorrTh/Corr].
#                 New: "Turbo=-1", it activates an inpainting preset more suitable for UHD - HD resolutions.
#                 New: "IntSpd=4", similar as above.
#                 Basemask change: Background should be less than full white, logo - full white.
#                 Swapped "Turbo" 1 & 3.
#                 Removed "rSize" parameter.
#                 Reworked "Show=2", alternative to "Show=1" for positive Analyze.
#                 New feature: Various parameters to manipulate the deblending masks from positive analyze [for the experts only]:
#                              "YAlphaTweak", "UAlphaTweak", "VAlphaTweak",
#                              "YAlphaSolidIns", "UAlphaSolidIns", "VAlphaSolidIns",
#                              "YAlphaSolidOuts", "UAlphaSolidOuts", "VAlphaSolidOuts",
#                              "YColorSolid", "UColorSolid", "VColorSolid",
#                              "YColorSolidOuts", "UColorSolidOuts", "VColorSolidOuts",
#                              "YColorSolidIns", "UColorSolidIns", "VColorSolidIns",
#                              "YOffsetIns", "YOffsetOuts", "UVOffsetIns", "UVOffsetOuts", "ShiftMasksVe", "ShiftMasksHo",
#                              "YAlphaExternal", "WholeDeblend", "TriggerDynamic", "DumpMasks".
#                 Various other tweaks.
#                 Avisynth+ v3.7.2 or later is required.

Have fun.

Originally Posted by Dogway

I tried to improve it with temporal compensation, it does improve a little but needs more work.

I would be interested in your compensation script if it improves anything.

[kedautinh12]

Lol, many new parameters to remember

[VoodooFX]

Originally Posted by Zetti

Thank you very much.

I will test the temp script and im happy to see that i came with something you can use to get the script better for everyone.

Now you can adjust detection position with DetWinHoPos and use Show=12 for preview.

InpaintDelogo(Loc="60,566,-120,-30", Show=12, DynLocUp=2, DynMask=4, DynTune=170, DynMask4H=150, KillBlobs=-7, KillNoise=5, DetWinHoPos=0.8)

Comparison of Extract=1 vs Extract=-1 vs ReExtract=1 [read help about how to setup negative Extract]:

InpaintDelogo(Loc="60,566,-120,-30", Show=4, DynLocUp=2, DynMask=4, DynTune=170, DynMask4H=150, KillBlobs=-7, KillNoise=5,
\  Extract=1, ImgDir="D:\Subs", ImgInflate=1, CorrTh=0.7, DetWinHoPos=0.8)

InpaintDelogo(Loc="60,566,-120,-30", Show=4, DynLocUp=2, DynMask=4, DynTune=170, DynMask4H=150, KillBlobs=-7, KillNoise=5,
\  Extract=-1, ImgDir="D:\Subs", ImgInflate=1, CorrTh=0.7, DetWinHoPos=0.8)

InpaintDelogo(Loc="60,566,-120,-30", Show=4, DynLocUp=2, DynMask=4, DynTune=170, DynMask4H=150, KillBlobs=-7, KillNoise=5,
\  Extract=-1, ReExtract=1, ImgDir="D:\Subs", ImgInflate=1, CorrTh=0.7, DetWinHoPos=0.8)

Test.mkv file: https://drive.google.com/file/d/1Wi-...ew?usp=sharing

[Zetti]

Thank you i will look into it.

[VoodooFX]

Originally Posted by kedautinh12

Lol, many new parameters to remember

There at the manual's bottom is filter() with all parameters and defaults, I copy/paste from there sometimes.
Anyway, "for the experts only", so you don't need to know them.

Btw, I think that v3 crossed some threshold, because avs v3.7.1 just ignores InpaintDelogo filter like it's commented out.

Originally Posted by katzenjoghurt

Still looking forward to it.
(Not so much on trying to figure out what they do exactly... but some means to tweak deblending... mhh... looks super-delicous.)

Here is a good sample to practice on hard to delogo video -> https://www.youtube.com/watch?v=hSXo5EMY-vA
There is a good quality 2K VP9 stream [not 1080p!], not all download tools can see that 2K stream [use 4KVideoDownloader].


Logo:


Delogo:

[kedautinh12]

Btw, can new parameters fix my problem??
https://forum.doom9.org/showthread.p...72#post1975972

[kedautinh12]

I meet new problem with circle logo
can anyone had suggest when use with InpaintDelogo??
https://imgur.com/gallery/9G8g3Bv
Source: https://drive.google.com/file/d/1tes...ew?usp=sharing
Scripts:

ex_bob(nnedi3=true).SelectEven()
trim(38,6996)
InpaintDelogo(mask="C:\mask2.bmp", Automask=1, aMix=-10, Loc="84,44,-1260,-910", Mode="Inpaint")

[kedautinh12]

same error with left-bottom
https://imgur.com/gallery/HrQ3Vvg
Script:

ex_bob(nnedi3=true).SelectEven()
trim(224,6871)
InpaintDelogo(mask="C:\mask1.bmp", Automask=1, aMix=-50, Loc="78,916,-1180,-48", Mode="Inpaint")

[VoodooFX]

Originally Posted by kedautinh12

same error with left-bottom
https://imgur.com/gallery/HrQ3Vvg

What error? I see expected result of what you are doing.
Logo has shadow, so you are inpainting that shadow over letters.

[VoodooFX]

Originally Posted by kedautinh12

Btw, can new parameters fix my problem??
https://forum.doom9.org/showthread.p...72#post1975972

Split logo at the left and delogo separately.
To delogo at the right you can use ebmp from another video: https://drive.google.com/drive/folde...Vl?usp=sharing

[kedautinh12]

Originally Posted by VoodooFX

What error? I see expected result of what you are doing.
Logo has shadow, so you are inpainting that shadow over letters.

But how i can erase that remain of black color??

[kedautinh12]

And can you have other ways to delogo with circle logo??