ExBlend deblender - v1.04 - 18 Dec 2018

[Selur]

I'm on Windows 11.

Also, I seem to remember that no XBD file will be generated unless a complete scan is done {ie, it does not write a partially complete file}

I called my clip with "avs2yuv64.exe c:\Users\Selur\Desktop\test2.avs NUL" which runs through the whole thing.

I now opened the script in avsmod, changed the call to

Exblend(mode=1, ExBfile="e:\Exbfile", debug=true, lv=5, dv=5)

downloaded and started Debugview and scrolled through the clip in avspmod.

Tried to save the content of Debugview, but then Debugview, simple froze.
-> took a screenshot and killed Debugview.

Now E:\Exbfile_1.LOG was created, when I closed avspmod which contains:

ExBlend: INFO,    
ExBlend: INFO,    ExBlend() v1.04 - 18 Dec 2018 - (c) StainlessS.
ExBlend: INFO,    
ExBlend: DEBUG,   Limiting args to 'Mode 1'
ExBlend: DEBUG,   Checking Colorspace
ExBlend: DEBUG,   Checking valid 'mode'
ExBlend: DEBUG,   Checking valid 'pal' range
ExBlend: DEBUG,   Allocating fdat[]
ExBlend: DEBUG,   Allocating MetricsDat[]
ExBlend: INFO,    ------------------------------------
ExBlend: INFO,    MODE                    = 1
ExBlend: INFO,    PAL                     = 0
ExBlend: INFO,    LOCKTHRESH              = 1,00
ExBlend: INFO,    ITHRESH                 = 3,00
ExBlend: INFO,    SHOW                    = 5 
ExBlend: INFO,    EXBFILE                 = 'e:\Exbfile'
ExBlend: INFO,    VER                     = False
ExBlend: INFO,    REVIP                   = False
ExBlend: INFO,    OVERRIDE                = NOT SET
ExBlend: INFO,    LV                      = 5 DEBUG
ExBlend: INFO,    DV                      = 5 DEBUG
ExBlend: INFO,    DISP                    = 1 EXBLEND [Default]
ExBlend: INFO,    DCLIP                   = NO
ExBlend: INFO,    COMPUB                  = 2 0=SSSS, 1=SDDS 2=DDDD [S=Source,D=DClip]
ExBlend: INFO,    DECIMATE                = False
ExBlend: INFO,    DECOMPIX                = 1 UNUSED
ExBlend: INFO,    DecClpIx                = 1 
ExBlend: INFO,    DEBUG                   = True
ExBlend: INFO,    ------------------------------------
ExBlend: DEBUG,   LOG Filename            = e:\Exbfile_1.LOG
ExBlend: DEBUG,   LOG file Verbosity      = 5
ExBlend: DEBUG,   LOG DebugView Verbosity = 5
ExBlend: DEBUG,   XBD Filename            = e:\Exbfile.XBD
ExBlend: DEBUG,   FRAMES Filename         = e:\Exbfile_Decimated.TXT
ExBlend: DEBUG,   ------------------------------------
ExBlend: DEBUG,   Constructor, no Errors encountered.
ExBlend: DEBUG,   Constructor OUT  >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
ExBlend: INFO,    [569] Lost Sequence: Detected=2
ExBlend: DEBUG,   Destructor IN    <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
ExBlend: DEBUG,   Mode 1, checking if clip fully scanned.
ExBlend: DEBUG,   Mode 1, Buffer Incomplete ( 0,3 Percent)
ExBlend: DEBUG,   delete[] MetricsDat
ExBlend: DEBUG,   delete[] fdat
ExBlend: DEBUG,   Destructor OUT (CLOSING LOG) >>>>>>>>>>>>>>>>>>>>
>>>

No e:\Exbfile.XBD or e:\Exbfile_Decimated.TXT file was created.

Cu Selur

[StainlessS]

OK, I think I twigged whats happening,

I called my clip with "avs2yuv64.exe c:\Users\Selur\Desktop\test2.avs NUL" which runs through the whole thing.

think that avs2yuv64 is returning to frame 0 after scan, which I've a sneaky feeling will start afresh ie reset, as if nothing has been scanned.
I'm not on my compiler machine, and not even on windows at present, I'll see what I can do when I can.

EDIT: I've never actually used avs2yuv. [or cant remember it if I have done]

EDIT:
I still doubt that it would do any good if it is to follow this

TFM() # field match back to a film frames
TDecimate() #remove duplicates

but that's a different matter.

[StainlessS]

Selur,
https://forum.doom9.org/showthread.p...53#post1846853
above linked RT_ForceProcess() will scan entire file and NOT return to frame 0 on completion. [if that is any good]

[Selur]

Thanks will look whether I get RT_ForceProcess working.
a. Okay, the link in that thread doesn't work, but I got the RT_Stats_25&26_x86_x64_dll_v2.00Beta13_20201229.zip from your MediaFire site.
b. Looked at the source the TFM&Decimate isn't needed, source is wrongly flagged as interlaced while it's progressive (+ blended fields).
-> okay, I got no idea how to use that properly.
using:

ClearAutoloadDirs()
SetFilterMTMode("DEFAULT_MT_MODE", MT_MULTI_INSTANCE)
LoadPlugin("I:\Hybrid\64bit\Avisynth\AVISYN~1\LSMASHSource.dll")
Import("I:\Hybrid\64bit\Avisynth\avisynthPlugins\mtmodes.avsi")
LoadPlugin("C:\Users\Selur\Desktop\ExBlend_x64.dll")
LoadPlugin("C:\Users\Selur\Desktop\RT_Stats_x64.dll")
LWLibavVideoSource("e:\clips\Courage the Cowardly Dog S02E17E18 SOURCE.mkv",cache=false,dr=true,format="YUV420P8", prefer_hw=0)
org=last
#Exblend(mode=1, ExBfile="e:\Exbfile", debug=true, lv=5, dv=5)
RT_ForceProcess()
#Exblend(mode=0,revip=true, show=0)
#StackHorizontal(last, org)
PreFetch(16)
#  output: color sampling YV12@10, matrix: bt709, scantyp: progressive, luminance scale: limited
return last

also doesn't output a file (I could find), but it shows some stuff in the debugviewer.


Cu Selur
Ps.: Also uploaded the source to my GoogleDrive

[StainlessS]

Selur,
OK, Exblend only writes XBD file on exblend input clip [EDIT: ExBlend Filter] destructor, so we need to do a little hack for RT_ForceProcess thingy to work.

VideoFileName   ="E:\SELUR\Courage the Cowardly Dog S02E17E18 SOURCE.dgi"
DGSource(VideoFileName)
ORG=Last

TMP=ORG
TMP.Exblend(mode=1, ExBfile=".\Exbfile", debug=true, lv=5, dv=5)
RT_ForceProcess()  # Force PASS1
TMP=0               # Force Close ExBlend I/P clip [and so also destroy ExBlend Filter clip]. XBD file NOT written until ExBlend destructor is called.

ORG
Exblend(mode=2,ExBfile=".\Exbfile")  # PASS2

Return last

EDIT: Above we had a bit of an 'Interoperability' style problem, as RT_ForceProcess returns only a 0 [TwriteAVI::ForceProcess() does return a clip and would probably be more suitable].
So, we had to kill input clip to Exblend instead of output clip. Making Last=0 [instead of "TMP=0"] after RT_ForceProcess() does not work, not sure why.

EDIT: Above PASS2 is decimated result, so any StackHorizontal whatsit will be out-of-sync frames.

EDIT: Metrics on last frame [single pass only] show 92.53% of maximum possible blend pair detections,
I would only use ExBlend() if above about 95% or 96%. [EDIT: Although it is a short clip and does fluctuate about 92% -> 96%, longer clip would be better accuracy %]

[StainlessS]

With stackhorizontal

VideoFileName   ="E:\SELUR\Courage the Cowardly Dog S02E17E18 SOURCE.dgi"
DGSource(VideoFileName)
ORG=Last

TMP=ORG
TMP.Exblend(mode=1, ExBfile=".\Exbfile", debug=true, lv=5, dv=5)
#return last Return Pass 1

RT_ForceProcess()
TMP=0 # kill TMP clip and call ExBlend filter destructor

ORG

SHOW=1
Exblend(mode=2,ExBfile=".\Exbfile",Decimate=False,Disp=1,Show=SHOW)  # Non decimated, Blend pair replaced with 2 x copies of ex-blended frame. Little colored block flags ex-Blended frame pair.
#Exblend(mode=2,ExBfile=".\Exbfile")                                 # Deblended & Decimated

# Both below lines for Non Decimated ONLY.
StackHorizontal(ORG,Last)
#Subtract(ORG,Last)

Return last

[Julek]

Originally Posted by Selur

Ps.: Also uploaded the source to my GoogleDrive

In this case there is no new information in the combed frame, it's just the prev blended with the next, the correct way here is to just drop it like this:

import vapoursynth as vs
core = vs.core

src = core.lsmas.LWLibavSource(r"C:\Users\conta\Videos\src\dog.mkv")
decimate = src.std.SelectEvery(cycle=5, offsets=[0, 1, 2, 4])
decimate.set_output()

But since the pattern is not fixed, you would have to adjust the offsets for each scene.

[Julek]

Originally Posted by Julek

In this case there is no new information in the combed frame, it's just the prev blended with the next, the correct way here is to just drop it like this:

import vapoursynth as vs
core = vs.core

src = core.lsmas.LWLibavSource(r"C:\Users\conta\Videos\src\dog.mkv")
decimate = src.std.SelectEvery(cycle=5, offsets=[0, 1, 2, 4])
decimate.set_output()

But since the pattern is not fixed, you would have to adjust the offsets for each scene.

I just noticed that the background is true 30 fps, so decimate would not be ideal.
I will try to make a script to replace the damaged part using a mask.

[Selur]

But since the pattern is not fixed, you would have to adjust the offsets for each scene.

I know I could go scene by scene and manually drop fields, but that really is a pain to do for a whole file and not just a snipped.
I'm looking for some way to automate this.

[Selur]

@StainLess: Finally found the time to test it, and with this 2pass works fine: Thanks for the help!