Dogway's Filters Packs

[salvo00786]

Originally Posted by FTLOY

Well, that's not good

Have you asked on the StaxRip thread ?? (I haven't seen your name there).

Emulgator left an interesting post...

As the suggestions given here, haven't worked either

Hi... Finally I have the SMDegrain Working. I have tried so many times on staxrip 2.19 with all my settings and nothing. After that I copied a clean copy of Staxrip 2.19 in a new directory and I updated EXtools and Avisynth. In the new clean copy of Staxrip the SMDegrain work. Probably there are some personal settings in my Staxrip that create a problem with SMDegrain. Anyway now it work. Now I want to know please if someone know a method to use KTGMC with Staxrip, because I have an RTX3070 but QTGMC is so slow. I have seen that exist KTGMC but how to make it work on Staxrip?

[kedautinh12]

KTGMC need avisynthCuda to work but it's old and dom't update very long

Originally Posted by salvo00786

Hi... Finally I have the SMDegrain Working. I have tried so many times on staxrip 2.19 with all my settings and nothing. After that I copied a clean copy of Staxrip 2.19 in a new directory and I updated EXtools and Avisynth. In the new clean copy of Staxrip the SMDegrain work. Probably there are some personal settings in my Staxrip that create a problem with SMDegrain. Anyway now it work. Now I want to know please if someone know a method to use KTGMC with Staxrip, because I have an RTX3070 but QTGMC is so slow. I have seen that exist KTGMC but how to make it work on Staxrip?

Well done.

There must be somehow that you can get QTGMC to run faster..

Never heard of KTGMC, but here's some info:-

https://github.com/nekopanda/AviSynt...ers/wiki/KTGMC

https://github.com/nekopanda/AviSynt...lters/releases

https://forum.videohelp.com/threads/...MC-information

I think you should start asking questions on the StaxRip thread

[DTL]

Originally Posted by salvo00786

I have an RTX3070 but QTGMC is so slow. I have seen that exist KTGMC but how to make it work on Staxrip?

Some time ago I tried to make QTGMC work with DX12-ME builds of post-2.7.45 mvtools - https://github.com/DTL2020/QTGMC . But if you need main (?) part of QTGMC using MCompensate - it still do not have interpolated ovelap (from MDegrainN). So may be not good in quality while running with no-overlap MAnalyse with hardware accelerator (also Win10 or better required).

I think your QTGMC is slow because you use large pel and large overlap settings ? Also may be frame size if 1080 interlaced ? I typically do not read complains for too slow QTGMC because it is simple enough and run good at 202x years CPUs. So the project of making QTGMC working with DX12-ME-capable mvtools builds (and interpolated overlap to MCompensate) was almost stopped because close to no one uses QTGMC (for HD and slow settings). And for old SD it may run already good even with high settings.

[fabioseixal]

Hello,

I'm probably doing something wrong, but I don't understand why I get "green frames" when using Spresso "Dogway mod in 2022.03.05 Cosmetics".
If I upscale to HD, the issue is solved. So for now I returned back to the old and trusty Didée original function which works well.

Here are some screenshots: https://slow.pics/c/NLBKXy5L
Video Info

Width : 768 pixels
Height : 576 pixels
Display aspect ratio : 4:3
Frame rate mode : Constant
Frame rate : 23.976 (24000/1001) FPS
Color space : YUV
Chroma subsampling : 4:2:0
Bit depth : 10 bits

Thank You

[salvo00786]

Hi DTL. Thanks for the reply. I was using a long script and one parameter, was very slow. I was using chromanoise and chromamotion, but chromamotion slowed down my qtgmc from 40fps to 2/3fps.

When I use QTGMC Slower the speed is about 40fps. I tried this script for a problematic video

chroma = checkmate(thr=12,max=25,tthr2=25)
luma   = checkmate(thr=12,max=25,tthr2=0)
fixed  = MergeChroma(chroma, luma)
SetFilterMTMode("DEFAULT_MT_MODE", 2)
QTGMC(preset="Slower", InputType=0, sourceMatch=3, Lossless=2, sharpness=0.2, NoisePreset="Slower", Denoiser="dfttest", ChromaMotion=true, ChromaNoise=true, EZDenoise=2.0, DenoiseMC=true, NoiseDeint="Generate", StabilizeNoise=true, ediThreads=8)
Prefetch(8)

With this script the speed dropped from 40 to 2/3 fps. After some experiments, I found that Chromamotion dropped drastically my speed. Without chromamotion the speed go from 2/3 fps to 28/30 fps with all the other parameters, but after some other experiments, this scripts doesn't resolved my problems with the video.

The script that I found that solved my problems is this

chroma = checkmate(thr=12,max=25,tthr2=25)
luma   = checkmate(thr=12,max=25,tthr2=0)
fixed  = MergeChroma(chroma, luma)
SetFilterMTMode("DEFAULT_MT_MODE", 2)
QTGMC(preset="Slower", sharpness=0.2, ediThreads=8).QTGMC(Preset="Slower", InputType=1, sharpness=0.2, ediThreads=8)
Prefetch(8)

Running two pass of QTGMC, solved my problems. The speed of my last double pass script is about 26.60 fps that is acceptable.

[anton_foy]

@Dogway
If I denoise pretty heavily with smdegrain/mvtools but need to make it affect brighter areas less, could this be done in a clever way in the prefilter?
Ex_merging with masks and two calls of smdegrain is pretty slow so I would think there is a faster solution.

Edit: prefiltering is mostly for the motion vectors and not for denoise strength I know but details can be affected if the prefilter is too soft. Maybe doing it in prefiltering stage is not the way. Any ideas are very welcomed.

[Dogway]

fabioseixal: Thanks for the report! Fixed
anton_foy: Maybe increase SAD for brighter areas with AddGrainC. A mix of LumaMask, AddGrainC and ex_merge. But maybe better to do afterwards and merge back source clip via LumaMask and ex_merge.

[anton_foy]

Originally Posted by Dogway

anton_foy: Maybe increase SAD for brighter areas with AddGrainC. A mix of LumaMask, AddGrainC and ex_merge. But maybe better to do afterwards and merge back source clip via LumaMask and ex_merge.

Great thanks! But how do you mean afterwards? Not in the prefilter?

[Dogway]

Originally Posted by anton_foy

Great thanks! But how do you mean afterwards? Not in the prefilter?

Yes:

src=last
SMDegrain()
ex_merge(src, LumaMask(lo=150, hi=235),luma=true)

[anton_foy]

Originally Posted by Dogway

Yes:

src=last
SMDegrain()
ex_merge(src, LumaMask(lo=150, hi=235),luma=true)

It is faster than doing the addgrainC-merging on the prefilter?

Did you read DTL's suggestion in the MVTools thread?
Maybe something to implement into smdegrain if it is faster and or better quality?

[Dogway]

I read DTL's now, basically my suggestion above(?).
This is basic AviSynth usage, masking, filtering and whatnot.

Post merging is recommended, I don't think it can be merged into an existing expression within SMDegrain, so this should be as fast as it gets. Unless you want to break down the ex_merge call into pieces and turn it into an ex_lutxy() call, but that's advanced.

[anton_foy]

Originally Posted by Dogway

I read DTL's now, basically my suggestion above(?).
This is basic AviSynth usage, masking, filtering and whatnot.

Post merging is recommended, I don't think it can be merged into an existing expression within SMDegrain, so this should be as fast as it gets. Unless you want to break down the ex_merge call into pieces and turn it into an ex_lutxy() call, but that's advanced.

Yeah okay thanks, I just want to find a way with the least processing time to "pull back" degraining in the brighter areas because this is IMHO possibly the simplest road to a "dynamic degrain" without going through slooow runtime filtering.

Another way is to use averageluma and conditionals but I must do benchmarks and it would not be as seamless as the suggested above. (I am aware it is runtime though)

Edit:

so this should be as fast as it gets

You mean below?:

src=last
SMDegrain()
ex_merge(src, LumaMask(lo=150, hi=235),luma=true)

[tormento]

I have tried to reverse the upscaling of an anime, using the values that getnative (python utility) gave me about the source, usually in bicubic parameters.

My intention is to later apply some needi3resize, to have a better 1080p result.

I did tests with DeBicubicResizeMT, Descale and fmtc_resample. I can't get rid of the ghosting close to the edges of the screen that, AFAIK, are a consequence of the bicubic upscaling and minor ones around dark lines.

So, aren't they caused by the upscaling?

Dogway, do you have any hint for me? Is there any function in your plethora of scripts that can help me?

P.S: Something that would *really* work without having to use python and VS to get native resolution would be great too.

[Dogway]

Originally Posted by tormento

I have tried to reverse the upscaling of an anime, using the values that getnative (python utility) gave me about the source, usually in bicubic parameters.

My intention is to later apply some needi3resize, to have a better 1080p result.

I did tests with DeBicubicResizeMT, Descale and fmtc_resample. I can't get rid of the ghosting close to the edges of the screen that, AFAIK, are a consequence of the bicubic upscaling and minor ones around dark lines.

I would use getNative only to get the source original resolution but then upscale with something else. needi3resize is a nice fast upscaler but if you have the power to spare I would use an onnx model, in one of my tests for a 90s film I use 2X_DigitalFilmV5_Lite with great results. For the borders I usually crop them or use FillBorders plugin.

nnedi3resize can be a bit soft for textures so if you have some in your source you might want to use a better upscaler for 'flat', not to the extent oh high taps sincs but maybe spline16.

[tormento]

Originally Posted by Dogway

if you have the power to spare I would use an onnx model

Unfortunately not and that's why I am downsizing to "native".

As I wrote, I have issues with the artifacts that the original upscale caused and I don't know why they don't disappear when downscaling.

Can I bother you, sending some piece of anime where you can see them?

[Dogway]

Originally Posted by tormento

As I wrote, I have issues with the artifacts that the original upscale caused and I don't know why they don't disappear when downscaling.

Can I bother you, sending some piece of anime where you can see them?

It's ok. If you can please give me the original resolution that getNative provides. You want to rescale back right?

[tormento]

Originally Posted by Dogway

It's ok. If you can please give me the original resolution that getNative provides. You want to rescale back right?

Here is the archive.

It contains a short cut of AnoHana 1st episode and the getnative analysis on a couple of significative frames. There is a doubt about 720p and 960p. I have chosen the 720p as it is the most probable, with b=1, c=0, as they are the values that gives the higher error detection.

Look at the upper border of the sky frame. It has some multiple ghostings and, in a minor way, around the game controller too.

My very simple script is:

PHP Code:

SetMemoryMax()
SetFilterMTMode("DEFAULT_MT_MODE", 2)
LoadPlugin("D:\Eseguibili\Media\DGDecNV\DGDecodeNV.dll")
DGSource("N:\In\AnoHana\01.dgi")
ConvertBits(16)
fmtc_resample (1280, 720, kernel="bicubic", a1=1, a2=0, invks=True)
fmtc_bitdepth (bits=10,dmode=8) 


[Dogway]

I see, so you only want to downscale.
You have to crop to remove the original ringing in the upper and lower frame borders, as well sides for the black.

crop(2,2,-2,-2)

Or you can use FillBorders plugin instead to fill those areas.

You can also play with crop+dilation:

crop(2,2,-2,-2)
PadBorders(16,16,16,16,mode="Dilate")
fmtc_resample (1280+20, 720+20, kernel="bicubic", a1=1, a2=0, invks=True)
PadResize(1280,720)

[tormento]

Originally Posted by Dogway

You have to crop to remove the original ringing in the upper and lower frame borders, as well sides for the black.

Isn't inverse kernel supposed to get rid of the upscaling artifacts? AFAIK those ones come from bicubic.

Originally Posted by Dogway

You can also play with crop+dilation

Please, explain me the script with crop+dilation.

Anyway, at the end, I would get rid of borders artifacts only but not the ones around the lines.

Am I wrong or once you find native resolution + bicubic parameters, everything should be fixed in the downsized video?