Topaz Video Enhance AI

[kedautinh12]

Error 403, don't have permission

[lollo2]

Here are some comparison between: Raw (Original + Spline36), MDegrain (Spline36 + Adaptive Sharpen), Topaz AI (Artemis High Quality v12)
MDegrain uses Delta=4, thSAD=150, blksize=16 & overlap=8.

Here an additional comparison between a full AviSynth flow (raw capture + color correction + TemporalDegrain2 + nnedi3 + LSFmod ) and a Topaz flow (raw capture + color correction + Arthemis High Quality).

A quick video comparison (I was unable to upload the video, so used youtube, with all its limitations):

https://www.youtube.com/watch?v=vmHJyF_XxT0 (here is easy to find the winner)

Some image comparison, use zoom and fullscreen options to compare the details:

https://imgsli.com/NjcyMTE (here is easy to find the winner)

https://imgsli.com/NjcyMTI (here AviSynth is better except in the red border of the panel, but looking to any other area, i.e. the hand and the harm of the girl, the difference is evident)

[kedautinh12]

In 2 example, i choice avisynth cause your topaz result too blur and banding color and avisynth better for removed artifacts in example 1. Maybe your hobbies in detail video and mine don't same

[takla]

Originally Posted by kedautinh12

Error 403, don't have permission

Fixed. For anyone comparing those images: Please download the whole folder and view with external viewer, google drive is pretty bad for this.

[takla]

Originally Posted by lollo2

Here an additional comparison between a full AviSynth flow (raw capture + color correction + TemporalDegrain2 + nnedi3 + LSFmod ) and a Topaz flow (raw capture + color correction + Arthemis High Quality).

A quick video comparison (I was unable to upload the video, so used youtube, with all its limitations):

https://www.youtube.com/watch?v=vmHJyF_XxT0 (here is easy to find the winner)

Some image comparison, use zoom and fullscreen options to compare the details:

https://imgsli.com/NjcyMTE (here is easy to find the winner)

https://imgsli.com/NjcyMTI (here AviSynth is better except in the red border of the panel, but looking to any other area, i.e. the hand and the harm of the girl, the difference is evident)

Yeah. Not much difference there, so I'd pick what ever is faster (which is most likely avisynth)

[lollo2]

Yeah. Not much difference there, so I'd pick what ever is faster (which is most likely avisynth)

Yes, I think that all our considerations really depends on the videos we have. That's why everybody should experiment on his own and do not follow any general guideline ;-)

[lollo2]

In 2 example, i choice avisynth cause your topaz result too blur and banding color and avisynth better for removed artifacts in example 1. Maybe your hobbies in detail video and mine don't same

As I said, I always prefer AviSynth, but I am working on s-vhs capture, so my results are very limited. If you use pristine blue-ray video, or something like that, you may find completely different results. Experiment yourself to find the best procedure ;-)

[MysteryX]

I looked at some of the sample images on their website, denoise, sharpen, upscale.

It tends to gives a plastic effect, and I genuinely hate over-processed pictures with that plastic effect.

[ognirats]

It won't even give out good results with anime since it has been trained on real life video

[ognirats]

If there is anything that I hate about this piece of software than that are its users. Bunch of gullible morons that think their compressed af standard definition source would sunddenly be 4K.

[takla]

Originally Posted by ognirats

If there is anything that I hate about this piece of software than that are its users. Bunch of gullible morons that think their compressed af standard definition source would sunddenly be 4K.

Yep

[PatchWorKs]

Originally Posted by lollo2

Some image comparison, use zoom and fullscreen options to compare the details:

https://imgsli.com/NjcyMTE (here is easy to find the winner)

https://imgsli.com/NjcyMTI (here AviSynth is better except in the red border of the panel, but looking to any other area, i.e. the hand and the harm of the girl, the difference is evident)

Can you please test same frames in SwinIR an post results ?

[lollo2]

Should I use this porting: https://github.com/HolyWu/vs-swinir ?

I do not have VapourSynth installed, so please allow some time for me to get familiar with it.

[PatchWorKs]

Originally Posted by lollo2

Should I use this porting: https://github.com/HolyWu/vs-swinir ?

I do not have VapourSynth installed, so please allow some time for me to get familiar with it.

You can, of course.

@Selur has already tested it, we're discussing it here:

Originally Posted by Selur

here are a few examples:

used:

# Imports
import vapoursynth as vs
# getting Vapoursynth core
core = vs.core
# Loading Plugins
core.std.LoadPlugin(path="I:/Hybrid/64bit/vsfilters/Support/fmtconv.dll")
core.std.LoadPlugin(path="I:/Hybrid/64bit/vsfilters/DeinterlaceFilter/TIVTC/libtivtc.dll")
core.std.LoadPlugin(path="I:/Hybrid/64bit/vsfilters/SourceFilter/d2vSource/d2vsource.dll")
# source: 'E:\clips\VTS_02_1-Sample-Beginning.demuxed.m2v'
# current color space: YUV420P8, bit depth: 8, resolution: 720x480, fps: 29.97, color matrix: 470bg, yuv luminance scale: limited, scanorder: telecine
# Loading E:\clips\VTS_02_1-Sample-Beginning.demuxed.m2v using D2VSource
clip = core.d2v.Source(input="E:/Temp/m2v_5d36292e1f7f53fd6e26be51d50bbf8c_853323747.d2v")
# making sure input color matrix is set as 470bg
clip = core.resize.Bicubic(clip, matrix_in_s="470bg",range_s="limited")
# making sure frame rate is set to 29.97
clip = core.std.AssumeFPS(clip=clip, fpsnum=30000, fpsden=1001)
# Setting color range to TV (limited) range.
clip = core.std.SetFrameProp(clip=clip, prop="_ColorRange", intval=1)
# Deinterlacing using TIVTC
clip = core.tivtc.TFM(clip=clip)
clip = core.tivtc.TDecimate(clip=clip)# new fps: 23.976
# make sure content is preceived as frame based
clip = core.std.SetFieldBased(clip, 0)
# DEBUG: vsTIVTC changed scanorder to: progressive
# cropping the video to 704x480
clip = core.std.CropRel(clip=clip, left=8, right=8, top=0, bottom=0)
from vsswinir import SwinIR
# adjusting color space from YUV420P8 to RGBS for VsSwinIR
clip = core.resize.Bicubic(clip=clip, format=vs.RGBS, matrix_in_s="470bg", range_s="limited")
# resizing using SwinIR
clip = SwinIR(clip=clip, task="real_sr_large", scale=4, tile_x=352, tile_y=240, tile_pad=16, device_type="cuda", device_index=0) # 2816x1920
# adjusting resizing
clip = core.fmtc.resample(clip=clip, w=1920, h=1474, kernel="lanczos", interlaced=False, interlacedd=False)
# adjusting output color from: RGB48 to YUV420P8 for x264Model
clip = core.resize.Bicubic(clip=clip, format=vs.YUV420P8, matrix_s="470bg", range_s="limited")
# set output frame rate to 23.976fps
clip = core.std.AssumeFPS(clip=clip, fpsnum=24000, fpsden=1001)
# Output
clip.set_output()

some more using RealSR_large:




Cu Selur

[kolak]

What is the difference in case of girl with the phone?
Different parameters?
Some look good, others not.
Overall bit too artificial look, enough to add some nice (real grain) and it's not bad.
What is the speed for eg. HD to UHD?

[PatchWorKs]

Originally Posted by kolak

What is the difference in case of girl with the phone?
Different parameters?
Some look good, others not.
Overall bit too artificial look, enough to add some nice (real grain) and it's not bad.

Different models.

Try yourself (don't abuse):

Originally Posted by kolak

What is the speed for eg. HD to UHD?

Slow.
Maybe an optimized version will come.

Note that is an image (not video) upscaler yet.

[kolak]

Tried myself but had issue with CUDA.
At the end got scrip loading but black video.

I know it's very slow, but how slow. 1fps or 0.1fps?

[lollo2]

I did not succeed either, both trying to install VapourSynth + Vs-SwinIR or using your link.

If you wish to experiment, here are the images

Original video + Colormatrix("Rec.601->Rec.709") frame 1: https://drive.google.com/file/d/1VCk...ew?usp=sharing
Original video + Colormatrix("Rec.601->Rec.709") frame 2: https://drive.google.com/file/d/1Yws...ew?usp=sharing

For comparison

AviSynth denoise and upscale frame 1: https://drive.google.com/file/d/10lj...ew?usp=sharing
AviSynth denoise and upscale frame 2: https://drive.google.com/file/d/1Kz5...ew?usp=sharing

Topaz VEAI "denoise" and upscale frame 1: https://drive.google.com/file/d/1xu0...ew?usp=sharing
Topaz VEAI "denoise" and upscale frame 2:https://drive.google.com/file/d/12ex...ew?usp=sharing

AviSynth denoise + Topaz VEAI "denoise" and upscale frame 1: https://drive.google.com/file/d/1d4A...ew?usp=sharing
AviSynth denoise + Topaz VEAI "denoise" and upscale frame 2: https://drive.google.com/file/d/1dle...ew?usp=sharing

[sixthofmay]

Has anyone gotten Vs-SwinIR working? I'd like to try it on a film that has only a VHS and low bitrate streaming release.

I followed some links and installed Miniconda but then lost the webpage link.

I'm experienced with Avisynth+, QTGMC and other deinterlacers, Virtualdub2, x264, TVEIA, Resolve Studio, etc. but know nothing about Vaporsynth. I had Covid19 and it's affected my ability to concentrate.

Dumb question but searching it was futile: Can Vaporsynth be installed at the same time as Avisynth+?

If anyone has Vs-SwinIR working, maybe you could write a step-by-step for Windows 10 that others could follow?

[Selur]

Can Vaporsynth be installed at the same time as Avisynth+?

Sure.

If anyone has Vs-SwinIR working, maybe you could write a step-by-step for Windows 10 that others could follow?

send me a pm and I can send you a link to:
a. my current Hybrid dev version (~720MB download, ~2.5GB install)
b. my current torchPy addon (~12GB download, ~17.5GB install)
last one is a portable Vapoursynth with torchPy and VSGAN, vsDPIR, vsRIFE,vsBasidVSR++, vsSwinIR and vsHINet in it.
First one is just my current dev version which can use the addon if it's extracted into the Hybrid/64bit-folder and thus replaces the Vapopursynth&Co that is shipped with Hybrid.

Cu Selur