Avisynth AiUpscale v1.2.0

[DTL]

Strange to see Lanczos resize as reference for video data. I think the SincResize (with max possible 'taps' parameter) is closer to reference upsize resampler for band-limited and 'conditioned' against ringing good quality video data. Lanczos is more universal, but it significally limited for reference restoring of highset frequencies in video data. Unfortunately current version avisynth looks like has (small) bug in SincResize resampler implementation and it can make compare metrics with ideal input reference image data worse.

[Alexkral]

AviSynth AiUpscale v1.0.1

Changes:

- Added shaders source code.
- Some minor fixes.

[wolfman2791]

This is very good. Thank you!

[gmail123]

how to import to vs?

[Alexkral]

Originally Posted by wolfman2791

This is very good. Thank you!

You're welcome.

Originally Posted by gmail123

how to import to vs?

I'm pretty new to VapourSynth so I can't help you with that, sorry.

[poisondeathray]

Originally Posted by gmail123

how to import to vs?

you can run glsl shaders directly in vs with vs-placebo

https://github.com/Lypheo/vs-placebo


If you're on Windows with avisynth installed, you can also import an avs script into vapoursynth with AVISource

[gmail123]

Originally Posted by poisondeathray

you can run glsl shaders directly in vs with vs-placebo

https://github.com/Lypheo/vs-placebo


If you're on Windows with avisynth installed, you can also import an avs script into vapoursynth with AVISource

my english is poor...
sample:1080p ---->2160P,
can you give me a vs script ?
thx！

[poisondeathray]

Originally Posted by gmail123

my english is poor...
sample:1080p ---->2160P,
can you give me a vs script ?
thx！

My English is poor too (and it's my first language )


You should probably post in the vapoursynth subforum

One difference is Alexral did some separate training (slightly different) . I'm not sure how to use those into vapoursynth directly; only .glsl shaders can be used with placebo.Shader . (You can use the AVISource workaround, but you need windows, avisynth installed)

There is documentation on the page


eg.

import vapoursynth as vs
core = vs.get_core()
clip = core.lsmas.LWLibavSource(r'PATH\input.mkv')
clip = core.resize.Bicubic(clip, format=vs.YUV444P16)
clip = core.placebo.Shader(clip, width=clip.width*2, height=clip.height*2, shader=r'PATH\FSRCNN-Medium\FSRCNN_x2_r2_16-0-2.glsl')
clip.set_output()

[Alexkral]

Yes, there are no glsl mpv hooks of the VDSR and HQ models because they were fully or partially trained with Matlab, and their weights were converted directly to hlsl. They would have been too slow for mpv anyway.

[biship]

This can be used in MadVR?

[Alexkral]

Originally Posted by biship

This can be used in MadVR?

No, they are different programs.

[gmail123]

compare to with Waifu2x- cunet (For 2D artwork. Slow, but better quality.)?

[Alexkral]

Originally Posted by gmail123

compare to with Waifu2x- cunet (For 2D artwork. Slow, but better quality.)?

That's subjective. For RGB it seems that the VDSR and HQ models are a little slower. Looking at the results, I think you'll find that the AiUpscale models are a bit sharper.

[gmail123]

Originally Posted by Alexkral

That's subjective. For RGB it seems that the VDSR and HQ models are a little slower. Looking at the results, I think you'll find that the AiUpscale models are a bit sharper.

I had tested it,VDSR/HQ models are very good.

1、Plan to support 32bit float?
2、for video, "Photo" or "Illustration"，Which is better?

[Alexkral]

32 bit float is not supported because the processing in Avisynth Shader is done at 16 bit depth, I don't think that will change.

For video that comes from a camera you should use the "Photo" models, the "Illustration" models are for artwork, drawings, etc.

[gmail123]

Originally Posted by Alexkral

32 bit float is not supported because the processing in Avisynth Shader is done at 16 bit depth, I don't think that will change.

For video that comes from a camera you should use the "Photo" models, the "Illustration" models are for artwork, drawings, etc.

good,thx!

[markiemarcus]

This is really fantastic work. Thank you so much for all of the effort! These NN upscalers can be a little unpredictable and being able to modify the script and check the results in realtime is just invaluable. Really, really, terrific work. It's incredibly fast, too. Absolutely flies on my RX 480.

[markiemarcus]

Quick question. How is this handling 601 to 709 conversion, if at all? The SD sources I'm working from are all 601 so there's a huge shift post upscale. Is there an optimal way of handling this?

[Alexkral]

Originally Posted by markiemarcus

Quick question. How is this handling 601 to 709 conversion, if at all? The SD sources I'm working from are all 601 so there's a huge shift post upscale. Is there an optimal way of handling this?

Hi, thanks for the feedback. There is no conversion between RGB and YUV so there should be no change in this. If you're using VirtualDub2 you have to select that in Video > Decode format.

[markiemarcus]

Originally Posted by Alexkral

Hi, thanks for the feedback. There is no conversion between RGB and YUV so there should be no change in this. If you're using VirtualDub2 you have to select that in Video > Decode format.

Spot on, thanks for getting back to me. Again, this is just fab work and much appreciated.