Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion.

Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules.

 

Go Back   Doom9's Forum > Hardware & Software > Software players

Reply
 
Thread Tools Search this Thread Display Modes
Old 24th July 2023, 08:21   #1  |  Link
PatchWorKs
Registered User
 
PatchWorKs's Avatar
 
Join Date: Aug 2002
Location: Italy
Posts: 305
Mathematically Evaluating mpv's Upscaling Algorithms

Just discovered this - updated - study of performance and quality by João Vitor Chrisóstomo:
https://artoriuz.github.io/blog/mpv_upscaling.html

Quote:
__________________
Hybrid Multimedia Production Suite will be a platform-indipendent open source suite for advanced audio/video contents production.

Official git: https://www.forart.it/HyMPS/
PatchWorKs is offline   Reply With Quote
Old 24th July 2023, 11:42   #2  |  Link
butterw2
Registered User
 
Join Date: Jun 2020
Posts: 303
You probably should mention that the test results you posted are for an Anime test image.

While the linked study is Anime focused it also tests a live action photo, with different results. It's worth a look for those who haven't done so already.
butterw2 is offline   Reply With Quote
Old 26th July 2023, 06:07   #3  |  Link
FranceBB
Broadcast Encoder
 
FranceBB's Avatar
 
Join Date: Nov 2013
Location: Royal Borough of Kensington & Chelsea, UK
Posts: 2,957
I'm really surprised to see Lanczos above Spline64 in both tests...
FranceBB is offline   Reply With Quote
Old 8th February 2024, 21:51   #4  |  Link
huhn
Registered User
 
Join Date: Oct 2012
Posts: 8,001
having better psnr doesn't mean the scaler is better.
both are very similar anyway.
lanczos is sharper but rings more.
huhn is offline   Reply With Quote
Old 16th February 2024, 22:00   #5  |  Link
Alexkral
Registered User
 
Join Date: Oct 2018
Posts: 328
The ArtCNN models have been trained with the Manga109 dataset, this is a huge advantage when testing with anime content, in short, it is what makes the biggest difference, so their good results are not surprising at all. Also, not everyone knows that FSRCNNX has been trained with increased distortion, which makes it able to reduce compression artifacts, but also makes it a bit less sharp with clean content.

I'm not really into this anymore to make a more scientific comparison, I'll leave it to whoever may be interested, but looking at the network architecture, my bet is that the results of these models should be very similar to the AiUpscale LineArt models, which can be used also in mpv.

These models work really well for 2x (or maybe even 3x) upscaling, the real challenge is for 4x upscaling, where GAN models have shown great superiority, but are too resource intensive to be used in real time.
__________________
AviSynth AiUpscale

Last edited by Alexkral; 16th February 2024 at 22:03.
Alexkral is offline   Reply With Quote
Old 17th February 2024, 06:06   #6  |  Link
huhn
Registered User
 
Join Date: Oct 2012
Posts: 8,001
ArtCNN is trained like this:
The shaders are trained on the Manga109 dataset using the Adam optimiser with a learning rate of 1e-4 and the L1/MAE loss function. The high-resolution images are downsampled with a box filter, and they're also split into small 64x64 patches for performance and memory reasons.

and what is used in that test:
magick convert aoko.png -colorspace rgb -filter box -resize 50% -colorspace srgb downsampled.png
shocker. it has to be trained on something so fine.

i'm not going into the sRGB part...

let's take and anime image and look at it.
gpu-next has been avoided because of a current bug that's been around for awhile.

FSRCNNX_x2_16 ArtCNN_C4F32 and NGU sharp very high
i'm not going to tell which is which because they all perform terrible to whatever on this image:
https://slow.pics/c/8jsbuzNR
please guess what is what.
edit: more scaler this time with names
https://slow.pics/c/UoS7hM07

this is one image so no need to jump to a general conclusion here.
ArtCNN is quite impressive compared to NGU sharp and fsrcnnx because they both need to cease and desist here.
the problem on this image is ArtCNN looks the same as super xbr or well it looks the same but rings...
super xbr biggest problem is it is quite unremarkable and well rings.
what so ever ArtCNN not going completely crazy yet is very good achievement

anime 4k was added for comedic effect.

Last edited by huhn; 17th February 2024 at 10:34.
huhn is offline   Reply With Quote
Reply

Tags
mpv, player, software, study, upscale

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 01:28.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2024, vBulletin Solutions Inc.