Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion. Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules. |
30th May 2015, 00:36 | #1 | Link |
Registered User
Join Date: Mar 2012
Location: Texas
Posts: 1,665
|
waifu2x for AviSynth 2.6
Just found out someone ported waifu2x to AviSynth: https://github.com/sunnyone/Waifu2xAvisynth
Just spreading the news just in case someone is not already aware. |
30th May 2015, 00:55 | #2 | Link |
47.952fps@71.928Hz
Join Date: Mar 2011
Posts: 940
|
Fascinating.
I saw the other thread and was hoping somoene might try to port it. Thanks for the info.
__________________
Win10 (x64) build 19041 NVIDIA GeForce GTX 1060 3GB (GP106) 3071MB/GDDR5 | (r435_95-4) NTSC | DVD: R1 | BD: A AMD Ryzen 5 2600 @3.4GHz (6c/12th, I'm on AVX2 now!)
|
30th May 2015, 00:58 | #3 | Link |
Angel of Night
Join Date: Nov 2004
Location: Tangled in the silks
Posts: 9,559
|
Laziness wins again! (I was going to attempt this.) There's a website, too: http://waifu2x-avisynth.sunnyone.org/
Translation of usage: waifu2x(clip, int nr=0, int scale=2, string models=".", int jobs=0) nr: 0, 1, or 2 for no/light/more noise reduction. scale: A power of 2. 1 disables scaling (noise reduction only) models: Location of models, defaults to plugin folder. jobs: Threads, 0=# of cores in system. Last edited by foxyshadis; 30th May 2015 at 01:03. |
30th May 2015, 01:19 | #4 | Link |
Registered User
Join Date: Mar 2012
Location: Texas
Posts: 1,665
|
It seems not all of the parameters are in order, here's the correct order: waifu2x(clip, nr, scale, jobs, models)
Also only YV12, YV16, and YV24 are supported. I wonder why not Y8? Y8 is useful for processing RGB as individual planes. Sure one can use YV12 but it can be less efficient. I might ask the author if he can add support for it. One question for those of you who can read code, I see that unlike the original that only scales up to 2x, this implementation can scale 4x, 6x, 8x...etc. How is that done? Is it done in one shot or is waifu2x called multiple times? |
30th May 2015, 01:31 | #5 | Link | |
Angel of Night
Join Date: Nov 2004
Location: Tangled in the silks
Posts: 9,559
|
Quote:
|
|
30th May 2015, 02:08 | #6 | Link | |
Registered User
Join Date: Mar 2012
Location: Texas
Posts: 1,665
|
Thanks for the info foxyshadis. I overlooked that scale has be a power of 2 not a multiple of 2.
I wonder how well it will perform with video? A good point was brought up in #avs-plus. Quote:
(not at home so I haven't had a chance to try it out) |
|
30th May 2015, 12:59 | #8 | Link |
Registered User
Join Date: Mar 2012
Location: Texas
Posts: 1,665
|
It really only turns things into oil paintings when noise reduction is set to 2 (maybe even 1 for some sources) but that's not what I was referring to. waifu2x works well on single images but when you process video it might create shimmering artifacts due to interpolation differences between frames. Shimmering cannot be seen on a single frame but if you flip back between two frames sometimes you can seen lines and other details slightly jumping up and down (bobbing). Anyways I don't know if this is the case with waifu2x, I wanted to try and see but it's painfully slow (even slower than the online version) so I gave up.
|
30th May 2015, 13:16 | #9 | Link |
Registered User
Join Date: Aug 2007
Posts: 374
|
My waifu can't have so strong halos! I think she needs some more training... Also she is quite hungry now – stand alone version ate my 12 GB of RAM like nothing and crashed on moderately sized image.
Noise reduction is nice though – does good job on re-compressed images, but can't cure quantized to zero chroma. |
30th May 2015, 18:01 | #10 | Link |
Angel of Night
Join Date: Nov 2004
Location: Tangled in the silks
Posts: 9,559
|
This thing is absurdly slow. 50 seconds per frame for 480x270->960x540 on a Haswell! I wanted to redo an entire scene at 4x, but I didn't want to die of old age first.
4 second sample, shows no shimmering that I could see, so at least it's fairly stable. |
31st May 2015, 18:28 | #12 | Link |
Registered User
Join Date: Feb 2004
Posts: 1,348
|
While doing some testing on waifu2x there was strong evidence that its neural network may be significantly overtrained for the purposes of digital video. There can be a change uf up to 1 db in psnr simply by switching between different downscaling algorithms, and it gets conflicting psnr results compared to all other upscalers I have compared with, it always prefers neutral bicubic downscaling.
In one test it prefered neutral bicubic to sharp bicubic by ~0.6 db, while all other scalers prefered sharp cubic downscaling to neutral. This would strongly indicate that it was trained almost exclusively on content scaled using a catmull-rom kernel. Unsurprisingly, it does produce very nice results when fed with input it has been trained for. I will probably do some more rigorous testing on more varied content, but its speed makes testing it aggravating. |
1st June 2015, 10:11 | #13 | Link |
Registered User
Join Date: Mar 2014
Posts: 308
|
Sometimes people forget that we already have a super-resolution filter for Avisynth and it's called QTGMC. Motion-compensated deinterlacing is really just a special case of super-resolution, after all.
__________________
Say no to AviSynth 2.5.8 and DirectShowSource! Last edited by colours; 1st June 2015 at 10:14. |
6th June 2015, 00:04 | #17 | Link |
Registered User
Join Date: Jan 2007
Posts: 729
|
Take care what you link, even if it gets blocked by adblock (protip - not everybody has it active). There is a fullscreen extremely not safe for work ad, consider actually putting a warning in the post, because that thing could really get somebody in trouble if they browsed that at work.
BTW, imagebam is a bad host for images for another reason: it doesn't have a reasonable "show just this image 1:1" mode, it forces you to download when you want to see the original. Try imgbox - it shouldn't have nasty ads if you specify you are uploading family-safe content. And there are probably other less annoying imagehosts. Last edited by mandarinka; 6th June 2015 at 00:08. |
Tags |
waifu2x |
Thread Tools | Search this Thread |
Display Modes | |
|
|