deama
30th October 2020, 15:30
So I ran a few different interpolation algorithms and wanted to share my results, make sure you download these as streaming will limit the quality and framerate:
https://drive.google.com/drive/folders/1YAhyhlpUnrtAIuALTCW0BdpkmWz5Urk5?usp=sharing)
I've got a 2060 super 8GB for reference.
There's about 3 of them, the first one is the legends of runeterra breath trailer I downloaded from youtube and interpolated. I used dain-app for that one, sadly I had to downscale it to 720p because the algorithm is just so VRAM hungry, I think you'd need 10-12GB of vram for 1080p lol. Anyway, the results are decent, it's slightly jaggy because I set the scene cut threshhold a bit too high, so it ended up not interpolating frames that it thought were "scene cuts" but otherwise pretty good. This one took me a long while, I think about 8 hours or so, though I did increase it to 120fps, still, quite impressed actually, especially since the original was quite jaggy.
The second one is the one punch man fight scene with janos. This time I used a different algorithm, it wasn't nearly as VRAM hungry (I can do 1440p with it), but it's slightly worse in terms of quality, it can work quite well though still, especially if you give it enough information. The scene cuts threshhold here I could optimise better as this algorithm didn't take as long (about 2 hours), however I could only do a 2x interpolate with it. Anyway, the results are quite good I think, barely any artifacts, I think you'd need to be paying a lot of attention to spot any, and it looks quite smooth, can't notice any of the jaggies from scene cuts either.
The last one is the soul eater intro, this is actually one of the hardest ones for interpolation algorithms to do because it's so complicated and very "perspective", so far only one algorithm managed to do it well, the dain-app one. I originally tried to use the same algorithm as I used for the one-punch man one, but it didn't work well, the artifacting was obvious, not as bad as traditional algorithms like SVP, but not good either. As you can see though, the dain-app one does a really good job, I was quite impressed.
In conclusion, the dain-app has the highest quality, but takes forever to interpolate and you'd need at least 10-12GB of Vram to be able to do 1080p content, however sometimes the results can be a lot better compared to other algorithms.
Oh and also, none of these sadly use the tensor cores, not sure why, I think it's too new. The developer of the dain-app is working on implementing the usage of them, not sure how much of a speed up you'll get with them though.
Anyway, here's a link to my patreon in-case anyone is interested:
https://www.patreon.com/enhanceThis
https://drive.google.com/drive/folders/1YAhyhlpUnrtAIuALTCW0BdpkmWz5Urk5?usp=sharing)
I've got a 2060 super 8GB for reference.
There's about 3 of them, the first one is the legends of runeterra breath trailer I downloaded from youtube and interpolated. I used dain-app for that one, sadly I had to downscale it to 720p because the algorithm is just so VRAM hungry, I think you'd need 10-12GB of vram for 1080p lol. Anyway, the results are decent, it's slightly jaggy because I set the scene cut threshhold a bit too high, so it ended up not interpolating frames that it thought were "scene cuts" but otherwise pretty good. This one took me a long while, I think about 8 hours or so, though I did increase it to 120fps, still, quite impressed actually, especially since the original was quite jaggy.
The second one is the one punch man fight scene with janos. This time I used a different algorithm, it wasn't nearly as VRAM hungry (I can do 1440p with it), but it's slightly worse in terms of quality, it can work quite well though still, especially if you give it enough information. The scene cuts threshhold here I could optimise better as this algorithm didn't take as long (about 2 hours), however I could only do a 2x interpolate with it. Anyway, the results are quite good I think, barely any artifacts, I think you'd need to be paying a lot of attention to spot any, and it looks quite smooth, can't notice any of the jaggies from scene cuts either.
The last one is the soul eater intro, this is actually one of the hardest ones for interpolation algorithms to do because it's so complicated and very "perspective", so far only one algorithm managed to do it well, the dain-app one. I originally tried to use the same algorithm as I used for the one-punch man one, but it didn't work well, the artifacting was obvious, not as bad as traditional algorithms like SVP, but not good either. As you can see though, the dain-app one does a really good job, I was quite impressed.
In conclusion, the dain-app has the highest quality, but takes forever to interpolate and you'd need at least 10-12GB of Vram to be able to do 1080p content, however sometimes the results can be a lot better compared to other algorithms.
Oh and also, none of these sadly use the tensor cores, not sure why, I think it's too new. The developer of the dain-app is working on implementing the usage of them, not sure how much of a speed up you'll get with them though.
Anyway, here's a link to my patreon in-case anyone is interested:
https://www.patreon.com/enhanceThis