InterFrame 2.8.2 - Framedoubling/60FPS/HFR conversion script

[-Vit-]

Originally Posted by madshi

What kind of motion estimation technique are you currently using?

This script uses MVTools, which is a library of motion analysis tools for Avisynth. It splits the image into a grid of blocks and attempts to track the motion of every block (as opposed to tracking specific features).

If you check motion vectors to the next "future" frame, too, you could eventually fill the occluded space from the future frame.

The flow interpolation functions in MVTools use both forward and backward vectors, and consider the occlusion masks (both ways) to determine how best to fill all areas of the interpolated frame.

Originally Posted by madshi

Interesting approaches would also be to compare motion vectors between consecutive frames and only use those which are comparable.

I don't believe MVTools does this at any point, but it does seem a useful idea.

[madshi]

Originally Posted by -Vit-

This script uses MVTools, which is a library of motion analysis tools for Avisynth. It splits the image into a grid of blocks and attempts to track the motion of every block (as opposed to tracking specific features).

Hmmmm... Isn't this kind of technique mostly aimed at encoding? I think the better optical flow algorithms work quite different in concept, looking for gradients instead of matching blocks, tracking motion per pixel instead of blocks etc...

Originally Posted by -Vit-

The flow interpolation functions in MVTools use both forward and backward vectors, and consider the occlusion masks (both ways) to determine how best to fill all areas of the interpolated frame.

That is very good - better than I expected!

[SubJunk]

Hi madshi,
This script uses a modified MVTools2 for its motion estimation, so I suggest posting about these in the MVTools2 thread. Then Fizick (the developer) can give you his thoughts

Edit: Saw that Vit already posted, sorry for repeating information

[zamadatix]

InterFrame(Preset="Fast", FlowPath="C:\Program Files (x86)\MPCHC\AviSynth\plugins\")

Is giving me invalid arguements, why?

[SubJunk]

Hi zamadatix
What is the exact error you get?

[zamadatix]

It just says "Invalid arguments to function "InterFrame." in the video window when I drag a avs script with that line into mpchc.

[ryrynz]

Subjunk, do you know of any settings that could be used in to improve vertical panning in your script? I've tried the medium preset with film and animation tuning but both have caused tearing when I've played a vertical panning scene. I assume only the smooth setting seems to improve this but it's unusable in real time for the time being, any advice you could offer would be appreciated.

Anyway, thanks for your time creating this, I've tried quite a few MVtools scripts but was never satisfied with the results, this is working out quite well for my animated content and has become a part of my script.

[SubJunk]

Originally Posted by zamadatix

It just says "Invalid arguments to function "InterFrame." in the video window when I drag a avs script with that line into mpchc.

I just did that and it worked for me, so I don't know, maybe there is something else in the script that is causing it in some weird way.
P.S. That's awesome that MPC can do that, I never knew.

Originally Posted by ryrynz

Subjunk, do you know of any settings that could be used in to improve vertical panning in your script? I've tried the medium preset with film and animation tuning but both have caused tearing when I've played a vertical panning scene. I assume only the smooth setting seems to improve this but it's unusable in real time for the time being, any advice you could offer would be appreciated.

You can try editing line 119 of the file to change the value of sadml from 150 to 0. That will generally improve panning smoothness, but at the cost of overall frame-coherence. Or you could compromise and set the value to something higher like 300 or 500.

Originally Posted by zamadatix

Anyway, thanks for your time creating this, I've tried quite a few MVtools scripts but was never satisfied with the results, this is working out quite well for my animated content and has become a part of my script.

Thanks a lot, I'm glad you find it useful

[sumawo13]

I get these errors when using InterFrame 1.8.



This is the line I'm using for InterFrame.

interframe(flowpath="C:\Program Files (x86)\AviSynth 2.5\plugins\",preset="placebo",newnum=48000,newden=1001)

[SubJunk]

That can be a normal result depending on the source material. If the 2 frames on either side of that frame are very different, like in a high-action scene (which that looks like), those kind of frames are created.
You can try editing line 119 of InterFrame.avsi, changing algo=23 to algo=13 and sadml=150 to sadml=0. That will make individual details usually look better, but creates some edge artifacts. Let me know if that helps.

[SubJunk]

InterFrame 1.8.1 is released which fixes stuttering motion which was particularly visible in cartoons.

[dansrfe]

How CPU intensive is this script for realtime use? I have a C2D @ 2.66Ghz w/ 4GB RAM.

[CruNcher]

depends on the resolution heavily though it eats a lot of power when you do Full HD even SVPs original GPU supported (Realtime optimized) is a heavy thing for Full HD a 4 Core is advised even with GPU support (its only partial acceleration via OpenCL, but lowers the CPU load enough)
And then it depends on your Playback Chain (decoder,renderer ect)
see my results with SVPs original it's stunning (didn't tried it with interframe yet) and with the GPU i save a lot of Load that would slow it down heavily (VMR9 Renderless in this case though is to slow to cope). The SVP guys really thought about everything you even get statistics about it's Load Behavior
The absolute craziness it even has a side by side Realtime compare like you used to from Cyberlink,Corel,Arcsoft everything via avisynth ffdshow and they made the reload of a script a fully smooth experience (like it belongs to the player itself) you click onto their icon in the task tray select the option and it will change everything on the fly with only a small out time, just amazing work combining the best things into a very easy to use realtime experience




Renderer wise when using SVP or Interframe realtime i would advise MadVR without doubt on any Windows OS when you have a capable GPU

[Mr Alpha]

Anybody know how to get multi-threading for this to work inside ffdshow for realtime playback? I can do SD content on one core, but fullHD just isn't working.

[SubJunk]

Originally Posted by dansrfe

How CPU intensive is this script for realtime use? I have a C2D @ 2.66Ghz w/ 4GB RAM.

It all depends on which Preset value you use. The Preset value controls the "quality vs CPU load", so just try to use the highest quality preset that gives you a constant framerate.
See the documentation for more details
Low presets of this script should work on even slow CPUs.

Originally Posted by CruNcher

SVP etc

This is similar but different to SVP. These values are tweaked for better quality and smoother motion whereas SVP produces more ghosting by default. SVP can be tweaked to be similar to InterFrame in the options, but can't be the same (though maybe in a later version, I don't know)
You can also run InterFrame (or any AviSynth script) via SVP though which is convenient

Originally Posted by Mr Alpha

Anybody know how to get multi-threading for this to work inside ffdshow for realtime playback? I can do SD content on one core, but fullHD just isn't working.

Sorry, I'm not an expert on realtime since I convert. Hopefully someone else can help

[fairchild]

Originally Posted by Mr Alpha

Anybody know how to get multi-threading for this to work inside ffdshow for realtime playback? I can do SD content on one core, but fullHD just isn't working.

For me, I can't do real-time HD (720p and up). It turns into a slideshow and I verified it does use both of my cores so it is multi-threaded.

SD content works fine and looks fine and turns the frame rate to 59ish (converts 23.976, 25, and 30 fps content just fine to 59-60ish), but when I pop in a 720p or higher video it doesn't work. It appears to be my cpu which is stressed out to the max and can't do the real-time frame rate doubling at 720p and up.

SetMTmode(2,2)
ffdshow_source()
InterFrame(Preset="Fast", GPU=true, FlowPath="C:\Program Files (x86)\AviSynth 2.5\plugins\")
GetMTMode(false) > 0 ? distributor() : last

So the above works fine for SD, for real-time frame doubling to 59.94 fps.

Also this script works and is equivalent to the Faster preset in Interframe. This script also doesn't work right on my system in real-time with HD content, my CPU is not strong enough it seems.

svp_flow_lib="C:\Program Files (x86)\Avisynth 2.5\plugins\libflowgpu.dll"
svp_scheduler=true
SetMTMode(1,15)
V = ffdshow_source()
SetMTMode(2,15)
S = V.MSuper(pel=2, hpad=16, vpad=16, rfilter=4)
A = S.MAnalyse(isb=true, blksize=16, overlap=4, badSAD=2000, plevel=0, pelsearch=3, search=3, searchparam=3, badrange=(-24))
B = S.MAnalyse(isb=false, blksize=16, overlap=4, badSAD=2000, plevel=0, pelsearch=3, search=3, searchparam=3, badrange=(-24))
C = S.MRecalculate(A, blksize=8, overlap=2, search=3, searchparam=1)
D = S.MRecalculate(B, blksize=8, overlap=2, search=3, searchparam=1)
V.MSmoothFps(S, C, D, num=FramerateNumerator(V)*5, den=FramerateDenominator(V)*2, algo=23, sadgamma=2, sadml=0, ml=0, blend=true)
GetMTMode(false) > 0 ? distributor() : last

[SubJunk]

fairchild, have you tried other presets? There are still 4 more presets that are faster than that one

[fairchild]

Originally Posted by SubJunk

fairchild, have you tried other presets? There are still 4 more presets that are faster than that one

I've tried the fastest preset "Ultra Fast" and it does work and doesn't drop as many frames, but there is a big quality drop that is most noticeable in fast action scenes and the audio goes way out of sync. With the Fast preset, my CPU is 100% stressed out and it begins to drop frames and looks like a slideshow since my system can't handle the decoding of the 720p video + real-time frame doubling. Perhaps if I had a faster CPU or a CPU with more cores (4+ cores) then it would possibly work.

But the scripts I posted should work well with multi-threaded stronger CPU's for real-time HD frame doubling. You possibly need to change the SetMTmode for cpu's with more threads/cores as using (2,2) is for a dual-core cpu.

So to sum up, for real-time SD, using the system in my sig the following code works for me with no frame drops or audio going out of sync. Only change I make is change the renderer to EVR-CP, because if I try using MadVR there will be frame drops randomly because MadVR uses more system resources.

SetMTmode(2,2)
ffdshow_source()
InterFrame(Preset="Medium", GPU=true, FlowPath="C:\Program Files (x86)\AviSynth 2.5\plugins\")
GetMTMode(false) > 0 ? distributor() : last

For HD I have a profile setup and just change the Preset=Ultra Fast

[Didée]

Originally Posted by fairchild

I can't do real-time HD (720p and up).
[...]
I verified it does use both of my cores so it is multi-threaded.

For HD content, a dual-core very likely is too small.

To perform this kind of operation on HD content, a quad-core is strongly recommended.

Also, you definetly do NOT want to use FIFTEEN(!!) threads on a dualcore. More than 4 threads probably do more harm (overhead) than good.

[SubJunk]

Originally Posted by fairchild

I've tried the fastest preset "Ultra Fast" and it does work and doesn't drop as many frames, but there is a big quality drop that is most noticeable in fast action scenes and the audio goes way out of sync. With the Fast preset, my CPU is 100% stressed out and it begins to drop frames and looks like a slideshow since my system can't handle the decoding of the 720p video + real-time frame doubling. Perhaps if I had a faster CPU or a CPU with more cores (4+ cores) then it would possibly work.

But the scripts I posted should work well with multi-threaded stronger CPU's for real-time HD frame doubling. You possibly need to change the SetMTmode for cpu's with more threads/cores as using (2,2) is for a dual-core cpu.

So to sum up, for real-time SD, using the system in my sig the following code works for me with no frame drops or audio going out of sync. Only change I make is change the renderer to EVR-CP, because if I try using MadVR there will be frame drops randomly because MadVR uses more system resources.

SetMTmode(2,2)
ffdshow_source()
InterFrame(Preset="Medium", GPU=true, FlowPath="C:\Program Files (x86)\AviSynth 2.5\plugins\")
GetMTMode(false) > 0 ? distributor() : last

For HD I have a profile setup and just change the Preset=Ultra Fast

Depending on your CPU it's possible you could run 4 threads max like Didee said, so I would recommend trying 3 (using the maximum amount of threads is a bad idea).
So try:

SetMTmode(2,3)
ffdshow_source()
InterFrame(Preset="Ultra Fast", GPU=true, FlowPath="C:\Program Files (x86)\AviSynth 2.5\plugins\")
GetMTMode(false) > 0 ? distributor() : last

If that still drops frames for you, there is an update coming soon that will increase the speed a lot at the same quality.

Edit: Also you could try removing the SetMTMode line because it's possible the script is choking other programs, so maybe running single-threaded will be more stable for a dual-core CPU. It's a longshot but worth trying.