Best Motion Interpolation's software/plugin ?

[johnmeyer]

Originally Posted by poisondeathray

What "lots of freeze frames ?" The pictures he uploaded ? He uploaded 5 frames

He only uploaded a source video, not a processed video


lansing - can you make a directshow graph and use avisynth/directshowsource to upload a processed video please?

I was looking at the video Lansing provided which is, I assume, the source of the OP's stills.

[poisondeathray]

Originally Posted by lansing

I have the graph like this "video->LAV video decoder->dmitrirender->video renderer", it was able to play inside graphstudionext, but when I try to load the grf in avs it said

"DirectShowSource: GRF file does not have a compatible open video pin. Graph must have 1 output pin that will bid RGB24, RGB32, ARGB, YUY2, YV12...."

Disconnect the video renderer (delete the box). Leave the dimitrirender box open as the last box. Save the grf

[lansing]

Originally Posted by poisondeathray

Disconnect the video renderer (delete the box). Leave the dimitrirender box open as the last box. Save the grf

Same error message.

[poisondeathray]

Did you remember to save the new grf ?

Right click the dimitrirender box and see what the output pin is sending , or just right click and see if there are options

[lansing]

Originally Posted by poisondeathray

Did you remember to save the new grf ?

Right click the dimitrirender box and see what the output pin is sending , or just right click and see if there are options

[poisondeathray]

In directshowsource, specify the pixel_type="NV12" ; if that doesn't work try pixel_type="YUVex"

eg.

DirectShowSource("mygraph.grf", fps=23.976, audio=false, pixel_type="NV12")

[lansing]

Changing pixel_type to "YUVex" works

DirectShowSource("test.grf", fps=59.94, audio=false, pixel_type="YUVex")

hand wave dmitrirender 60fps

[poisondeathray]

Originally Posted by lansing

Changing pixel_type to "YUVex" works

DirectShowSource("test.grf", fps=59.94, audio=false, pixel_type="YUVex")

hand wave dmitrirender 60fps

Thanks.

Did you go through it?

There seem to be some problems, duplicate frames, quality issues.... and it doesn't look as "clean" as your screenshots in the hand waving segment. I'm wondering if something got messed up somewhere

If you open the avs in vdub2 or avspmod, go frame by frame, does it look ok or similar to what you see in mpchc frame by frame ?

EDIT: Actually , it does match your screenshots. It's just there are other sorts of problems. Not that impressive on this test video . But I guess for realtime playback it might look a little better than svp or interframe or whatever method on some frames. But other frames are pretty bad. I thought it might be something much better, but it's not really that good overall either ; it fails under the same circumstances as just about everything else in "automatic" mode

[lansing]

Originally Posted by poisondeathray

Did you go through it?

There seem to be some problems, duplicate frames, quality issues.... and it doesn't look as "clean" as your screenshots in the hand waving segment. I'm wondering if something got messed up somewhere

If you open the avs in vdub2 or avspmod, go frame by frame, does it look ok or similar to what you see in mpchc frame by frame ?

EDIT: Actually , it does match your screenshots. It's just there are other sorts of problems. Not that impressive on this test video . But I guess for realtime playback it might look a little better than svp or interframe or whatever method. I thought it might be something much better, but it's not really

It took about 3 seconds for the filter to start rendering, so the first 3 seconds of the video doesn't have the effect yet.

Comparing it to framerateConverter frame by frame, dmitrirender is also noticeably blurrier.

[johnmeyer]

Originally Posted by poisondeathray

... Not that impressive on this test video . But I guess for realtime playback it might look a little better than svp or interframe or whatever method on some frames. But other frames are pretty bad. I thought it might be something much better, but it's not really that good overall either ; it fails under the same circumstances as just about everything else in "automatic" mode

Originally Posted by lansing

... Comparing it to framerateConverter frame by frame, dmitrirender is also noticeably blurrier.

Thanks to both of you for taking the time to check this out. Sounds like I can find something else to do and not bother with this. I did notice that the video seemed unusually soft, but I figured that was just the source video itself. It sounds like one of the "tricks" was to add a lot of blur to the video which might make the ME algorithms avoid "blowing up" when tracking sharply defined objects: some of the worst artifacts I ever saw was the rack of antlers on a stuffed moose that was on a float in a parade:

Moose Antlers

[poisondeathray]

Originally Posted by lansing

It took about 3 seconds for the filter to start rendering, so the first 3 seconds of the video doesn't have the effect yet.

Comparing it to framerateConverter frame by frame, dmitrirender is also noticeably blurrier.

Yes, I would ignore the beginning ...

I wonder if there are any differences between full/registered version (I mean besides the overlay and time for it to start)

By "blurrier" - did you account for compression differences (you used x264 crf23 for dimitri)

BTW, are there any other options? (e.g. can you select different framerates instead of 60.0, quality vs. speed tradeoff, etc...)



For my purposes, I don't really care about a realtime playback filter . I'd rather have a better, higher quality / offline method, even if it's slower or requires some manual input / user guidance. But I'm always looking for something even slightly better for "automatic" interpolation too, because it can be used sometimes as a base layer or compositing fixes

[lansing]

Originally Posted by poisondeathray

By "blurrier" - did you account for compression differences (you used x264 crf23 for dimitri)

Oh you're right, the blurriness was caused by the compression, checking the grf in avspmod, the sharpness doesn't change.

I wonder if there are any differences between full/registered version (I mean besides the overlay and time for it to start)

BTW, are there any other options? (e.g. can you select different framerates instead of 60.0, quality vs. speed tradeoff, etc...)

No idea, no options to set custom output frame rate. Maybe we can set it in directshowsource I don't know.

[poisondeathray]

Are you sure? It does seem "blurrier" to me too ; I know I'm not looking at the crf23 version, but there seems to be more motion blur that you would expect with a plain crf23 encode. Perhaps some motion blur is added to smooth? (that and the re-rendering timing of all subframes)

I think your choice of screenshots was not quite representative, even talking about the arm wave only, let alone other types of motions. It looks pretty bad too in some frames (but you could argue mvtools2 looks worse in some frames, but better in some areas).

Here is dimitry render vs. twixtor with trackpoints. It's not a realtime playback solution; there is some user input into what to track, to help guide the motion estimation


But thanks for testing anyway.

[MysteryX]

In artifact areas, does it give better results than frame blending? Does it leave really ugly artifacts pass through? If it could be used as a backup method instead of frame blending, that could be cool.

[poisondeathray]

Originally Posted by MysteryX

In artifact areas, does it give better results than frame blending? Does it leave really ugly artifacts pass through? If it could be used as a backup method instead of frame blending, that could be cool.

But dimitryrender is a commercial plugin, not open source.

How would you include it in your FrameRateConverter plugin+script ?

[Motenai Yoda]

Originally Posted by johnmeyer

so you can get the soap opera effect while watching movies

I think soap opera effect derive by cheap framerate/cadence conversion using something like convertfps, rather than motion interpolation conversion

[zorr]

Originally Posted by lansing

Here is hand wave sample. The DmitriRender sequence are screenshots from the player.

hand wave sample

I'd like to take a look at this. What's the recommended way to open .mkv videos in Avisynth?

[MysteryX]

Originally Posted by zorr

I'd like to take a look at this. What's the recommended way to open .mkv videos in Avisynth?

I just use LWLibavVideoSource for everything and don't have any issue.

[johnmeyer]

Originally Posted by poisondeathray

Here is dimitry render vs. twixtor with trackpoints.

Which one is on the left? You didn't label them. The one on the left looks like standard ME, so I assume it is Twixtor, but maybe I'm wrong.

Originally Posted by Motenai Yoda

I think soap opera effect derive by cheap framerate/cadence conversion using something like convertfps, rather than motion interpolation conversion

My Samsung TV creates its soap opera effect using motion estimation.

[lansing]

Originally Posted by poisondeathray

Are you sure? It does seem "blurrier" to me too ; I know I'm not looking at the crf23 version, but there seems to be more motion blur that you would expect with a plain crf23 encode. Perhaps some motion blur is added to smooth? (that and the re-rendering timing of all subframes)

I think your choice of screenshots was not quite representative, even talking about the arm wave only, let alone other types of motions. It looks pretty bad too in some frames (but you could argue mvtools2 looks worse in some frames, but better in some areas).

The blurriness I was referring to are the lost of details in the clothing, which was caused by the x264 compression. I'm okay with motion blur on moving objects.

From this example, it should to safe to assume that dmitrirender is better than framerateConverter. Frame blending just doesn't look good on hand waving because on playback, it makes it looking like Matrix.