How can this displacement be fixed

[Drmsy]

Hi everybody.This is my first post in this forum.

I would be very grateful if some could help me in stopping the internal displacement of a few successive frames of the clip below.

https://www.mediafire.com/file/mbgnt62p7vprcvh/displacement.mp4/file

[johnmeyer]

It's a pretty short clip (easy to download!) but all I saw is what is normally called "gate weave." This is caused by each frame of movie film not coming to rest in the film gate at exactly the same X-Y position as the adjacent frames. This causes the image to bounce around. It is usually more severe with small gauge (16mm and smaller) than large gauge film because the sprocket hole alignment is a larger percentage of the frame size.

It can be fixed, almost perfectly, but using any motion stabilizer. For film, I use Depan. I'm in a hurry now, but you can find the proper settings in the film script created by "VideoFred" here in this forum. Just search his name and "film" in the title of the thread.

[Drmsy]

Johnmeyer Thank you so much for your reply.
Unfortunately, I tried almost all stabilization scripts and plugins on both avisynth and virtualdub and no luck. Even Deshaker could not fix it.

[johnmeyer]

If you could post 10-15 seconds (or a little longer) I'll take a look and see what I can do. As you may know, I wrote the Deshaker tutorial, and also wrote the automation scripts to let it be used inside of the Vegas Pro NLE with only a single button push. I also own Mercalli which is, IMHO, the "ultimate" motion stabilization technology available to us mere mortals.

I need to see a longer clip to see if the "displacement" is a single event, like what happens when a film projector momentarily loses its loop. If so, there are other techniques. Here is a before/after on some film where it was the camera which kept losing its loop and therefore the jumps were baked into the film. I wish I'd posted the result when the truck pulled away, because it is much more impressive to see everything fixed perfectly when there is significant motion in the frame:

Restoration of Jumpy Film (https://www.youtube.com/watch?v=uzMFodrGHDs)

To do this fix I had to manually "mark" each jump. I then wrote an AVISynth script that used motion estimation to synthesize a frame, using the adjacent frames, and inserted this frame in place of the jump.

[Drmsy]

Johnmeyer Many thanks once again
here is a longer clip of about 10s

https://www.mediafire.com/file/ldcbk79k7zgoq5r/displacement.mp4/file

[johnmeyer]

If you are talking about the single anomaly just after Hanna/Barbera's names appear, that is indeed a strange one because it affects only one field, which is why the motion stabilization doesn't do anything. What's more, it first affects one field, and then two frames later affects the other field. If it only happens in this one place, the easiest thing to do is simply replace the two bad frames with an adjacent frame.

If it happens a lot, I have in the past created scripts to detect and fix this sort of thing. Here are the names of some of the scripts I developed for past repairs:

Detect and Fix Field Shifts (average three frames).avs
Didée fix warped even fields on progressive film source.avs
Replace Bad Field With Motion Estimated Field from Good Field.avs

[Drmsy]

I already tried "Detect and Fix Field Shifts (average three frames).avs" and had no luck. I've also already tried "Replace Bad Field With Motion Estimated Field from Good Field.avs" and get a jerky motion. The only one I haven't tried yet is "Didée fix warped even fields on progressive film source.avs" which I could not find the link for.

[poisondeathray]

Are you only fixing the titles, "of a few successive frames of the clip below" ? or does the entire video have this issue that you're trying to fix ? - I'm talking specifically about the frame warping where the top part of the frame move differently than the bottom in the affected sections.

Are you planning to preserve the dirt/dust/noise and flicker (is this a preservation project); or do you plan to clean up as well ?

[Drmsy]

The strange behavior of three successive frames happens a lot throughout this clip and also other clips of the Tom and Jerry cartoons. I assembled an excellent script to clean and remove the flickering. Only this problem remains.

[poisondeathray]

Stabilization does not really fix frame warping (some can , to a small extent, such as mercalli or warp stabilizer which have warp and rolling shutter modes)

Avisynth is great at automating some types of operations and fixes , but not frame warping . There are semi manual techniques, but it can get tedious if every episode is like this

But looking at a youtube video for "Tom and Jerry PAL Series - Jerry's Diary (1949) Opening Title & Closing [PAL Turner Print]" , you can see different parts of the frame move in different directions in some sequences. Difficult to fix properly

If you had lots of duplicates that are clean, you could copy /paste , such as in the title sequence. But in the main body, when Tom/Jerry are running, moving, it's going to be difficult to fix properly without manual work. The only good news is it's a cartoon, with repeated simple textures - this makes it easier to borrow from parts of adjacent frames with masks