Sync Files Together

[jay123210599]

I have an audio and video file I want to put together, but they're out of sync. What are some tools that can automatically sync them together?

[RetsimLegin]

Two possible scenarios:
1: The two sources are simply a fixed amount out of sync; the mistiming is constant throughout
2: The mistiming varies either because the audio and video aren't from exactly the same source (eg, there are edits to the video that aren't exactly parallelled in the audio; the speed of each differs, etc.)

I'd test for, and then if OK, fix the first by ear/eye manually:
Mux them together as is. Play the output in (say) VLC and use the synchronisation adjustment there, as it plays back, until it looks and sounds right. Note the value. With the adjustment in place, check at a good many points throughout the file to ensure it now remains synchronised. If it does, then it would be a matter of muxing the two sources together (eg tsMuxeR) with that amount of sync shift applied.

If the test fails i.e. you have (2) then I suspect that would have to be fixed using an AV editor and making manual adjustments to either edit points or speed of one or other track to get it right.

Maybe someone else knows something, but I can't imagine how any automated tool would be able to look at a picture and listen to a sound, and work out/know how they should be synchronised.

[Z2697]

I'd say if in doubt, go AI, LOL. At least that's what recent trend in tech goes.

Realistically speaking, an imaginary tool for such thing would require some level of "semantic" video and audio analysis, and making connections of both, which I think we don't have better tools than "AI"... yet?
(I mean, our brain is of course the best "tool" but... you know what I mean)

That's the complexity if you want a catch-all tool for any or most of the A/V you give it. If the inputs have simpler patterns that's probably easier.

[StainlessS]

You could maybe see here:- Standalone Faster-Whisper - AI auto-transcription-translation
https://forum.doom9.org/showthread.php?t=184859

Create subs file using audio only.

Might help in manual sync.

[GeoffreyA]

(I mean, our brain is of course the best "tool" but... you know what I mean)

Well, we're a Zen 19 AI compared to 386!

[jay123210599]

Well, we're a Zen 19 AI compared to 386!

Can you take a look at this?
https://forum.doom9.org/showthread.php?p=2018825#post2018825

[GeoffreyA]

Can you take a look at this?
https://forum.doom9.org/showthread.php?p=2018825#post2018825

When I've got time.

[GeoffreyA]

1 > test1 (Dithering is less noticeable, and smaller.)
2 < test2 (2 has more noise, dithering, banding. Also pans slower.)
3 > test3 (Only slightly better. Both look all right.)

[jay123210599]

1 > test1 (Dithering is less noticeable, and smaller.)
2 < test2 (2 has more noise, dithering, banding. Also pans slower.)
3 > test3 (Only slightly better. Both look all right.)

I made a better version of 2 named 2.5 where I set the quality at 100. Compare it to see the result.

https://www.mediafire.com/view/dmrzc7evzdjndpy/2.5.gif/file

[GeoffreyA]

I made a better version of 2 named 2.5 where I set the quality at 100. Compare it to see the result.

https://www.mediafire.com/view/dmrzc7evzdjndpy/2.5.gif/file

test2 > 2.5

2.5 still has a lot of artefacting. If you lower the brightness, it becomes more visible. Look round the short-haired girl and wall. Also, the judder is quite bad.

[Z2697]

It's not like the other is looking any good anyway. Both crap.

[Z2697]

test2 > 2.5

2.5 still has a lot of artefacting. If you lower the brightness, it becomes more visible. Look round the short-haired girl and wall. Also, the judder is quite bad.

The judder is probably just from how badly his method was.
And don't you think "test2" has more obvious dithering "dots"?

[GeoffreyA]

The judder is probably just from how badly his method was.
And don't you think "test2" has more obvious dithering "dots"?

You're right. I hadn't looked at the dithering dots, but they're quite visible in test2.

[jay123210599]

But overall, though my tests, Gifski is proven to make better and higher gifs than Shutter Encoder.