Match two alternative versions of the same movie and audio stream from another source

[doomwake]

Hello I'm on a mission to help make a script or program to sync up videos by frames to either replace frames with the better one or add new scenes. or to adapt the audio to the other 2nd video with the parts that it has in common between the 2 videos.

This would be great for regions of languages that only had a TV version release and could be synced up with the dvd or blu ray or web version of a different region.

or if there are missing scenes they could be added in for a directors cut version.

or if you have multiple captures with dropped frames so they can be combined for a the best of both.

I have found some things that are working on this but needs to be perfected for best results.

The first is FFmatch
http://fsinapsi.altervista.org/code/ffmatch/index.html

It uses change scene detection to sync up films but it hasn't been updated since the start of 2012. it tries to match scenes and then mix the audio to mux to the better quality video.

It has problems with added scenes or extra frames in parts so it doesn't link to the last frame before it changes and you have to do it your self which takes a lot of time.

2nd is StainlessS scripts
RT_Stats
SirPlant
SpatialAlign
SubstituteRanges

They work great when its set to false but then the lips don't line up due to a few added frames. Also when video fades in and out it misses to get a few frames .

I got the best results with following settings:

Th: 95
Th2: 75
luma: 62
Strict=False

[2984] SubstituteRangesGenerator: ######
[2984] SubstituteRangesGenerator: # InLen= 27750 OutLen= 27775 Replaced=26773 NotReplaced=2986 Extras=0
[2984] SubstituteRangesGenerator: # Approx Frames Compared=62869440
[2984] SubstituteRangesGenerator: # LumaTol Failures=801
[2984] SubstituteRangesGenerator: # *** 41 JUMPING *** sequences detected (Strict=False)
[2984] SubstituteRangesGenerator: # Local Stop Time = 2017-06-05 07:07:42.509 : Time Taken=231.162 Secs (3.853 mins)
[2984] SubstituteRangesGenerator: ######


If anybody else that is working on this can you share the settings you are using?

What else can we add to get the lips synced up or to get the missing frames when it fades in and out.

I'm about to start working with the SirPlant settings which helps with the lips.

Does anybody here have a better program like FFmatch?
Does anybody have scrips that help with this?

Lets work together to come up with a perfected method syncing video together.