PatchWorKs
10th December 2023, 18:45
After 5 years it finally comes out with prebuilt binaries. Enjoy.
AudioAlign is a research tool to investigate automatic synchronization of audio and video recordings that have either been recorded in parallel at the same event or contain the same aural information. It is designed as a GUI for the Aurio library.
To see what AudioAlign can do, check the demo videos linked below.
https://raw.githubusercontent.com/protyposis/AudioAlign/main/audioalign1.png
Use cases
AudioAlign has been developed for a research project with the goal to automatically synchronize audio and video recordings, recorded at the same time at the same event, e.g. a speech or a music concert. The idea was to synchronize all those videos taken from the crowd and combine them to
generate multicamera cuts by switching between perspectives (video (https://www.youtube.com/watch?v=QXQVPXjR3Lc)),
create videos with full or at least better event coverage,
replace bad quality audio or video tracks with better ones, or
detect interesting moments (where many recordings have been captured at the same time).
AudioAlign can be used for a lot more uses cases though, including
video mashups (video (https://www.youtube.com/watch?v=cdv4-gOxxZ0))
comparison of live performances (video (https://www.youtube.com/watch?v=4yUSLa4K3GE))
synchronization of different cover interpretations (video (https://www.youtube.com/watch?v=Jo2XPXUmkK0))
voice dubbing (video (https://www.youtube.com/watch?v=f89isFfLgvg))
ground truth creation (website (http://protyposis.github.io/JikuMVD-SynchronizationGroundTruth/))
evaluation of fingerprinting algorithms
...
What's new
1.5.1
silent startup crash on missing native dependency
1.5.0
allow skipping of missing project assets on load
improve scheduling of many CC operations
display number of matches
bump Aurio to 4.0.0 (incl. FFmpeg 6.0)
FULL CHANGELOG (https://github.com/protyposis/AudioAlign/blob/main/CHANGELOG.md)
Support
For questions and issues, please open an issue on the issue tracker. Commercial support, development and consultation is available through Protyposis Multimedia Solutions (https://protyposis.com/).
License
Copyright (C) 2010-2023 Mario Guggenberger mg@protyposis.net. This project is released under the terms of the GNU Affero General Public License. See LICENSE (https://github.com/protyposis/AudioAlign/blob/main/LICENSE) for details.
Official GIT: https://github.com/protyposis/AudioAlign
Direct Download: https://github.com/protyposis/AudioAlign/releases/download/v1.5.1/AudioAlign-Release-v1.5.1.zip
.NET 6 SDK (needed): https://dotnet.microsoft.com/en-us/download/visual-studio-sdks
AudioAlign is a research tool to investigate automatic synchronization of audio and video recordings that have either been recorded in parallel at the same event or contain the same aural information. It is designed as a GUI for the Aurio library.
To see what AudioAlign can do, check the demo videos linked below.
https://raw.githubusercontent.com/protyposis/AudioAlign/main/audioalign1.png
Use cases
AudioAlign has been developed for a research project with the goal to automatically synchronize audio and video recordings, recorded at the same time at the same event, e.g. a speech or a music concert. The idea was to synchronize all those videos taken from the crowd and combine them to
generate multicamera cuts by switching between perspectives (video (https://www.youtube.com/watch?v=QXQVPXjR3Lc)),
create videos with full or at least better event coverage,
replace bad quality audio or video tracks with better ones, or
detect interesting moments (where many recordings have been captured at the same time).
AudioAlign can be used for a lot more uses cases though, including
video mashups (video (https://www.youtube.com/watch?v=cdv4-gOxxZ0))
comparison of live performances (video (https://www.youtube.com/watch?v=4yUSLa4K3GE))
synchronization of different cover interpretations (video (https://www.youtube.com/watch?v=Jo2XPXUmkK0))
voice dubbing (video (https://www.youtube.com/watch?v=f89isFfLgvg))
ground truth creation (website (http://protyposis.github.io/JikuMVD-SynchronizationGroundTruth/))
evaluation of fingerprinting algorithms
...
What's new
1.5.1
silent startup crash on missing native dependency
1.5.0
allow skipping of missing project assets on load
improve scheduling of many CC operations
display number of matches
bump Aurio to 4.0.0 (incl. FFmpeg 6.0)
FULL CHANGELOG (https://github.com/protyposis/AudioAlign/blob/main/CHANGELOG.md)
Support
For questions and issues, please open an issue on the issue tracker. Commercial support, development and consultation is available through Protyposis Multimedia Solutions (https://protyposis.com/).
License
Copyright (C) 2010-2023 Mario Guggenberger mg@protyposis.net. This project is released under the terms of the GNU Affero General Public License. See LICENSE (https://github.com/protyposis/AudioAlign/blob/main/LICENSE) for details.
Official GIT: https://github.com/protyposis/AudioAlign
Direct Download: https://github.com/protyposis/AudioAlign/releases/download/v1.5.1/AudioAlign-Release-v1.5.1.zip
.NET 6 SDK (needed): https://dotnet.microsoft.com/en-us/download/visual-studio-sdks