Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion.

Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules.

 

Go Back   Doom9's Forum > Announcements and Chat > General Discussion

Reply
 
Thread Tools Search this Thread Display Modes
Old 11th December 2023, 17:40   #1  |  Link
PatchWorKs
Registered User
 
PatchWorKs's Avatar
 
Join Date: Aug 2002
Location: Italy
Posts: 305
[OPEN SOURCE] AudioAlign: Audio Synchronization And Analysis Tool

After more than 5 years, an updated version (now with prebuild Windows binary) finally out:
Quote:
AudioAlign is a research tool to investigate automatic synchronization of audio and video recordings that have either been recorded in parallel at the same event or contain the same aural information. It is designed as a GUI for the Aurio library.

To see what AudioAlign can do, check the demo videos linked below.


Use cases
AudioAlign has been developed for a research project with the goal to automatically synchronize audio and video recordings, recorded at the same time at the same event, e.g. a speech or a music concert. The idea was to synchronize all those videos taken from the crowd and combine them to
  • generate multicamera cuts by switching between perspectives (video),
  • create videos with full or at least better event coverage,
  • replace bad quality audio or video tracks with better ones, or
  • detect interesting moments (where many recordings have been captured at the same time).
For more, see the readme.

AudioAlign can be used for a lot more uses cases though, including
  • video mashups (video)
  • comparison of live performances (video)
  • synchronization of different cover interpretations (video)
  • voice dubbing (video)
  • ground truth creation (website)
  • evaluation of fingerprinting algorithms
  • ...

What's new
1.5.1
- silent startup crash on missing native dependency [bugfix]

1.5.0
- allow skipping of missing project assets on load [features]
- improve scheduling of many CC operations [features]
- display number of matches [features]
- bump Aurio to 4.0.0 (incl. FFmpeg 6.0) [features]

See CHANGELOG

Support
For questions and issues, please open an issue on the issue tracker. Commercial support, development and consultation is available through Protyposis Multimedia Solutions.

License
Copyright (C) 2010-2023 Mario Guggenberger mg@protyposis.net. This project is released under the terms of the GNU Affero General Public License. See LICENSE for details.
Official git: https://github.com/protyposis/AudioAlign/
Download link: https://github.com/protyposis/AudioAlign/releases/
.NET SDK 6 (needed): https://dotnet.microsoft.com/en-us/d...al-studio-sdks
__________________
Hybrid Multimedia Production Suite will be a platform-indipendent open source suite for advanced audio/video contents production.

Official git: https://www.forart.it/HyMPS/

Last edited by PatchWorKs; 29th January 2024 at 09:59.
PatchWorKs is offline   Reply With Quote
Old 29th January 2024, 09:59   #2  |  Link
PatchWorKs
Registered User
 
PatchWorKs's Avatar
 
Join Date: Aug 2002
Location: Italy
Posts: 305
New Aurio and AudioAlign versions are out !

Aurio v4.2.0 changelog:
Quote:
Features
  • bump FFmpeg to 6.1.1
  • direct audio proxy file writing
  • improve FFmpeg seeking
  • read FFmpeg samples without intermediary buffer

Bug Fixes
  • exception on FFmpeg proxy file creation
  • infinite read loop at end of FFmpeg stream
https://github.com/protyposis/Aurio/releases/tag/v4.2.0

AudioAlign v1.6.0 changelog:
Quote:
Features
  • bump Aurio to 4.2.0
https://github.com/protyposis/AudioA...ses/tag/v1.6.0
__________________
Hybrid Multimedia Production Suite will be a platform-indipendent open source suite for advanced audio/video contents production.

Official git: https://www.forart.it/HyMPS/
PatchWorKs is offline   Reply With Quote
Old 29th January 2024, 11:22   #3  |  Link
Frank62
Registered User
 
Join Date: Mar 2017
Location: Germany
Posts: 240
Will this work maybe also for different dubs in different languages somehow?
Frank62 is offline   Reply With Quote
Old 31st January 2024, 17:28   #4  |  Link
PatchWorKs
Registered User
 
PatchWorKs's Avatar
 
Join Date: Aug 2002
Location: Italy
Posts: 305
Quote:
Originally Posted by Frank62 View Post
Will this work maybe also for different dubs in different languages somehow?
Maybe (never tested for this purpose personally), anyway consider FFmatch (downloads here) for...
__________________
Hybrid Multimedia Production Suite will be a platform-indipendent open source suite for advanced audio/video contents production.

Official git: https://www.forart.it/HyMPS/
PatchWorKs is offline   Reply With Quote
Old 31st January 2024, 17:31   #5  |  Link
PatchWorKs
Registered User
 
PatchWorKs's Avatar
 
Join Date: Aug 2002
Location: Italy
Posts: 305
More bugfixes, more fun !

AudioAlign v1.7.0
Quote:
Features
  • selective match flipping

Bug Fixes
  • alignment graph plots offsets incorrectly
AudioAlign v1.6.1
Quote:
Bug Fixes
  • bump Aurio to 4.2.1
  • missing sign on alignment graph offset axis
Aurio v4.2.1
Quote:
Bug Fixes
  • FFmpeg end-of-stream handling breaks stream contract
  • FFmpeg sometimes seeks one frame too far
  • initial position not zero when first PTS not zero
  • wrongly accepted first PTS when file not seekable
__________________
Hybrid Multimedia Production Suite will be a platform-indipendent open source suite for advanced audio/video contents production.

Official git: https://www.forart.it/HyMPS/
PatchWorKs is offline   Reply With Quote
Old 1st February 2024, 12:54   #6  |  Link
Frank62
Registered User
 
Join Date: Mar 2017
Location: Germany
Posts: 240
Quote:
Originally Posted by PatchWorKs View Post
Maybe (never tested for this purpose personally), anyway consider FFmatch (downloads here) for...
Thanks for the hint! But FFMatch I tried several years ago, with not much success.
Frank62 is offline   Reply With Quote
Reply

Tags
alignment, audio, open source, sync audio and video, synchronization

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 03:44.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2024, vBulletin Solutions Inc.