Search video files using audio content

[johnmeyer]

A client just asked if there is a way to find all video clips on a 2TB drive in which the song "Happy Birthday" is played.

This same person, several weeks ago, showed me an app on his smartphone that could identify virtually any song I played on my computer, including various "covers" of the original recording of the song. I don't own a smartphone, but I am led to believe that most people who do are well aware of this capability.

So my question is this: does anyone know of an AVISynth plugin that would let me use that same technology to search through video files and flag those (preferably with a timecode where the song starts) where a given song is played?

[StainlessS]

I would think only Green Street, Green field or some other Green something would do.
A sort of Open DB data base of 'sounds'. (dont know of any plug).

EDIT: Not sure, I think Quintessential Media Player has something like that. (no longer developed).

EDIT: http://www.quinnware.com/index.php

[johnmeyer]

Thanks! I just Googled for "green street" along with audio OR sound, but didn't find anything relevant. I'll keep looking.

[StainlessS]

bump, see previous post. I'll try to find something (when I sober up) I think they also do some kind of movie recognition.

[johnmeyer]

Thanks for the link ... I'm perusing their site right now ...

[hanfrunz]

You could try Avid MediaComposer (30 day trial) It has a feature called "Phrase Find". So you could search for "Happy Birthday" and will find all parts that sound like someone saying it. This of course only if someone is singing... You only need to import the audio of all clips. Maybe worth a try.

[StainlessS]

John, was a bit off target with "Green" something, was actually "GraceNote"
http://www.gracenote.com/music/recognition/
It works like the CD database but for eg mp3's.

QMP does have it, on the "Music ID View" tab. (I think later versions of PowerDVD might have similar but I
still use PowerDVD v5.0).


EDIT: GraceNote developer page:
https://doors.gracenote.com/developer/cddb2new.html

EDIT: There is Open Source Licensing available, VB and C++, ActiveX dll.

[johnmeyer]

Oh yes, Gracenote. I haven't looked at that for over a decade. I'll research that when I get to my main computer later today.

Mediacomposer sounds very promising. I've never used any Avid products because, prior to the Pinnacle acquisition, they were way too expensive for me. As a result, I'm not familiar with what they offer. Should be interesting to try it out.

Many thanks for both suggestions.

[Seedmanc]

There's PC software called "Tunatic" able to recognize song playing through the speakers. Combine that with Avisynth's ability to launch external applications and cycle through videofiles and maybe this will lead somewhere. I don't know how to organize feedback from Tunatic to script to tell that song has been found though.