Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion.

Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules.

 

Go Back   Doom9's Forum > Programming and Hacking > Development

Reply
 
Thread Tools Search this Thread Display Modes
Old 9th May 2011, 23:20   #1  |  Link
diablo23q
Registered User
 
Join Date: May 2011
Posts: 5
Developing new MSU VirtualDub filter

Hello everyone!
I am studying in Moscow State University, Russia (sorry for crooked english), and now I have to start a project connected with video processing. Due to requirements it must contain interesting algorithms and must be needed to large group of people. So I'm asking you to help me decide what task to choose.

Now in detail.
Task must be in video processing area.
It will be VirtualDub filter as a result and it will be free to download from here: http://compression.ru/video/
It's desirable for task to be connected with following: stereo, 3d, depth maps, object detection, object tracking.
I will be glad to see any comments. If someone is intrested in development process - I'm ready to contact
diablo23q is offline   Reply With Quote
Old 9th May 2011, 23:21   #2  |  Link
Dark Shikari
x264 developer
 
Dark Shikari's Avatar
 
Join Date: Sep 2005
Posts: 8,666
Why not an Avisynth filter? Surely that would be more powerful, more flexible, easier to write, and usable by more people?
Dark Shikari is offline   Reply With Quote
Old 9th May 2011, 23:44   #3  |  Link
diablo23q
Registered User
 
Join Date: May 2011
Posts: 5
It's recommended for me as a student. But I think it can be Avisynth filter.
diablo23q is offline   Reply With Quote
Old 10th May 2011, 00:03   #4  |  Link
pbristow
Registered User
 
pbristow's Avatar
 
Join Date: Jun 2009
Location: UK
Posts: 263
I second what Dark Shakiri says. By creating an AVIsynth plugin, the result can be used by several different applications (including VirtualDub, of course), and be more powerfully combined with other tools and techniques.

Myself, I'd love to see a new approach to motion estimation & interpolation, based on 3d object recognition and tracking. At present, for motion estimation we have:
- In Virtualdub, the free MSU_Motion_Estimation.vdf plugin, thanks to you guys.
- In AviSynth, MSU_FRC - I don't know what method or algorithm this is based on, possibly 'cos you guys are keeping it secret for commercial exploitation...? (Or maybe it's 'cos I'm too lazy to try to read the source code. [EDIT: No, I was right first time. There's no source code published for this filter.])
- In AViSynth, the excellent MVTools2, which uses a 2d block-based algorithm. It's very good for most simple types of motion, which account for maybe 90% or 95% of what happens in real video, but there are cases it can't handle, e.g.: objects that are rotating or tumbling so quickly that, although their *topology* remains near enough the same from frame to frame, their shape as seen in 2d doesn't; Also layered motion, for example where fog or smoke or a reflection on a window is drifting one way, in front of an object or person that moves the other way (or remains still).
- Several lesser tools, mostly to do with simple de-shaking/de-panning.

I can see two possible ways forward for motion estimation from MVtools2:

1. Stick with 2d analysis, but move from detecting and matching similar blocks, to detecting clusters of features that move together as an "object". This means being able to take into account that a set of features may have been rotated or skewed between frames, as well as translated across or up/down the frame.

2. Switch to using 3d object recognition and tracking. This brings in the areas of study you refer to above.

The result of the tool needs to be not just a pre-determined action, such as frame-rate conversion, but rather a video clip (or a logfile, but a video clip is better, especially if you're working AVisynth) containing the encoded motion data IN A PUBLICLY DOCUMENTED FORMAT, so that other developers/researchers can then develop new applications (or alternative motion detection tools) using the same format. (This is the approach MVtools2 takes: Although it provides a complete toolkit for motion interpolation and frame rate conversion, it also allows others - by examining the code - to develop their own tools using the same data.)

Last edited by pbristow; 10th May 2011 at 00:16.
pbristow is offline   Reply With Quote
Old 10th May 2011, 00:32   #5  |  Link
diablo23q
Registered User
 
Join Date: May 2011
Posts: 5
Thanks for information, I'll look in this direction.

Any other ideas?

Last edited by diablo23q; 10th May 2011 at 21:26.
diablo23q is offline   Reply With Quote
Reply

Tags
avisynth, development, msu, video filter, virtualdub

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 11:47.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2024, vBulletin Solutions Inc.