Avisynth Tracking Filter

Wilbert · 14th April 2010, 22:03

Shlomo posted his Tracking Filter to avisynth.org:
Author: Shlomo Matichin
plugin: https://sourceforge.net/projects/avisynthtrackin/
YouTube demo: http://www.youtube.com/watch?v=SQ-JtJs7US0
license: GPL

I can't find the plugin itself though, perhaps i'm looking in the wrong place.

Guest · 14th April 2010, 23:15

I couldn't find any files there either.

Blue_MiSfit · 14th April 2010, 23:55

Looks like a very cool tool for visual effects! The YouTube demo is interesting!

~MiSfit

tin3tin · 15th April 2010, 07:38

Wow looks nice. OpenCV + Avisynth rules.

Looking forward to try the plugin, when it is uploaded.

Noticed another interesting Avisynth project on Sourceforge to keep an eye on: JAviSynth
JAviSynth is a wrapper library that allows AviSynth to be used in the Java programming language.

tin3tin · 17th April 2010, 22:46

The tracker file is up now.

shlomimatichin · 18th April 2010, 13:08

Hi guys!

Thank you for showing interest! I wanted to post it here myself, and also wanted to post a reply saying when will the download be available, but Doom9 has a five day rule for newbies...

I'm thinking about developing further automatic resizing option (so when following, the input amount of pixels changes according to how big the object is on the screen).

Any feedback will be welcome!

Shlomi.

AnnaFan777 · 18th April 2010, 14:15

Quote:

Originally Posted by shlomimatichin

Hi guys!

Thank you for showing interest! I wanted to post it here myself, and also wanted to post a reply saying when will the download be available, but Doom9 has a five day rule for newbies...

I'm thinking about developing further automatic resizing option (so when following, the input amount of pixels changes according to how big the object is on the screen).

Any feedback will be welcome!

Shlomi.

can you upload the demo vid to rapidshare or some place
people can download from?

I'm using dial-up, it's impossible to view or dl from youtube..

um3k · 18th April 2010, 16:03

I wonder, would it be possible to make the coordinates available to other plugins? I think this could be a lot more versatile than just cropping to a subject.

shlomimatichin · 18th April 2010, 16:36

um3k: already works this way. The filter works "two-pass": in the first "pass" a gui window opens were you select the object. the region selected is searched for "strong features" (subpixel) to track. the coordinate for each feature for each frame is written to a text file... then i've included a python script to average the center of these coordinates (after dicarding the top and bottom 10 precent) and write the result into a ConditionalReader format text file. In the "second pass", i use a duplicate of the crop filter i hacked to receive the coordinates from a ConditionalReader. The text file has a very straight forward format...

If you have any clever ideas i would like to hear more about them...

scharfis_brain · 18th April 2010, 17:36

Maybe you could put out a deshaker-compatible motion data file?

shlomimatichin · 18th April 2010, 18:01

hi,

first of all thanks, i was not aware of deshaker. but i think deshaker works best for cam-corder videos. My solution is better for cases such as extreme sports photography, like ski or skydiving, where the camera is head-mounted, and no real time control of zoom and panning is possible. From my short experience, half the skydiving flicks i've seen suffer from sharp head movements by the photographer, and framing issues.

so my question is: why? what kind of an end user will need that?

thanks!
Shlomi.

tin3tin · 19th April 2010, 07:38

Nice work. I hope that one day arrays or loading+parsing of text files will be functions of Avisynth, so something like this could be done without python.

Soulhunter · 19th April 2010, 15:09

Nice! The tracking would be also handy for censoring (tracking faces/boobs/whatever -> pixelate/blur)

birdinred · 29th September 2011, 21:32

i downloaded the .zip and test it following the doc,but failed to get the right result.

the tracking was stored in a .csv file,not in the .txt file.and after dragging the test.avs over the FollowCrop.py,then the Xoffset and Yoffset in the .txt file are all set to Zero.so nothing changed.

if i did any step wrong,anyone can help figure out? TKS.

btw,the demo on Youtube can't be seen anylonger.(now i can see it by a proxy website,the demo is right there...)

+++++++++++++++++
these days i asker for help to a programmer friend and learned some basic python language,and the question has resolved - i need to adjust the resolved frame size.now all worked well,the filter gives a great effect not very correct but more than expected.it looks very well,although i must first get the tracking by hand,but the next using the x and y offset to get my effect in avisynth script can go automatically,near to the professional results.thanks to all,especially to author ShlomiMatichin giving so good gift,thanks.

Usage Demo:
http://www.tudou.com/programs/view/T2g2AT_7Rhs/

14th April 2010, 22:03	#1 \| Link
Wilbert Moderator Join Date: Nov 2001 Location: Netherlands Posts: 6,364	Avisynth Tracking Filter Shlomo posted his Tracking Filter to avisynth.org: Author: Shlomo Matichin plugin: https://sourceforge.net/projects/avisynthtrackin/ YouTube demo: http://www.youtube.com/watch?v=SQ-JtJs7US0 license: GPL I can't find the plugin itself though, perhaps i'm looking in the wrong place. Last edited by Wilbert; 14th April 2010 at 22:07.

14th April 2010, 23:55	#3 \| Link
Blue_MiSfit Derek Prestegard IRL Join Date: Nov 2003 Location: Los Angeles Posts: 5,989	Looks like a very cool tool for visual effects! The YouTube demo is interesting! ~MiSfit __________________ These are all my personal statements, not those of my employer :)

15th April 2010, 07:38	#4 \| Link
tin3tin Registered User Join Date: Mar 2005 Posts: 366	Wow looks nice. OpenCV + Avisynth rules. Looking forward to try the plugin, when it is uploaded. Noticed another interesting Avisynth project on Sourceforge to keep an eye on: JAviSynth JAviSynth is a wrapper library that allows AviSynth to be used in the Java programming language. __________________ DVD slideshow GUI(Freeware).

17th April 2010, 22:46	#5 \| Link
tin3tin Registered User Join Date: Mar 2005 Posts: 366	The tracker file is up now. __________________ DVD slideshow GUI(Freeware).

18th April 2010, 13:08	#6 \| Link
shlomimatichin Registered User Join Date: Apr 2010 Posts: 3	Word from the developer Hi guys! Thank you for showing interest! I wanted to post it here myself, and also wanted to post a reply saying when will the download be available, but Doom9 has a five day rule for newbies... I'm thinking about developing further automatic resizing option (so when following, the input amount of pixels changes according to how big the object is on the screen). Any feedback will be welcome! Shlomi.

14th April 2010, 23:15	#2 \| Link
Guest Guest Join Date: Jan 2002 Posts: 21,901	I couldn't find any files there either.

18th April 2010, 16:03	#8 \| Link
um3k Registered User Join Date: May 2007 Posts: 220	I wonder, would it be possible to make the coordinates available to other plugins? I think this could be a lot more versatile than just cropping to a subject.

18th April 2010, 16:36	#9 \| Link
shlomimatichin Registered User Join Date: Apr 2010 Posts: 3	um3k: Already works this way um3k: already works this way. The filter works "two-pass": in the first "pass" a gui window opens were you select the object. the region selected is searched for "strong features" (subpixel) to track. the coordinate for each feature for each frame is written to a text file... then i've included a python script to average the center of these coordinates (after dicarding the top and bottom 10 precent) and write the result into a ConditionalReader format text file. In the "second pass", i use a duplicate of the crop filter i hacked to receive the coordinates from a ConditionalReader. The text file has a very straight forward format... If you have any clever ideas i would like to hear more about them...

18th April 2010, 17:36	#10 \| Link
scharfis_brain brainless Join Date: Mar 2003 Location: Germany Posts: 3,653	Maybe you could put out a deshaker-compatible motion data file? __________________ Don't forget the 'c'! Don't PM me for technical support, please.

18th April 2010, 18:01	#11 \| Link
shlomimatichin Registered User Join Date: Apr 2010 Posts: 3	reply to scharfis_brain hi, first of all thanks, i was not aware of deshaker. but i think deshaker works best for cam-corder videos. My solution is better for cases such as extreme sports photography, like ski or skydiving, where the camera is head-mounted, and no real time control of zoom and panning is possible. From my short experience, half the skydiving flicks i've seen suffer from sharp head movements by the photographer, and framing issues. so my question is: why? what kind of an end user will need that? thanks! Shlomi.

19th April 2010, 07:38	#12 \| Link
tin3tin Registered User Join Date: Mar 2005 Posts: 366	Nice work. I hope that one day arrays or loading+parsing of text files will be functions of Avisynth, so something like this could be done without python. __________________ DVD slideshow GUI(Freeware).

19th April 2010, 15:09	#13 \| Link
Soulhunter Bored... Join Date: Apr 2003 Location: Unknown Posts: 2,812	Nice! The tracking would be also handy for censoring (tracking faces/boobs/whatever -> pixelate/blur) __________________ Visit my IRC channel

29th September 2011, 21:32	#14 \| Link
birdinred Registered User Join Date: Jul 2011 Location: Beijing,China Posts: 3	i downloaded the .zip and test it following the doc,but failed to get the right result. the tracking was stored in a .csv file,not in the .txt file.and after dragging the test.avs over the FollowCrop.py,then the Xoffset and Yoffset in the .txt file are all set to Zero.so nothing changed. if i did any step wrong,anyone can help figure out? TKS. btw,the demo on Youtube can't be seen anylonger.(now i can see it by a proxy website,the demo is right there...) +++++++++++++++++ these days i asker for help to a programmer friend and learned some basic python language,and the question has resolved - i need to adjust the resolved frame size.now all worked well,the filter gives a great effect not very correct but more than expected.it looks very well,although i must first get the tracking by hand,but the next using the x and y offset to get my effect in avisynth script can go automatically,near to the professional results.thanks to all,especially to author ShlomiMatichin giving so good gift,thanks. Usage Demo: http://www.tudou.com/programs/view/T2g2AT_7Rhs/ Last edited by birdinred; 6th October 2011 at 20:33. Reason: get the answer