Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion.

Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules.

 

Go Back   Doom9's Forum > Capturing and Editing Video > Avisynth Development

Reply
 
Thread Tools Search this Thread Display Modes
Old 7th August 2007, 17:45   #1  |  Link
Terranigma
*Space Reserved*
 
Terranigma's Avatar
 
Join Date: May 2006
Posts: 953
Help tritical's interpolation research by contributing CPU cycles


Hello? Does anyone know tritical's Status? Is he ok or...?
I've haven't seen him around lately, I hope he's ok. Please return, we miss you (well I do anyways).
You'll be surely missed around, that's for sure. You have inspired me in many ways, you and the lot of you here @ this community. If anyone know his status, please share it with me.

EDIT by neuron2: I took the liberty of changing your title to draw attention to tritical's research. Thanks for inspiring this thread.

Last edited by Guest; 29th August 2007 at 16:04. Reason: Changed title
Terranigma is offline   Reply With Quote
Old 7th August 2007, 18:26   #2  |  Link
Leak
ffdshow/AviSynth wrangler
 
Leak's Avatar
 
Join Date: Feb 2003
Location: Austria
Posts: 2,441
Quote:
Originally Posted by Terranigma View Post
If anyone know his status, please share it with me.
Last thing I know is that he's finishing his masters thesis, which should be some kind of filter. But of course this means he can't really get much help from other people...

(He told you so in May, incidentally... and believe me, writing a masters thesis takes several months - I should know, mine still isn't finished after several years... )

Also - why don't you just send him a mail to ask him?

np: Retina.IT - Per Assurdo (Semeion)
__________________
now playing: [artist] - [track] ([album])
Leak is offline   Reply With Quote
Old 29th August 2007, 07:11   #3  |  Link
tritical
Registered User
 
Join Date: Dec 2003
Location: MO, US
Posts: 999
Actually, I've just been taking some time away from the forums and avisynth for the summer. However, I have spent a lot of time working on the project mentioned previously. Atm, it is still up in the air as to whether it will be my master's thesis, but the idea definitely works. It has the potential to completely blow away eedi2 in terms of edge directed interpolation and is faster to boot. I am posting here to ask for assistance from anyone who might be interested in helping... specifically, donating computer time to run my training algorithm.

Basically, the idea requires searching very high dimensional spaces using CMAES. I have written heavily optimized code to do this (sse2, multithreaded, etc..), but even with 2 Q6600's running 24/7 it takes about 3 weeks to complete (that means find 'ok' solutions, not the best possible). The overall computation consists of 41 separate problems (meaning each of these 41 can be run on separate computers). To complete (i.e. find an 'ok' solution) one problem in a reasonable amount of time (say 1-3 days) requires something along the lines of an amd x2, amd fx, core 2 duo, core 2 quad, or similar processor. For reference, my Q6600@3.0Ghz can complete an average problem in ~.5-1 days (they vary in complexity). My 1.6 Pentium M laptop can complete an average problem in 8-12 days. The program requires ~150-400 MBs of memory so a minimum of 1GB of RAM would be necessary if you intend to use your computer while the program is running. Since the program uses avisynth, it requires windows as the os (I've only tested it in 32bit windows xp). The cpu must support sse2.

If anyone agrees to help, all I would need to send you is one dll, one exe, one binary file, and two avi files totaling ~40 MBs. The program writes out results and all information needed to restart (in case you need to stop it or the electricity goes out, etc...) as it goes (these files total about 20KB). It also spits out information via OutputDebugString() which is how you would know when it has reached the minimum training criteria. It is set to run at IDLE priority and can be started such that it wont show up in the taskbar or system tray if desired (though would still show up in task manager). Once training is complete you would just need to send me two files totaling 10KB.

If anyone is interested or has questions post here or send me a pm. If you are on irc join #editrain on irc.freenode.net (should be easier to answer questions and help with setup that way). I guarantee that any cpu time donated will be towards a good cause: better intra interpolation for deinterlacing .

Last edited by tritical; 29th August 2007 at 08:03.
tritical is offline   Reply With Quote
Old 29th August 2007, 10:23   #4  |  Link
halsboss
likes to tinker
 
Join Date: Jan 2004
Location: girt by sea
Posts: 635
I'm interested... a 1Gb AMD3500 is no good, then ? My kid's AMD 3000 (no SSE2) would not be a good either I guess.
halsboss is offline   Reply With Quote
Old 29th August 2007, 15:24   #5  |  Link
Terranigma
*Space Reserved*
 
Terranigma's Avatar
 
Join Date: May 2006
Posts: 953
Glad to see that you're ok.
I would love to help, but unfortunately my computer doesn't meet the criteria required for such a tedious task.
Terranigma is offline   Reply With Quote
Old 29th August 2007, 15:42   #6  |  Link
mitsubishi
Registered User
 
Join Date: Sep 2006
Location: UK
Posts: 416
Hi Tritical, I can spare you some CPU cycles, C2D & 2GB. I'm not into gaming right now, so when not encoding or watching HD I have plenty to spare.
mitsubishi is offline   Reply With Quote
Old 29th August 2007, 16:29   #7  |  Link
tritical
Registered User
 
Join Date: Dec 2003
Location: MO, US
Posts: 999
For all those interested, I have put up some initial instructions (text from an irc conversation ) on how to get things going here: http://bengal.missouri.edu/~kes25c/t...structions.txt. This will require some coordination among those participating so that work isn't duplicated. Joining the irc channel mentioned before would work best, but if you just want to communicate with me via pm's or email I can try to keep everything coordinated.

Atm, I am a little behind in generating the initial starting point files, but should have more than enough for everyone by the end of today.

Thanks to everyone helping out.

@halsboss
Unfortunately, neither of those computers would probably work, but thanks a lot for the interest (and Terranigma as well).

Last edited by tritical; 29th August 2007 at 16:32.
tritical is offline   Reply With Quote
Old 4th September 2007, 23:37   #8  |  Link
tritical
Registered User
 
Join Date: Dec 2003
Location: MO, US
Posts: 999
Most of the number crunching is done at this point. There are still a few parts being worked on, but no more left to be started. I just wanted to thank everyone who contributed (sorry if these aren't your doom9 nicks):

checkers
Flaarn
Mitsubishi
junkd
Kentar
Aqualung99
kaptah
ReufToc
ChiDragon
jinkslynx

What would have taken me about 4 weeks to do alone only took 1 . I should be able to release an initial version of the filter here in another two weeks or so (there is still one large problem left whose computation can't be split among computers).
tritical is offline   Reply With Quote
Old 5th September 2007, 00:49   #9  |  Link
Chainmax
Huh?
 
Chainmax's Avatar
 
Join Date: Sep 2003
Location: Uruguay
Posts: 3,103
Sorry to be late, just found out about this. I am expecting to complete an X2 3800+ system with 1GB RAM within a couple of hours, can I still join the party?
__________________
Read Decomb's readmes and tutorials, the IVTC tutorial and the capture guide in order to learn about combing and how to deal with it.

Last edited by Chainmax; 5th September 2007 at 00:59.
Chainmax is offline   Reply With Quote
Old 5th September 2007, 05:49   #10  |  Link
tritical
Registered User
 
Join Date: Dec 2003
Location: MO, US
Posts: 999
Yes, actually. I've decided to break the larger problems up into smaller ones. Which will sacrifice some speed in the final filter operation, but means that the computations can be spread across multiple computers. So anyone who wants to continue helping or wants to join in feel free .
tritical is offline   Reply With Quote
Old 5th September 2007, 08:50   #11  |  Link
Revgen
Registered User
 
Join Date: Sep 2004
Location: Near LA, California, USA
Posts: 1,545
@tritical

Will this be a filter that the university keeps for profit? Or will you post it as open-source?
__________________
Pirate: Now how would you like to die? Would you like to have your head chopped off or be burned at the stake?

Curly: Burned at the stake!

Moe: Why?

Curly: A hot steak is always better than a cold chop.
Revgen is offline   Reply With Quote
Old 5th September 2007, 20:43   #12  |  Link
tritical
Registered User
 
Join Date: Dec 2003
Location: MO, US
Posts: 999
Definitely not for profit, and afaik there is no policy granting the university rights or ownership of the ip or the work itself if I used it as my master's thesis. Admittedly, I haven't looked deeply into it. However, since this is still just a hobby project of mine I can do whatever at this point. My plan is to release an initial, closed source version of the filter here in a few weeks. If it turns out that I am not going to use this for my master's thesis then I'll just make it open source at that point.
tritical is offline   Reply With Quote
Old 6th September 2007, 08:28   #13  |  Link
psme
Registered User
 
Join Date: Mar 2005
Posts: 68
I've a C2D 6600 OC to 3.2G and 2G ram. Let me know if I can be any help.

On the other hand, I know your filter is primary for offline encoding, but my interest is only in realtime DVD playback. Maybe the resulting filter will work as a general film/video deinterlacer. Feed it any (ok, normal 480i/576i) interlaced source and it will automatically detect for 3/2,2/2 or any other pulldown cadence as well as real 60i video content (for the new EDI video deinterlace processing), with a user perfected output framerate (60 for general output with mixed content, 24/48 for film based content etc), all in auto mode, like a real world video deinterlacer in a standalone video processor/scaler box. And it'd be great if all the process can be run in realtime on my C2D at 3.2G. Or I will get a 4 core in a heart beat if needed!

Thanks in advance.

regards,

Li On
psme is offline   Reply With Quote
Old 6th September 2007, 10:08   #14  |  Link
foxyshadis
ангел смерти
 
foxyshadis's Avatar
 
Join Date: Nov 2004
Location: Lost
Posts: 9,413
As long as there's more remaining in http://bengal.missouri.edu/~kes25c/t...o_has_what.txt help is needed. I'm crossing my fingers on speed too.
__________________
There are four boxes to be used in defense of liberty: soap, ballot, jury, and ammo. Please use in that order.
foxyshadis is offline   Reply With Quote
Old 6th September 2007, 16:32   #15  |  Link
psme
Registered User
 
Join Date: Mar 2005
Posts: 68
Ok, download all the files from the ftp...

regards,

Li On
psme is offline   Reply With Quote
Old 6th September 2007, 19:42   #16  |  Link
tritical
Registered User
 
Join Date: Dec 2003
Location: MO, US
Posts: 999
I can give some rough numbers on the speed of the final filter. Running on 720x480 YV12 frames, my 1.6Ghz pentium M laptop gets ~2 frames per second. My Q6600 @ 2.8Ghz gets ~20 frames per second. The speed does depend on the image content or complexity, and I would say those numbers are towards the low end because the sequence I used to test is primarily made up of complex frames. Anyways, it definitely isn't going to set any speed records or run realtime on a typical system. However, it is highly parallelizable and should scale very well to 8 or 16 core systems.

As far as realtime playback and film/video detection, it doesn't interest me that much. So the likelihood that I would create such a filter is pretty small, though not zero .
tritical is offline   Reply With Quote
Old 7th September 2007, 16:32   #17  |  Link
cwk
Registered User
 
Join Date: Jan 2004
Location: earth, barely
Posts: 95
Just for reference purposes Tritical, how fast would eedi2 run in those environments for that file?

Is the quality as good as you were hoping for?

cwk
cwk is offline   Reply With Quote
Old 8th September 2007, 18:12   #18  |  Link
Chainmax
Huh?
 
Chainmax's Avatar
 
Join Date: Sep 2003
Location: Uruguay
Posts: 3,103
Ok, I took stage1-09_8_ffv1.avi/output-stage2-09_8-linear.txt. My AVS is now like this:

Code:
SetMemoryMax(16)

LoadPlugin("C:\tritical\nntrain.dll")

avisource("C:\tritical\tall_ffv1")

nnborder()

mskc = avisource("C:\tritical\stage1-09_8_ffv1.avi")

nntrain(maskc=mskc,restart="C:\tritical\output-stage2-09_8-linear.txt")
There is one thing I'm missing though: where do I set the PATH environment variable?
__________________
Read Decomb's readmes and tutorials, the IVTC tutorial and the capture guide in order to learn about combing and how to deal with it.
Chainmax is offline   Reply With Quote
Old 8th September 2007, 18:17   #19  |  Link
juhok
Registered User
 
juhok's Avatar
 
Join Date: Dec 2005
Posts: 110
Quote:
Originally Posted by Chainmax View Post
There is one thing I'm missing though: where do I set the PATH environment variable?
http://www.siluriformes.net/doom9/path.png
juhok is offline   Reply With Quote
Old 8th September 2007, 18:51   #20  |  Link
Chainmax
Huh?
 
Chainmax's Avatar
 
Join Date: Sep 2003
Location: Uruguay
Posts: 3,103
First try gave an error because I forgot to add the .AVI extension to the first AVISource call . It seems to be working now.

[edit]If I understood correctly, this output:



means it went from iteration 19316 to 19317, is that correct?
__________________
Read Decomb's readmes and tutorials, the IVTC tutorial and the capture guide in order to learn about combing and how to deal with it.

Last edited by Chainmax; 9th September 2007 at 18:05.
Chainmax is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 07:50.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2019, vBulletin Solutions Inc.