Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion. Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules. |
17th July 2007, 06:45 | #381 | Link | |||
Registered User
Join Date: Nov 2003
Location: San Diego, CA
Posts: 325
|
Quote:
Quote:
One question: when the controller marks an agent as "Dead?", is the agent actually dead, or is it still running? Quote:
The negative FPS occurs when the controller doesn't know when the encoding will end or how many frames have been encoded. Due to the way I coded it, the ending of the second pass is actually quite hard to guess. I'll see if there's a way to make it look nicer, anyway. The negative FPS happens on the first pass when x frames are completed, but the controller then realizes that y frames are bad and need to be re-encoded. If y>x, then the number of encoded frames actually decreases. This shouldn't happen very often or for too long. I'm still working on x264farm as fast as I can, even though I don't post as often as I'd like. It usually takes more effort to write responses than to write code.
__________________
"We demand rigidly defined areas of doubt and uncertainty!" - Vroomfondel, H2G2 |
|||
17th July 2007, 08:31 | #382 | Link | ||||
Junglist
Join Date: May 2003
Location: Belarus, Minsk
Posts: 298
|
Quote:
Quote:
Quote:
Quote:
keep it up .. i'm trying to be a support-unit as much as i can
__________________
Rule Number 6: Concentrate!!! (c)Hercules, Disney "I like to build planes.... in the air" (c) some ADV. tutorials How to Setup agent-based encoding with x264farm (the easy way) |
||||
17th July 2007, 08:42 | #383 | Link |
Junglist
Join Date: May 2003
Location: Belarus, Minsk
Posts: 298
|
and i just noticed...
Code:
pc206 1 | 1.28 | Doing frames 18459-18510 (52) pc206 2 | 1.44 | Doing frames 15086-15119 (34) pc82 1 | 3.52 | Doing frames 10785-10839 (55) pc82 2 | 3.92 | Doing frames 32006-32086 (81) both have no processes running (just agent), both encoding "agent-based" both in one room with mine (mine is waay too slow.. but the controller ) but first one is on 100mbit-LAN and the second one is on 1GiGAbit-LAN .... damn... i need all other PCs to gen GIGa aswell
__________________
Rule Number 6: Concentrate!!! (c)Hercules, Disney "I like to build planes.... in the air" (c) some ADV. tutorials How to Setup agent-based encoding with x264farm (the easy way) |
2nd August 2007, 13:51 | #384 | Link |
Junglist
Join Date: May 2003
Location: Belarus, Minsk
Posts: 298
|
Hi guys... we are partially back ...
me - made new meGUI-MOD. omion - made new x264-plainSVN build ... but i've also managed to build cef's sources ... (unfortunately with external pthreads.dll ,.. but it works.. i've tested, for real) 'kay... one after another: meGUI-rev138.x264farm_mod-beta4.by.iB-SpAwN_gUy this one is core version: 0.2.6.1001 x264farm-mod ver: 0.7 Changelog: Updated to x264farm 1.13 commandline parameters. -- help also.. Fixed "job status - error" after successfull encode --sorry no errors additions for now.. (lazy again) next release Fixed - "completeness" runs from 0 to 100% two times --now percentage goes from 0 to 100% ... --from 0 to 50% - first-pass --from 50 to 100% - second-pass --current-pass detection - is present ... currently NOT working: - x264 parameters.. (actually it IS opening (in dev-builds) but i can't manage to get output parameters ...) so it is disabled.. - no x264farm errors handling... and i can't find meGUIs behaviour.. when it starts controller in it's own dir, and when in "output" dir ,... so controller's out-dump.txt will be placed in one of those dirs.. tha LiNK: http://rapidshare.com/files/46519420...-SpAwN_gUy.rar and now for x264-667b-MSVS2005 builds.. omion made, on my request, plainSVN build.. and i figured out how to build my builds ... so,.. my build is MSVS2005 + AQ-PATCH (updated..btw) and requires pthread.dll(included) to be placed near it (i'm working on it..) and it is NOT capable to output .mp4 ('cause no GPAC) theese could be found here: http://rapidshare.com/files/46519549...b-MSVS2005.rar
__________________
Rule Number 6: Concentrate!!! (c)Hercules, Disney "I like to build planes.... in the air" (c) some ADV. tutorials How to Setup agent-based encoding with x264farm (the easy way) |
18th August 2007, 20:31 | #385 | Link |
Registered User
Join Date: Jun 2007
Posts: 1
|
Controller command line options
I have been ripping dvd's from netflix using dvd decrypter and now have almost 2 terabytes of vobs amased on my fileserver. I have started using autogordian knot to compress these ~8gb files to avi's with my new quad core. I have about 10 assorted computers laying around that I have tried running dvd::rip on but had terrible audio sync problems. Gordian works well but takes about 1.5 hours to generate an avi. I am wondering if I can use x264 parallel encoder to re encode these vobs to avi or similar compressed ~700MB format?
So far I installed controller and agent on my quad and generated an .avs file for a collection of vobs. I am wondering about the command line arguments to use to achieve my desired compression. I could be totally off in my assumptions of what this software can do but any help/advice would be great. ~elpierco |
3rd September 2007, 10:46 | #387 | Link |
Junglist
Join Date: May 2003
Location: Belarus, Minsk
Posts: 298
|
(i'm not sure what it really is.. so)
i suppose.. there will be no problem.. IF: you can obtain IP-Adresses of all agents ... for controller-based encodings.. and access to shares(they must be seen from agentPCs) on filestoragePC. 'kay guys i'm back from my vacations.. before i went to germany omion wrote to me, that he has something new to show to us.. and work is in progress... aswell as i got some working sources from berringham(i hope this is correct ) of MeGUI developers..
__________________
Rule Number 6: Concentrate!!! (c)Hercules, Disney "I like to build planes.... in the air" (c) some ADV. tutorials How to Setup agent-based encoding with x264farm (the easy way) |
3rd September 2007, 10:54 | #388 | Link | ||
Junglist
Join Date: May 2003
Location: Belarus, Minsk
Posts: 298
|
Quote:
so maybe, if you still want to encode with DivX and XviD, you should use so other prog (ELDER, i think.. you can find it in theese forums). But if you want to take a step into the Future ... you can start to read throug "HowTo"'s on doom9 MainSite... Quote:
but before that i recomment reading tutorials on how to properly encode video and all those Audio/video sync tutorials.. and so on.. this one is not the easiest way to encode.. but seems to be faster anyway ..
__________________
Rule Number 6: Concentrate!!! (c)Hercules, Disney "I like to build planes.... in the air" (c) some ADV. tutorials How to Setup agent-based encoding with x264farm (the easy way) |
||
3rd September 2007, 15:38 | #389 | Link |
Registered User
Join Date: Aug 2004
Posts: 211
|
There should be no problem using this over a VPN like Hamachi, I guess you could even use it over the plain internet, the thing is that you need to transfer huge amounts of data, so unless all your computers are connected very fast to the net (and in both directions, up/down) it will most probably be faster to encode it on just one machine.
|
12th September 2007, 05:53 | #391 | Link |
Registered User
Join Date: Nov 2003
Location: San Diego, CA
Posts: 325
|
I haven't given up at all. I just completely forgot...
I got another computer a month ago, and I decided to switch around the roles of all my others (my Mac Mini is now my server, my old server is now for backups) and in the middle of all that I decided to reinstall Windows on my only computer I wasn't moving around. So for a while none of my 4 computers worked. I actually just got around to testing out my encoding setup yesterday, and I'm currently trying to get a new build of x264farm for controller-based encoding out. But I should get around to the controller soon. Sorry about the (unusually long) delay...
__________________
"We demand rigidly defined areas of doubt and uncertainty!" - Vroomfondel, H2G2 |
18th September 2007, 00:40 | #392 | Link |
Registered User
Join Date: Apr 2007
Posts: 142
|
I found a small bug. Maybe?
in the agent config.xml, it requires quotes around the path of the location of x264.exe but not for the location of the temp dir. If you put quotes around the temp dir location, it gives an error. As a side note: gigabit network kicks ass. |
18th September 2007, 02:47 | #393 | Link |
Registered User
Join Date: Apr 2007
Posts: 142
|
Came across an annoying bug, my first pass got 75% done (did it correctly). Then the controller started to only give jobs to 1 of the clients; and naturally it was the slowest one (p3 450). So i turned off the agent on that machine. Now its only giving jobs to the 1 agent i'm running on the same machine as the controller.
confuzed. |
18th September 2007, 07:59 | #394 | Link | ||
Registered User
Join Date: Nov 2003
Location: San Diego, CA
Posts: 325
|
Quote:
And yes, gigabit networks are awesome! I got mine up to 105MB/s through Samba once That's faster than most people's hard drives! Quote:
If you want to disable this "feature" (since it seems like it isn't working) you can use "--rethresh 1" on the controller's command-line. This is harder than I thought it would be... the only way I know of to parse .avs files is with avs2yuv through Wine (this is actually why avs2yuv exists) and I keep running into path problems. avs2yuv can't use a Linux-style path, but the controller (if built for Linux) can't use a Windows-style path. Since the controller only needs the avs file to send to avs2yuv, I thought I could avoid this issue. I thought I could just set a Windows-style path on the command line and send it directly to avs2yuv. However, there is one part of the controller that needs access to the avs file: the part that makes a hash of the file to send to the agent for agent-based encoding. Without access to the avs file, there is no way to check if the agent is encoding the correct file, so I'd have to turn off agent-based encoding. I am now coming to the conclusion that you may have EITHER agent-based encoding OR a native Linux build, and I think being able to use agent-based encoding would be faster in almost all cases.
__________________
"We demand rigidly defined areas of doubt and uncertainty!" - Vroomfondel, H2G2 |
||
18th September 2007, 12:39 | #396 | Link | |
Junglist
Join Date: May 2003
Location: Belarus, Minsk
Posts: 298
|
Quote:
the only one who has all IPs is controller. it rules the agents. and calculates what needs to be encoded.
__________________
Rule Number 6: Concentrate!!! (c)Hercules, Disney "I like to build planes.... in the air" (c) some ADV. tutorials How to Setup agent-based encoding with x264farm (the easy way) |
|
18th September 2007, 23:16 | #397 | Link | |
Registered User
Join Date: Nov 2003
Location: San Diego, CA
Posts: 325
|
Quote:
I had an idea to allow multiple "servers" that each agent could connect to, instead of the controller. This would even out the encoding load without using agent-based encoding, but it looks like most people use agent-based, so I gave up on that idea.
__________________
"We demand rigidly defined areas of doubt and uncertainty!" - Vroomfondel, H2G2 |
|
19th September 2007, 00:03 | #398 | Link | |
Registered User
Join Date: Apr 2007
Posts: 142
|
Quote:
Anyway, you mentioned that most people use agent based encoding. I don't because I have no f'ing idea how it works, I read the little explanation in the agents config file, but I am still clueless. From my understanding, the avs, the source, avisynth, and all the filters need to be installed in identical places on all of the agents. I don't want to copy my 40gb source to all of the clients. edit: I suppose this is because all filtering in the avs is done on the controller, but with this as my avs Code:
LoadPlugin("C:\PROGRA~2\GORDIA~1\DGMPGDec\DGDecode.dll") LoadPlugin("C:\PROGRA~2\GORDIA~1\AviSynthPlugins\KernelDeInt.dll") LoadPlugin("C:\Program Files (x86)\AviSynth 2.5\plugins\EEDI2.dll") LoadPlugin("C:\Program Files (x86)\AviSynth 2.5\plugins\TDeint.dll") SetMemoryMax(128) # SOURCE mpeg2source("H:\-=HD Movies=-\Akira (1988)\Akira - 1080i - RAS.d2v") interp = separatefields().selecteven().eedi2() tdeint(edeint=interp) #KernelDeInt(order=1,sharp=true) # CROPPING crop(0,0,1920,1080) # RESIZING LanczosResize(1280,592) edit2: the source is 1080i content. Last edited by legoman666; 19th September 2007 at 00:18. |
|
19th September 2007, 08:24 | #399 | Link | ||
Junglist
Join Date: May 2003
Location: Belarus, Minsk
Posts: 298
|
Quote:
currently i'm stuggling on the field of relative-paths in .d2v, so we had no need to modify it by hands... (you can join me here ) !!!! UPD: Nevermind. this feature will be in the next beta release of DGIndex .... i assume DGMPGDec 1.5.0 beta 3 Quote:
but you can look to "--firstavs and --fastavs" params
__________________
Rule Number 6: Concentrate!!! (c)Hercules, Disney "I like to build planes.... in the air" (c) some ADV. tutorials How to Setup agent-based encoding with x264farm (the easy way) Last edited by SpAwN_gUy; 19th September 2007 at 08:37. |
||
19th September 2007, 08:32 | #400 | Link | |
brontosaurusrex
Join Date: Oct 2001
Posts: 2,392
|
Quote:
|
|
Thread Tools | Search this Thread |
Display Modes | |
|
|