Blue_MiSfit
22nd August 2008, 02:40
Hey all,
So I've run into a workflow management issue at work.
Basically, we've got 80+ encoding cores - 10x 8 core servers racked away in a closet. I manage x264 encodes with our little homebrewed job software that gets installed on each machine. I just RDP into a system, and assign jobs / batches.
It's a daunting task - keeping track of each machine!
What would be absolutely amazing is a system that abstracts these machines, and just generates a cluster. In other words, instead of assigning batches to a machine, I assign them to the cluster, and the workload gets spread evenly. Apple's QMaster can do this (when it works), but of course only supports Apple's codecs (which are useless to me).
Is there anything like this?? ELDER was an early attempt at clustering x264, but I don't recall it being exactly this...
Suggestions???
~MiSfit
So I've run into a workflow management issue at work.
Basically, we've got 80+ encoding cores - 10x 8 core servers racked away in a closet. I manage x264 encodes with our little homebrewed job software that gets installed on each machine. I just RDP into a system, and assign jobs / batches.
It's a daunting task - keeping track of each machine!
What would be absolutely amazing is a system that abstracts these machines, and just generates a cluster. In other words, instead of assigning batches to a machine, I assign them to the cluster, and the workload gets spread evenly. Apple's QMaster can do this (when it works), but of course only supports Apple's codecs (which are useless to me).
Is there anything like this?? ELDER was an early attempt at clustering x264, but I don't recall it being exactly this...
Suggestions???
~MiSfit