DualDVDRB: Tool for DVDRB to support Hyperthreading/dual processors (RC 3)

[Rumbah]

Released RC3
-better detection of the last file to encode, one and two clock modes should work now

It should work in one or two click mode now with every film though I did not have the time to fully test it.

EDIT: Additionally I removed the tray icon, now there shouldn't be all the green Hs in the tray bar anymore.

[robot1]

DualDVDRB does not support Procoder or CCE and I do not know if Procoder or CCE 2.5 are multithreaded. The problem is that I do not have these encoders so developing and testing is a p.i.t.a. . I tried to support Procoder with my Cuttermaran provider and it did not work as intended but I could not find the error because I could not test it myself.
Procoder is multithreaded, anyway it would be interesting to test it with DualDVDRB: with a multicore computer, the global processor usage is 70% while encoding (probably because avisynth isn't multithreaded). If with DualDVDRB we could achieve 100%, there would be a large gain. Procoder and CCE 2.5 share the same .ecl format. If you need help, PM me.

[Rumbah]

Due to popular demand here is an experimental version of DualDVDRB with Procoder support.

File down as it did not work.

I didn't test it at all so there might be bugs or perhaps it doesn't even work at all. As for the other encoders, you have to have 2 different directories with EclPro completely configured. I haven't added Procoder to the GUI yet, so you have to edit the DualDVDRB.ini file like this:
Simply add two lines to the ini file after the [general] line with

Procoder1=path to the first EclPro
Procoder2=path to the second EclPro

For those of you who are not fimiliar with rapidshare, scroll the page down and you'll see a free button on the right. Then you have to enter the letters you see in the graphic and press the download via ... button.
I uploaded it there because I didn't want to upload it on sourceforge as I do not know if this version works.

[DK]

despite the fact that i have chosen eclpro (two different ones) i receive an error message that i will have to configure dualdvdrb first for using procoder

does anyone successfully run procoder?

[jdobbs]

I've experimented with it this a little and I while ProCoder will run more than one instance -- it doesn't seem that ECLPRO will.

[Rumbah]

I've experimented with it this a little and I while ProCoder will run more than one instance -- it doesn't seem that ECLPRO will.
Ok, then my ProCoder support cannot work. So I'll take the file down till the problem is solved.

[robot1]

I've tested DualDVDRB with EclPRO.
It works *ONLY* with Procoder2
I've disabled running multiple istances of Procoder1.5 and Procoder Express, because some parameters are passed with sendkeys for these encoders.

A test is running right now, and Procoder2 seems to work without problems. CPU usage is fully 100% for my Athlon x2.
I will report as soon as I finisth the test.

[Edit]
I wat too fast.
I've received the error after encoding 6 segments :-(
I will post an updated version soon.

[robot1]

Here is a build to test Procoder2 with DualDVDRB, as soon as a mod approves it.

@Rumbah
It's my first test with DualDVRB.
You've done a great job!

[Sophoclesdrf]

I would love to give DualRB and procoder a test drive. I would like to thank robot1 and Rumbah for their efforts.

[l8nights]

thnx 4 that robot1 I am setting it up right now!

[Rumbah]

Now here is the Procoder test version with GUI configuring.

Link removed. New version a few posts down.

This time you can configure it by simply double click the DualDVDRB.exe file like for the other encoders.

You have to use the EclPro version posted by robot1 three posts up.
As for the other encoders, you have to have 2 different directories with EclPro completely configured.

[DK]

thanx to both robot1 and rumbah for your efforts


i am wondering about this:
firing up dualdvdrb and selecting the two eclpro paths i get this:
http://img372.imageshack.us/img372/851/dual13sy.th.png (http://img372.imageshack.us/my.php?image=dual13sy.png)


now clicking ok and re-running dualdvdrb in order to check results in this:
http://img394.imageshack.us/img394/9724/dual29sq.th.png (http://img394.imageshack.us/my.php?image=dual29sq.png)


i still receive this message:
http://img389.imageshack.us/img389/5879/conf6ne.png (http://imageshack.us)

[Rumbah]

Thanks for the good report, I found the error at once:
Too much copy and paste...

Here is the version that should fix this:
http://rapidshare.de/files/12124445/DualDVDRB_Procoder_test_3.zip.html

[DK]

thanx a ton rumbah

the latest release fixed the problems and calls two different versions of procoder now

much appreciated!

[Sophoclesdrf]

The problem does seem to be fixed. I'm encoding right now and procoder is showing that two instances are running at once. I'm using mastering quality so I suspect speeds will vary but it is working.

A big hand clap goes to Rumbah and Robot1 and let's not forget jdobbs who follows and is keeping pace with it all.

[robot1]

Anybody could post the encoding time saved with DualDVDRB and Procoder2 with a multicore CPU?

[Sophoclesdrf]

Be glad to but I'm encoding a Japanese Anime for my son and they're usually a bit slower to encode. I'll show a screen shot of the result.


I'm running a dual core Opteron 175 2.2 Ghz overclocked to 2.67 Ghz.

[l8nights]

I was just about to post an error when I got here dk had beat me to it!

good catch like alway's I'm one step behind!Hell I turned my back and there was a fix!
good job Rumbah let's all go try to get microsoft to address something like that! lol

[Sophoclesdrf]

Here is my first complete encode and all went well. The final file size came in at 4.31 Ghz. My time is off a litte because during the last few frames procoder somehow was paused and I'm not sure for how long but it was less than 10 minutes. I don't know how the last part of the encode became paused, I could have caused it while responding to PMS at dvdhounds.com.


http://img203.imageshack.us/img203/7285/rebuild121ib.jpg

[J-Wo]

Even though it has been previously stated that CCE supports multithreading, I never get 100% cpu usage with one instance of CCE on my AMD Opteron 165 (I'm using CCE 2.70.02). So I think adding CCE support to this program would be a great idea.

[jptheripper]

i agree completely. there is the potential that cce support this way could be much more efficient

[jdobbs]

Unfortunately CCE will not allow two instances. Try it. If you load one and then try to load another (even if you rename it and put it in a different directory) it just allows one to run.

There may be a way around it, but I haven't found it yet.

[Top_Cat]

I'm using HCBatch and created two folders each with a copy of HCBatch in them. However when I try to encode it lauches both copies of HCBatch but the encoding progress bar only moves on one...

I've checked task manager and both copies of HCBatch are utilising the CPU, but only one seems to be doing anything. Any advice?

Thanks

--------------------------------------------------------
I have an AMD X2 processor and running WinXP 64, and DVD Rebuilder 1.01 Pro, DVDRB RC3.

[SpazzHH]

Upgrade to the latest version of RB and see what happens.

[l8nights]

with newest (beta) version of eclpro and latest update to gui of dual dvdrb

I'm getting a rare error when using procoder2 stating that "the settings to this preset are invalid" this results in the m2k not being created! and when encode completes the bar say's 99.8% this happened w/ valiant!
so I did the fog and this happened to a couple instances so I aborted!

the gains w/ procoder2 are little to none using ht!
so I'm wondering if any body w/ a true dual core is getting these errors

both the fog & valiant are R1!

[Top_Cat]

Upgrade to the latest version of RB and see what happens.

Thanks, that helped the problem(ish). When both HCbatch were opened initially they were both encoding (great), however now that first .avs chunk is done and the HCbatch closes and reopens for the next .avs chunk its now back to how it was before with the encoding progress bar only moves on one.

[Rumbah]

Thanks, that helped the problem(ish). When both HCbatch were opened initially they were both encoding (great), however now that first .avs chunk is done and the HCbatch closes and reopens for the next .avs chunk its now back to how it was before with the encoding progress bar only moves on one.
Sorry, but I don't know what's causing this problem. DualDVDRB starts two encoders and I don't know why one should stop. Perhaps you could try the latest Avisynth and Dgdecode and see if that helps.
I'm getting a rare error when using procoder2 stating that "the settings to this preset are invalid" this results in the m2k not being created!
I think that's a problem of EclPro. Perhaps it'll help robot1 if you save the ecl file when it happens so that he can take a look at it.
and when encode completes the bar say's 99.8% this happened w/ valiant!
Is this only cosmetic or did it cause an error?

[robot1]

the gains w/ procoder2 are little to none using ht!
so I'm wondering if any body w/ a true dual core is getting these errors

Procoder2 is a multithreaded application, so it uses HT.
Anyway with a true dualcore there is a large gain. I've run one test, and the gain is about 35%.

[Sophoclesdrf]

I'm using an Opteron 175@2.67 Ghz and it's opening everything just fine. Did you aim both copies of eclpro to Procoder2 and then RB to say Eclpro1? I think that it has to be in setup. When I did my setup I deleted the setup INI file and the previous version of eclpro that I was using and redid everything from scratch.

[l8nights]

set-up is correct it has happened rarely but has not been static ie..the same place,segment of the same movie!

It makes since that this is an eclpro realted error that was my first thought, one ? : how do I save the eclfile?

[Sophoclesdrf]

I've done two movies so far with success but I'm not so sure that there are any speed gains to be had with dual core. This might be a situation where an Intel dual core with hyper threading might benefit.

[Rumbah]

The ecl file is located in the EclPro directory.

[Rockas]

Here's the result I got from a HC Dual test.
The computer I used on my test was my laptop... P4 HT 3.2G with 1GB Ram

I authored a DVD with 91 segments and with a GB of size.
Times

HC No Dual = 26 minutes

HC With Dual = 20 minutes

CCE SP Trial 2.70.02.04 (two passes CQM ON) = 17 minutes

Looks like HC is getting closer :)

... by the way... I made the test while I was working with AutoCAD... this may have slowdown a little ;)

[J-Wo]

First time trying DualDVDRB with Procoder2, using the beta EclPro from Robot1 and DVD-RB Pro 1.06.1 (fresh full install from .exe). I'm getting the same error as l8nights where my overall progress bar says 96.1% and Procoder gives the error message "The settings of this preset are invalid". This happens when RB's Program Status reads "Creating M2V for VTS_01 segment 23", which is the last segment, but since I left my encode to run overnight I'm not exactly sure when it happens. I'm guessing it's after the encode is done because the final .m2v file appears fine. After I click OK, RB begins the rebuild process and completes without problems. The resulting dvd files appear to play fine in powerdvd.

Here is a copy of my ecl file. Please note that I am using a custom matrix from RME, which is the Medium Low (2500-3200) matrix.

; Cinema Craft Encoder SP -- Encoder Control List
; Created by DVD Rebuilder

[item]
title=V01002300004006
aud_out=0
vaf_file=E:\BABYLON5_SEASON3_DISC3\D2VAVS\V01002300004006.vaf
aud_file=E:\BABYLON5_SEASON3_DISC3\D2VAVS\V01002300004006.mpa
file_focused=0
packet_size=2048
width=720
height=480
frame_rate_idx=1
cbr_brate=6000
vbr_brate_avg=2296
vbr_brate_min=0
vbr_brate_max=6389
seq_endcode=1
dvd=0
half_width=0
half_height=0
lum_level=0
adjust_q_matrix=0
aspect_ratio=3
gop_m=3
gop_nm=5
gop_hdr=15
seq_hdr=1
all_closed_gop=0
fix_gop_length=0
samples_per_sec=44100
stereo=2
brate_idx=7
crc=1
progressive=0
alternate_scan=1
intra_dc_prec=2
intra_dc_precision_9_max=113
intra_dc_precision_10_max=113
top_first=1
offset_line=0
encode_mode=0
vmode=2
fast_mode=0
quality_prec=25
timecode=0x0000000
vid_file0=E:\BABYLON5_SEASON3_DISC3\D2VAVS\V01002300004006.m2v
vid_file1=E:\BABYLON5_SEASON3_DISC3\D2VAVS\V01002300004006.m2v
vid_out=1
vaf_out=1
opv_q_factor=20
opv_brate_min=0
opv_brate_max=6389
vbr_bias=25
vbr_pass=1
use_filter=0
filter_val=6
non_linear=1
mpeg1=0
mpeg1_cps=1
qmat_idx=-1
q_scale_type=1
qmat=
08 12 13 14 15 16 19 22
12 13 14 15 16 19 22 26
13 14 15 16 19 22 26 32
14 15 16 19 22 26 32 41
15 16 19 22 26 32 41 53
16 19 22 26 32 41 53 70
19 22 26 32 41 53 70 94
22 26 32 41 53 70 94 127
12 12 13 14 15 16 19 22
12 13 14 15 16 19 22 26
13 14 15 16 19 22 26 32
14 15 16 19 22 26 32 41
15 16 19 22 26 32 41 53
16 19 22 26 32 41 53 70
19 22 26 32 41 53 70 94
22 26 32 41 53 70 94 127

[file]
name=E:\BABYLON5_SEASON3_DISC3\D2VAVS\V01002300004006.avs
frame_first=0
frame_last=11815
encode_first=0
encode_last=11815
I should also mention that my system is an Opteron 165 @ 2.57GHz. I'll have to do another test encode to determine if there is any speed increase with this or not.

[J-Wo]

Well here are my results from a mini test clip of 607Mb in size (13min). I could not reproduce the error message I reported above. This clip contained only two cells so was truly a short test. I used RB-Opt after the prepare phase to adjust the bitrates of this small clip to correspond with those from the entire movie. My system is an AMD Opteron 165 @ 2.57GHz with 1MB ram.

Without DualDVDRB:[22:56:35] One Click encoding activated...
[22:56:35] Phase II ENCODING started
- Creating M2V for VTS_01 segment 0
- Creating M2V for VTS_01 segment 1
[23:14:49] Phase II ENCODING completed in 18 minutes.
[23:14:49] Phase III, REBUILD started.
- Copying IFO, BUP, and unaltered files...
- Processing VTS_01
- Reading/processing TMAP table...
- Rebuilding seg 0 VOBID 1 CELLID 1
- Rebuilding seg 1 VOBID 1 CELLID 2
- Updating NAVPACKS for VOBID_01
- Updated VTS_C_ADT.
- Updated VTS_VOBU_ADMAP.
- Updated IFO: VTS_01_0.IFO
- Updating TMAP table...
- Correcting VTS Sectors...
[23:16:02] Phase III, REBUILD completed in 2 minutes.

Done.
[23:16:02] PREPARE/ENCODE/REBUILD completed in 20 min.
And with DualDVDRB:[23:21:33] One Click encoding activated...
[23:21:33] Phase II ENCODING started
- Creating M2V for VTS_01 segment 0
- Creating M2V for VTS_01 segment 1
[23:36:48] Phase II ENCODING completed in 15 minutes.
[23:36:48] Phase III, REBUILD started.
- Copying IFO, BUP, and unaltered files...
- Processing VTS_01
- Reading/processing TMAP table...
- Rebuilding seg 0 VOBID 1 CELLID 1
- Rebuilding seg 1 VOBID 1 CELLID 2
- Updating NAVPACKS for VOBID_01
- Updated VTS_C_ADT.
- Updated VTS_VOBU_ADMAP.
- Updated IFO: VTS_01_0.IFO
- Updating TMAP table...
- Correcting VTS Sectors...
[23:37:57] Phase III, REBUILD completed in 1 minutes.

Done.
[23:37:57] PREPARE/ENCODE/REBUILD completed in 16 min.Depending on how you do the math, that's about a 16-20% increase in speed! I was pretty surprised because I almost expected no speed improvement on an AMD dual core system but guess I was wrong.

[SpazzHH]

Here are some results from two different machines(both with 1 gig Ram) encoding Traffic - R1(NTSC) with HC encoder. One set of results using Dual instances, one set using only single instance. I did a complete backup of the disc, keeping all extras.

P4 Prescott 3.2 w/HT

Single - 219 minutes
Dual - 179 minutes


Pentium D 830 3.0

Single - 217 minutes
Dual - 127 minutes

Clearly, there are gains with both using Dual instances, but the true Dual core of the Pentium D really shines under these circumstances.

[Sophoclesdrf]

My system:
Asus A8N-SLI Deluxe
AMD 64 Opteron 175 2.2 GHZ
currently@ 2.67 GHZ
2 Gigs dual channel Corsair XMS DDR 433
PC3200LLC2 PRO mem timings of 2-3-2-6
Sapphire 256 meg X800 Pro ViVo
Seagate 250 gig SATA150 NCQ hard disk
Plex 712 and 716 DVD Roms
Creative Audigy2 platinum
And same old attitude!

Normal setting running one instance of Procoder 2:

http://img300.imageshack.us/img300/3830/proccodernorm18if.jpg


Multi processor setting using two instances of Procoder 2:


http://img431.imageshack.us/img431/3919/procoderdual15bl.jpg