Hardware considerations for BD Rebuilder

[QBhd]

Wow... That RAID Volume of SSD's is sick fast! Nice rig.

QB

[blusky]

Wow... That RAID Volume of SSD's is sick fast! Nice rig.

QB

Thanks QBhd,
This is my first build. Took a while. I did enjoy building it. I am curious to see what it can do with BD Rebuilder.

[QBhd]

Quick question... do you have the AX1200i and the H100i connected? As an owner of an H80i I have always been curious what the Corsair Link software shows in that situation

QB

ps... it's just QB (couldn't just use QB as a username so I came up with QBhd)

[RobertM]

I am curious to see what it can do with BD Rebuilder.

Whatever it does, it'll do it fast! :)

[blusky]

Whatever it does, it'll do it fast! :)

Thanks RobertM. I did follow the setup 3 that you had suggested.

Ran into some interesting issues with Raid 0 drivers for the motherboard. Though trial and error finally found the driver that would work at a reasonable speed with the SSD's. Lucky for me with the help of a few friends and some forums I was able to get it to work. Still figuring my way around Windows 8 but in time that will come. Just need to do a few more tweak's and I will start setting up BD Rebuilder. I have to do a little reading first to make sure I setup everything correctly.

[Ch3vr0n]

If you're missing your "classic" start bar & start menu there are several tools outthere that can do the trick and bring those items back ;). even booting into the classic desktop mode and bypassing that stupid metro style start screen).

[blusky]

If you're missing your "classic" start bar & start menu there are several tools outthere that can do the trick and bring those items back ;). even booting into the classic desktop mode and bypassing that stupid metro style start screen).

Thanks Ch3vr0n. I am giving Windows 8 a chance to see if I get used to it if not Classic Desktop mode here I come.

[blusky]

On another note. Should I use BD Rebuilder Pro??

Quite a few years ago I gave a donation for the Pro version will it still work on another computer??

[jdobbs]

On another note. Should I use BD Rebuilder Pro??

Quite a few years ago I gave a donation for the Pro version will it still work on another computer??There's no such thing. There is a "DVD Rebuilder Pro" -- but that is for DVDs, not BDs. BD Rebuilder is available only in the freeware version and is completely dependent upon voluntary donations (as opposed to a "Pro" version).

Both DVD Rebuilder and BD Rebuilder should work fine.

[blusky]

There's no such thing. There is a "DVD Rebuilder Pro" -- but that is for DVDs, not BDs. BD Rebuilder is available only in the freeware version and is completely dependent upon voluntary donations (as opposed to a "Pro" version).

Both DVD Rebuilder and BD Rebuilder should work fine.

Ok great, Understood. I have been looking around, can you please point me to the location of the current BD Rebuilder post that has all the setup and supporting program installs that are needed??

Thanks jdobbs.

[jdobbs]

Ok great, Understood. I have been looking around, can you please point me to the location of the current BD Rebuilder post that has all the setup and supporting program installs that are needed??

Thanks jdobbs.Everything you need is right here (http://forum.doom9.org/showthread.php?t=143716). Make sure you install the exact versions that are linked in that post. Also avoid installing any "codec packs" other than FFDSHOW (which is linked).

[blusky]

Everything you need is right here (http://forum.doom9.org/showthread.php?t=143716). Make sure you install the exact versions that are linked in that post. Also avoid installing any "codec packs" other than FFDSHOW (which is linked).

Thank you very much Jdobbs. Will get it setup tonight and give it a shot.

[blusky]

here is some info for those that are interested:

I used BD Rebuilder to encode Men in Black 3:
I used High Quality 2 pass, everything seemed to work great:
This is what I received from task manager:

1st pass processor averaged about 80% utilization
here is the 2nd pass Data from Task Manager:

CPU

Intel(R) Core(TM) i7-3930K CPU @ 3.20GHz

Maximum speed: 3.20 GHz
Sockets: 1
Cores: 6
Logical processors: 12
Virtualization: Enabled
L1 cache: 384 KB
L2 cache: 1.5 MB
L3 cache: 12.0 MB

Utilization 100%
Speed 3.75 GHz
Up time 0:01:38:13
Processes 54
Threads 718
Handles 16435

The total time BD Rebuilder took to encode was 1:23 . It reduced the file size from 26.88GB to 4.36GB

Here is the log:

04/27/13] BD Rebuilder v0.43.06 (beta)
[15:46:22] Source: MEN_IN_BLACK_3_00800
- Input BD size: 26.88 GB
- Approximate total content: [01:45:50.385]
- Target BD size: 4.36 GB
- Windows Version: 6.2 [9200]
- MOVIE-ONLY mode enabled
- Auto Quality: High Quality (Default), Two Pass
- Decoding/Frame serving: DirectShow
- Audio Settings: AC3=0 DTS=0 HD=0 Kbs=640
[15:46:22] PHASE ONE, Encoding
- [15:46:22] Processing: VID_00800 (1 of 1)
- [15:46:22] Extracting A/V streams [VID_00800]
- [15:49:14] Reencoding video [VID_00800]
- Source Video: MPEG-4 (AVC), 1920x1080
- Rate/Length: 23.976fps, 152,257 frames
- Bitrate: 4,681 Kbs
- [15:49:14] Reencoding: VID_00800, Pass 1 of 2
- [16:14:21] Reencoding: VID_00800, Pass 2 of 2
- [17:07:13] Video Encode complete
- [17:07:13] Processing audio tracks
- Track 4352 (eng): Reencoding audio to AC3...
[17:09:17]PHASE ONE complete
[17:09:17]PHASE TWO - Rebuild Started
- [17:09:17] Rebuilding AVCHD file Structure
[17:09:52] - Encode and Rebuild complete
[17:09:52] JOB: MEN_IN_BLACK_3 finished.


Any suggestions or comments would be appreciated. Thanks to all who contributed to this post . It did help me out a lot.
:)

[jdobbs]

Try setting:

MULTIPROCESS=4

in the Config/INI file, and see how that affects it.

[blusky]

Try setting:

MULTIPROCESS=4

in the Config/INI file, and see how that affects it.

I looked in the Config/INI file and did not see that option but I believe I Just need to add MULTIPROCESS=4 anywhere in the options area of the
Config/INI ??



I did find this great explanation on what it does:

"Currently multi-processing is enabled via a "hidden" switch in the CONFIG/INI file (accessible from the FILE menu). After it has been tested more thoroughly it will be added to the SETUP dialog. For now you must add it to the "[Options]" area of the configuration file like this:

MULTIPROCESS=n



"n" represents a number between 0 and 16. Setting MULTIPROCESS to "0" (the default) disables all multiprocessing and BD Rebuilder continues to operate the way it did in previous releases. Setting it to "1" enables automatic mode -- in this mode BD Rebuilder will use a number of concurrent processes it believes to be most optimal for the number of processors and memory present on your computer. Setting MULTIPROCESS to a greater value indicates "manual mode". BD-RB will run the number of concurrent X264 processes you've specified. Please note that currently anything over 4 is probably likely to show diminished performance. I would also recommend you avoid more than 2-3 if you have 4GB or less of RAM memory on your system. You might find yourself chugging along very slowly if memory your system starts swapping to disc.
If reports indicate a benefit or if system performance Increases dictate, I will increase the maximum – but that’s unlikely for a while."



The quality of the video is amazing!

Cannot tell difference between original and encoded disk. I really tried looking up close. Amazing. Thanks for sharing your work JDobbs.
I sent a little to help out.:)

[RobertM]

The total time BD Rebuilder took to encode was 1:23 . It reduced the file size from 26.88GB to 4.36GB

That's way fast! Could you repeat that, same settings but for a target size of BD-25, so that I can compare it to my typical results?

[blusky]

That's way fast! Could you repeat that, same settings but for a target size of BD-25, so that I can compare it to my typical results?

Sure RobertM, will do.
Going out to eat now when I return it should be done. I will let you know.

[Mark_Venture]

I'd be curious how it compares to mine... If I gave you my settings (I only change a couple from default), would you mind trying again so I can compare?

Here is excerpt of log when I did "Alt Movie Only" to 1920x1080, intact audio, MKV, with a 8096 size target...

[01/29/13] BD Rebuilder v0.42.08 (beta)
[16:58:14] Source: MEN_IN_BLACK_3_00800
- Input BD size: 26.88 GB
- Approximate total content: [01:45:50.385]
- Windows Version: 6.1 [7601]
- MOVIE-ONLY/ALTERNATE OUTPUT mode enabled
- Mode: MKV Container, 1920x1080, Intact Audio
- Decoding/Frame serving: DirectShow
- Audio Settings: AC3=0 DTS=0 HD=0 Kbs=640
[16:58:14] PHASE ONE, Encoding
- [16:58:14] Processing: VID_00800 (1 of 1)
- [16:58:14] Extracting A/V streams [VID_00800]
- [17:15:17] Reencoding video [VID_00800]
- Source Video: MPEG-4 (AVC), 1920x1080
- Rate/Length: 23.976fps, 152,257 frames
- Bitrate: 8,469 Kbs
- [17:15:17] Reencoding: VID_00800, Pass 1 of 2
- [17:53:43] Reencoding: VID_00800, Pass 2 of 2
- [18:32:28] Video Encode complete
- [18:32:28] Processing audio tracks
[18:32:28]PHASE ONE complete
[18:32:28]PHASE TWO - Rebuild Started
- [18:32:28] Building ALTERNATE OUTPUT Structure
[18:38:33] - Encode and Rebuild complete
[18:38:33] JOB: MEN_IN_BLACK_3 finished.

so like 1hr 41 min?

[RobertM]

Sure RobertM, will do.
Going out to eat now when I return it should be done. I will let you know.

BTW, congrats on getting the build working. I know that you had a few bumps along the way. Without the m/b issue it likely would have been fairly straightforward. In the end, I'm sure it is quite satisfying knowing that you put it all together yourself. :)

[blusky]

BTW, congrats on getting the build working. I know that you had a few bumps along the way. Without the m/b issue it likely would have been fairly straightforward. In the end, I'm sure it is quite satisfying knowing that you put it all together yourself. :)

Yes , it was quite satisfying , since I have never built one before and I end up building a gaming rig as my first one. That's me , always bite more off than I can chew.

Anyway here is the encode log for the BD-25

[04/27/13] BD Rebuilder v0.43.06 (beta)
[20:21:33] Source: MEN_IN_BLACK_3_00800
- Input BD size: 26.88 GB
- Approximate total content: [01:45:50.385]
- Target BD size: 22.95 GB
- Windows Version: 6.2 [9200]
- MOVIE-ONLY mode enabled
- Auto Quality: Good (Very Fast), ABR
- Decoding/Frame serving: DirectShow
- Audio Settings: AC3=0 DTS=0 HD=0 Kbs=640
[20:21:33] PHASE ONE, Encoding
- [20:21:33] Processing: VID_00800 (1 of 1)
- [20:21:33] Extracting A/V streams [VID_00800]
- [20:24:24] Reencoding video [VID_00800]
- Source Video: MPEG-4 (AVC), 1920x1080
- Rate/Length: 23.976fps, 152,257 frames
- Bitrate: 27,123 Kbs
- [20:24:24] Reencoding: VID_00800, Pass 1 of 1
- [20:49:39] Video Encode complete
- [20:49:39] Processing audio tracks
- Track 4352 (eng): Keeping original audio
[20:49:39]PHASE ONE complete
[20:49:39]PHASE TWO - Rebuild Started
- [20:49:39] Rebuilding BD file Structure
[20:52:34] - Encode and Rebuild complete
[20:52:34] JOB: MEN_IN_BLACK_3 finished.


Well, it took about :31 minutes to encode

Tomorrow I will do as Jdobbs said and try it with this setting:

MULTIPROCESS=4

I assume I just add it to the the "[Options]" area of the configuration file ??

Thanks RobertM

[QBhd]

I may have to try BD-RB just to compare my results with you boys... I am MeGUI guy right now, but it seems BD-RB has changed quite a bit since the last time I tried it. My beast is a pretty good encoder, I usually do these settings in MeGUI: Authoring a professional Blu-ray Disc with x264 (http://www.x264bluray.com/home/1080i-p) but set a few things different for BD-5/9 with this info: Encoding Video for Blu-Ray using H264/AVC (http://forum.doom9.org/showthread.php?t=154533). Encoding an ~1 hour TV episode from a .TS to a 1080p BD-5 runs at ~8.5 FPS (or less than 3 hours) for the second pass (DGIndex is used to index the mepg2 stream and it is set to the best quality settings as well, so that probably slows things down a wee-bit too). Although I am sure not too many people do this... It will be interesting to see what my machine can do compared to you guys with BD-RB.

Also... a full movie to a BD-5 is pretty low on the bitrate side for 1080p. I am sure quality loss is noticeable if you have a properly claibrated TV to watch it on. However a BD-9 easily fits a near lossless (at least in terms of naked eye analysis) re-encode... I have lent my discs to friends and they could not believe it was not a Blu-Ray disc.

QB

ps. blusky, you never did answer my question regarding the AX-1200i and the H100i and if you have them linked

[blusky]

I'd be curious how it compares to mine... If I gave you my settings (I only change a couple from default), would you mind trying again so I can compare?

Here is excerpt of log when I did "Alt Movie Only" to 1920x1080, intact audio, MKV, with a 8096 size target...

[01/29/13] BD Rebuilder v0.42.08 (beta)
[16:58:14] Source: MEN_IN_BLACK_3_00800
- Input BD size: 26.88 GB
- Approximate total content: [01:45:50.385]
- Windows Version: 6.1 [7601]
- MOVIE-ONLY/ALTERNATE OUTPUT mode enabled
- Mode: MKV Container, 1920x1080, Intact Audio
- Decoding/Frame serving: DirectShow
- Audio Settings: AC3=0 DTS=0 HD=0 Kbs=640
[16:58:14] PHASE ONE, Encoding
- [16:58:14] Processing: VID_00800 (1 of 1)
- [16:58:14] Extracting A/V streams [VID_00800]
- [17:15:17] Reencoding video [VID_00800]
- Source Video: MPEG-4 (AVC), 1920x1080
- Rate/Length: 23.976fps, 152,257 frames
- Bitrate: 8,469 Kbs
- [17:15:17] Reencoding: VID_00800, Pass 1 of 2
- [17:53:43] Reencoding: VID_00800, Pass 2 of 2
- [18:32:28] Video Encode complete
- [18:32:28] Processing audio tracks
[18:32:28]PHASE ONE complete
[18:32:28]PHASE TWO - Rebuild Started
- [18:32:28] Building ALTERNATE OUTPUT Structure
[18:38:33] - Encode and Rebuild complete
[18:38:33] JOB: MEN_IN_BLACK_3 finished.

so like 1hr 41 min?

Mark_Venture, no problem. Let me have your settings and I will try tomorrow and let you know.

[blusky]

I may have to try BD-RB just to compare my results with you boys... I am MeGUI guy right now, but it seems BD-RB has changed quite a bit since the last time I tried it. My beast is a pretty good encoder, I usually do these settings in MeGUI: Authoring a professional Blu-ray Disc with x264 (http://www.x264bluray.com/home/1080i-p) but set a few things different for BD-5/9 with this info: Encoding Video for Blu-Ray using H264/AVC (http://forum.doom9.org/showthread.php?t=154533). Encoding an ~1 hour TV episode from a .TS to a 1080p BD-5 runs at ~8.5 FPS (or less than 3 hours) for the second pass (DGIndex is used to index the mepg2 stream and it is set to the best quality settings as well, so that probably slows things down a wee-bit too). Although I am sure not too many people do this... It will be interesting to see what my machine can do compared to you guys with BD-RB.

Also... a full movie to a BD-5 is pretty low on the bitrate side for 1080p. I am sure quality loss is noticeable if you have a properly claibrated TV to watch it on. However a BD-9 easily fits a near lossless (at least in terms of naked eye analysis) re-encode... I have lent my discs to friends and they could not believe it was not a Blu-Ray disc.

QB

ps. blusky, you never did answer my question regarding the AX-1200i and the H100i and if you have them linked

Thanks QBhd for your response. Well after I reecoded I could not tell original from BD-5. Looked pretty good to me but I am not an expert.

You asked me if I have the Ax-1200I and the H100i linked. I do have them linked but have not downloaded the software yet. From what I have read I have to turn off the the Motherboard temp sensors before I install the Corsair Link dashboard software.

[Mark_Venture]

Mark_Venture, no problem. Let me have your settings and I will try tomorrow and let you know.

Encoder settings = Normal Priority

Under the MODE pull down, three are checked...
"Quicker" encode for extras
Movie Only backup
Alternate Movie Only Output

On the Alt Movie-Only Output screen, I check "MKV Container, 1920x1080, Intact Audio" and Two Pass Target size (MB), I set to 8096.

And my setup screen is attached to this post...


If there is any way to test a single hard drive being the source (where BD is ripped to) as well as working path, in addition to your SSD setup, I'd appreciate it. Since my rig uses WD Black 1TB as both the source and working paths, I'm curious to understand the speed improvements your SSD might make over traditional HD, as well as newer CPU and video card over my 2009 vintage gear.

thank you!!

for comparison my rig is...
Intel Core i7-860 Lynnfield 2.8GHz 8MB L3 Cache LGA 1156 95W Quad-Core Processor
ASUS P7P55D Deluxe LGA 1156 Intel P55 ATX Motherboard
8 gig DDR3 - Qty2 of Corsair XMS3 CMX4GX3M2A1600C8
Antec Nine Hundred II case with Antec EarthWatts EA750 power supply
EVGA GeForce GTX 275 896-P3-1170-AR
QTY1 - 250Gb Samsung 840 SSD (OS)
Qty 1 - 1Tb Western Digital Black SATA (holds page file, Bluray rips, and BD-Rebuilder's work folder)
Qty 2 - 1Tb Western Digital Caviar GP SATA (WD10EADS and WD10EADS)
Qty 2 - 2Tb Western Digital Caviar GP SATA (WD20EARS and WD20EARX)
Lite-On SOHD-167T DVDrom
LG BH08LS20 BD-RW/DVD-RW

except for a few of the hard drives, its all from Sept 2009

[jdobbs]

Tomorrow I will do as Jdobbs said and try it with this setting:

MULTIPROCESS=4

I assume I just add it to the the "[Options]" area of the configuration file ??

Thanks RobertM Yep. Hidden options aren't there until you add them. You can open the config/INI from the FILE menu within BD-RB and just type it in and then save.

[QBhd]

blusky... just curious where you read you need to turn off the MB sensors. I am not saying it's wrong, just looking for knowledge since I own an H80i myself and any new PSU would be an i version from Corsair... I love Corsair PSU's

QB

[RobertM]

Hi Blusky,

I don't have 'Men in Black 3' for a direct comparison, but I recently did 'Escape from LA' which is similar in original size and play length. I re-ran it using the same settings as your latest MIB3 test. Here's what I got:


[04/27/13] BD Rebuilder v0.43.06 (beta)
[23:35:36] Source: JC_ESCAPE_FROM_LA_00001
- Input BD size: 28.69 GB
- Approximate total content: [01:40:42.036]
- Target BD size: 22.95 GB
- Windows Version: 6.1 [7601]
- MOVIE-ONLY mode enabled
- Quality: Good (Very Fast), ABR
- Decoding/Frame serving: DirectShow
- Audio Settings: AC3=1 DTS=1 HD=0 Kbs=640
[23:35:39] PHASE ONE, Encoding
- [23:35:39] Processing: VID_00001 (1 of 1)
- [23:35:39] Extracting A/V streams [VID_00001]
- [23:40:47] Reencoding video [VID_00001]
- Source Video: MPEG-4 (AVC), 1920x1080
- Rate/Length: 23.976fps, 144,864 frames
- Bitrate: 29,544 Kbs
- [23:40:47] Reencoding: VID_00001, Pass 1 of 1
- [00:15:07] Video Encode complete
- [00:15:07] Processing audio tracks
- Track 4352 (eng): Keeping original core audio
[00:15:14]PHASE ONE complete
[00:15:14]PHASE TWO - Rebuild Started
- [00:15:14] Rebuilding BD file Structure
[00:21:21] - Encode and Rebuild complete
- Computer SHUTDOWN initiated.


The 4 main points of comparison are:


You Me
Extraction 2:51 4:52
Video encode 25:15 34:20
Rebuild 2:55 6:07
Total 31:01 45:45


The extraction and rebuild phases are largely influenced by the speed of storage devices, and here your SSD array is flying compared to my HDD array. Roughly twice as fast.

The encode phase is almost entirely governed by processor speed. You're running roughly 1/3 faster than my i7-950. My normal encodes are 'High quality, 2-pass', which take much longer than this 'good, 1-pass' test. So, for the type of encodes that I do, your faster processor would account for the majority of speed increases (maybe shave 1 hr off the job!!) while the SSD array would give a more modest improvement (5 or 6 minutes).

One funny thing that I noticed is that in my job it took about 7 seconds to 'think about' keeping the original core audio, while in your job it was virtually instantaneous. Not sure what that is about :/

[jdobbs]

Not that long ago I would have thought it to be a dream to do a complete reencode & rebuild in 46 mins. Remarkable.

[blusky]

Mark_Venture, as soon as I have second I will put in your settings and give it a try.

RobertM, those are some great times. It gives me hope , when this rig gets a little older it will still be useful for a while. Can only spend that kind of money maybe every 5 years.

Jdobbs,
I hope to give MULTIPROCESS=4 a try later today to see how it does in comparison to my first encode. From what I have read it will utilize the memory better since my Rig has 64GB of ram. On the second past the processor utilization was between 98 and 100%.
Yes the technology progresses at an incredible pace.


QBhd,
I obtained that info from one of the Techs at corsair, don't quote me on that had a lot of things going on that day. I will give them a call tomorrow before I setup the Corsair Link Dashboard Software and let you know.

[gonca]

Hello Blusky.

Good to see you have your system up and running. Nice one to start with. Next one you can approach with more comfort.
Give me a little time and I'll load a movie for comparison.
My system is similar to yours. I'll post my system specs if you want for a better comparison.

[blusky]

Mark_Venture,
In reference to this part of your post :
If there is any way to test a single hard drive being the source (where BD is ripped to) as well as working path, in addition to your SSD setup, I'd appreciate it. Since my rig uses WD Black 1TB as both the source and working paths, I'm curious to understand the speed improvements your SSD might make over traditional HD, as well as newer CPU and video card over my 2009 vintage gear.

I have my source folder on the Raid 0 SSD drive but I use Virtual CloneDrive to mount the ISO file. My setup has a Boot SSD for windows and other Apps , 2 SSD's in raid 0 config and WD 4TB drive for storage , which is where my working folder is located. Not sure I did that exactly as you wanted ??

Here is the logs with the settings you gave me:

----------------------
[04/28/13] BD Rebuilder v0.43.06 (beta)
[13:09:06] Source: MEN_IN_BLACK_3_00800
- Input BD size: 26.88 GB
- Approximate total content: [01:45:50.385]
- Windows Version: 6.2 [9200]
- MOVIE-ONLY/ALTERNATE OUTPUT mode enabled
- Mode: MKV Container, 1920x1080, Intact Audio
- Decoding/Frame serving: DirectShow
- Audio Settings: AC3=0 DTS=0 HD=0 Kbs=640
[13:09:06] PHASE ONE, Encoding
- [13:09:06] Processing: VID_00800 (1 of 1)
- [13:09:06] Extracting A/V streams [VID_00800]
- [13:12:01] Reencoding video [VID_00800]
- Source Video: MPEG-4 (AVC), 1920x1080
- Rate/Length: 23.976fps, 152,257 frames
- Bitrate: 8,345 Kbs
- [13:12:01] Reencoding: VID_00800, Pass 1 of 2
- [13:31:58] Reencoding: VID_00800, Pass 2 of 2
- [13:52:17] Video Encode complete
- [13:52:17] Processing audio tracks
[13:52:17]PHASE ONE complete
[13:52:17]PHASE TWO - Rebuild Started
- [13:52:17] Building ALTERNATE OUTPUT Structure
[13:53:49] - Encode and Rebuild complete
- WORKFILES folder removed.
[13:53:50] JOB: MEN_IN_BLACK_3 finished.


Looks like it took 44 minutes.
Hope that helps.

[gonca]

Hello Blusky

[Options]
VERSION=0.43.0.6
MULTIPROCESS=1
MODE=3
ENCODE_QUALITY=0
ONEPASS_ENCODING=2
AUTO_QUALITY=1
TARGET_SIZE=23500
AUDIO_TO_KEEP=eng;
SUBS_TO_KEEP=eng;
SD_CONVERT=0
OPEN_GOP=0
RESIZE_1080=0
DEINTERLACE=1
SD_TO_1080=0
CONVERT_WIDE=0
DTS_REENCODE=0
AC3_REENCODE=0
AC3_640=1
AC3_192=0
KEEP_HD_AUDIO=0
AVCHD=1
REMOVE_WORKFILES=0
MOVIE_ONLY_LOOP=1
REMOVE_OUTPUT=0
USE_FILTERS=0
BDMV_CERT_ONLY=0
USE_LAVF=0
IVTC_PULLDOWN=0
ASSUME_DVD_PAL=0
UNMASK_CHAPTER=0
COMPLETION_BEEP=0
DGDECNV=1
OUTPUT_3D=0
AUDIO_TRACK_LIMIT=1
SUBTITLE_TRACK_LIMIT=1
CUSTOM_TARGET_SIZE=23500
[Paths]
DGIndexNV=C:\Program Files (x86)\dgdecnv2044\DGIndexNV.exe
DGDecNV=C:\Program Files (x86)\dgdecnv2044\DGDecodeNV.dll
SOURCE_PATH=I:\MEN_IN_BLACK_3\
WORKING_PATH=W:\HD\


[04/28/13] BD Rebuilder v0.43.06 (beta)
[13:47:41] Source: MEN_IN_BLACK_3_00800
- Input BD size: 26.88 GB
- Approximate total content: [01:45:50.385]
- Target BD size: 22.95 GB
- Windows Version: 6.1 [7601]
- MOVIE-ONLY mode enabled
- Auto Quality: Good (Very Fast), ABR
- Decoding/Frame serving: DGDecNV [4-way]
- Audio Settings: AC3=0 DTS=0 HD=0 Kbs=640
[13:47:41] PHASE ONE, Encoding
- [13:47:41] Processing: VID_00800 (1 of 1)
- [13:47:41] Extracting A/V streams [VID_00800]
- [13:50:40] Reencoding video [VID_00800]
- Source Video: MPEG-4 (AVC), 1920x1080
- Rate/Length: 23.976fps, 152,257 frames
- Bitrate: 27,186 Kbs
- [13:50:40] Reencoding: VID_00800, Pass 1 of 1
- [14:11:00] Video Encode complete
- [14:11:00] Processing audio tracks
- Track 4352 (eng): Keeping original audio
[14:11:00]PHASE ONE complete
[14:11:00]PHASE TWO - Rebuild Started
- [14:11:00] Rebuilding BD file Structure
[14:15:29] - Encode and Rebuild complete
[14:15:29] JOB: MEN_IN_BLACK_3 finished.


Quick comparison. If you want me to test any other settings just post your .ini and I'll be happy to run it.

CPU 60% or less, Time is about 28 minutes.

[blusky]

Ok here is the second reincode. The only thing different was adding MULTIPROCESS=4 to the INI file

here is the log:


[04/28/13] BD Rebuilder v0.43.06 (beta)
[14:15:02] Source: MEN_IN_BLACK_3_00800
- Input BD size: 26.88 GB
- Approximate total content: [01:45:50.385]
- Target BD size: 4.36 GB
- Windows Version: 6.2 [9200]
- MOVIE-ONLY mode enabled
- Auto Quality: High Quality (Default), Two Pass
- Decoding/Frame serving: DirectShow
- Audio Settings: AC3=0 DTS=0 HD=0 Kbs=640
[14:15:02] PHASE ONE, Encoding
- [14:15:02] Processing: VID_00800 (1 of 1)
- [14:15:02] Extracting A/V streams [VID_00800]
- [14:17:49] Reencoding video [VID_00800]
- Source Video: MPEG-4 (AVC), 1920x1080
- Rate/Length: 23.976fps, 152,257 frames
- Bitrate: 4,744 Kbs
- [14:17:49] Reencoding: VID_00800, Pass 1 of 2
- [14:44:31] Reencoding: VID_00800, Pass 2 of 2
- [15:41:30] Video Encode complete
- [15:41:30] Processing audio tracks
- Track 4352 (eng): Reencoding audio to AC3...
[15:43:36]PHASE ONE complete
[15:43:36]PHASE TWO - Rebuild Started
- [15:43:36] Rebuilding AVCHD file Structure
[15:44:11] - Encode and Rebuild complete
- WORKFILES folder removed.
[15:44:11] JOB: MEN_IN_BLACK_3 finished.

took 1:29 minutes to reincode

Here is the log of the first reincode for comparison that did not have theMULTIPROCESS=4 in the ini file.

04/27/13] BD Rebuilder v0.43.06 (beta)
[15:46:22] Source: MEN_IN_BLACK_3_00800
- Input BD size: 26.88 GB
- Approximate total content: [01:45:50.385]
- Target BD size: 4.36 GB
- Windows Version: 6.2 [9200]
- MOVIE-ONLY mode enabled
- Auto Quality: High Quality (Default), Two Pass
- Decoding/Frame serving: DirectShow
- Audio Settings: AC3=0 DTS=0 HD=0 Kbs=640
[15:46:22] PHASE ONE, Encoding
- [15:46:22] Processing: VID_00800 (1 of 1)
- [15:46:22] Extracting A/V streams [VID_00800]
- [15:49:14] Reencoding video [VID_00800]
- Source Video: MPEG-4 (AVC), 1920x1080
- Rate/Length: 23.976fps, 152,257 frames
- Bitrate: 4,681 Kbs
- [15:49:14] Reencoding: VID_00800, Pass 1 of 2
- [16:14:21] Reencoding: VID_00800, Pass 2 of 2
- [17:07:13] Video Encode complete
- [17:07:13] Processing audio tracks
- Track 4352 (eng): Reencoding audio to AC3...
[17:09:17]PHASE ONE complete
[17:09:17]PHASE TWO - Rebuild Started
- [17:09:17] Rebuilding AVCHD file Structure
[17:09:52] - Encode and Rebuild complete
[17:09:52] JOB: MEN_IN_BLACK_3 finished.


This one took 1:23

So it took 6 more minutes with the MULTIPROCESS=4 in the INI file. The Processor utilization was about the same for both about 85 to 90% on the first pass and about 100% utilization on the second pass. Memory was 4GB used on the first reincode and 5GB on the MULTIPROCESS=4 reincode.

[blusky]

Hello Blusky

[Options]
VERSION=0.43.0.6
MULTIPROCESS=1
MODE=3
ENCODE_QUALITY=0
ONEPASS_ENCODING=2
AUTO_QUALITY=1
TARGET_SIZE=23500
AUDIO_TO_KEEP=eng;
SUBS_TO_KEEP=eng;
SD_CONVERT=0
OPEN_GOP=0
RESIZE_1080=0
DEINTERLACE=1
SD_TO_1080=0
CONVERT_WIDE=0
DTS_REENCODE=0
AC3_REENCODE=0
AC3_640=1
AC3_192=0
KEEP_HD_AUDIO=0
AVCHD=1
REMOVE_WORKFILES=0
MOVIE_ONLY_LOOP=1
REMOVE_OUTPUT=0
USE_FILTERS=0
BDMV_CERT_ONLY=0
USE_LAVF=0
IVTC_PULLDOWN=0
ASSUME_DVD_PAL=0
UNMASK_CHAPTER=0
COMPLETION_BEEP=0
DGDECNV=1
OUTPUT_3D=0
AUDIO_TRACK_LIMIT=1
SUBTITLE_TRACK_LIMIT=1
CUSTOM_TARGET_SIZE=23500
[Paths]
DGIndexNV=C:\Program Files (x86)\dgdecnv2044\DGIndexNV.exe
DGDecNV=C:\Program Files (x86)\dgdecnv2044\DGDecodeNV.dll
SOURCE_PATH=I:\MEN_IN_BLACK_3\
WORKING_PATH=W:\HD\


[04/28/13] BD Rebuilder v0.43.06 (beta)
[13:47:41] Source: MEN_IN_BLACK_3_00800
- Input BD size: 26.88 GB
- Approximate total content: [01:45:50.385]
- Target BD size: 22.95 GB
- Windows Version: 6.1 [7601]
- MOVIE-ONLY mode enabled
- Auto Quality: Good (Very Fast), ABR
- Decoding/Frame serving: DGDecNV [4-way]
- Audio Settings: AC3=0 DTS=0 HD=0 Kbs=640
[13:47:41] PHASE ONE, Encoding
- [13:47:41] Processing: VID_00800 (1 of 1)
- [13:47:41] Extracting A/V streams [VID_00800]
- [13:50:40] Reencoding video [VID_00800]
- Source Video: MPEG-4 (AVC), 1920x1080
- Rate/Length: 23.976fps, 152,257 frames
- Bitrate: 27,186 Kbs
- [13:50:40] Reencoding: VID_00800, Pass 1 of 1
- [14:11:00] Video Encode complete
- [14:11:00] Processing audio tracks
- Track 4352 (eng): Keeping original audio
[14:11:00]PHASE ONE complete
[14:11:00]PHASE TWO - Rebuild Started
- [14:11:00] Rebuilding BD file Structure
[14:15:29] - Encode and Rebuild complete
[14:15:29] JOB: MEN_IN_BLACK_3 finished.


Quick comparison. If you want me to test any other settings just post your .ini and I'll be happy to run it.

CPU 60% or less, Time is about 28 minutes.

Here is my Ini:[Options]
VERSION=0.43.0.6
MODE=3
ENCODE_QUALITY=2
ONEPASS_ENCODING=0
AUTO_QUALITY=1
TARGET_SIZE=4469
AUDIO_TO_KEEP=eng;
SUBS_TO_KEEP=eng;
SD_CONVERT=0
OPEN_GOP=0
RESIZE_1080=0
DEINTERLACE=1
SD_TO_1080=0
CONVERT_WIDE=0
DTS_REENCODE=0
AC3_REENCODE=0
AC3_640=1
AC3_192=0
KEEP_HD_AUDIO=0
AVCHD=1
REMOVE_WORKFILES=1
MOVIE_ONLY_LOOP=1
REMOVE_OUTPUT=0
USE_FILTERS=0
BDMV_CERT_ONLY=0
USE_LAVF=0
IVTC_PULLDOWN=1
ASSUME_DVD_PAL=0
UNMASK_CHAPTER=1
COMPLETION_BEEP=0
DGDECNV=0
OUTPUT_3D=0
AUDIO_TRACK_LIMIT=1
SUBTITLE_TRACK_LIMIT=1
CUSTOM_TARGET_SIZE=23500
PRIORITY_CLASS=1
QUICK_EXTRAS=1
MOVIEONLY_TYPE=0
ALTCRF=20
ALT_TARGET=8096
ALTMETHOD=2
ALTAUTOCROP=0
[Paths]
SOURCE_PATH=H:\
WORKING_PATH=E:\WORKING\
MULTIPROCESS=4


Thanks gonca.

[gonca]

The idea behind this, if you saw my previous post, is that we have, while not identical, very similar rigs. By using these comparisons you can maybe tweak out your performance a little.

[gonca]

Blusky, regarding MULTIPROCESS=4, try using 6 instead

PS When you added MULTIPROCESS=4 did you click on save, because I am not seeing 4 way split in your log. In other words, it looks like you are running without MULTIPROCESS=n set

[QBhd]

So I just tested multiprocess and while the idea is good, I don't think it works very well. I have an FX-8350 and the time it took to break up the source into 4 greatly slows the results. And I actually had a slower performance with multiprocess=4 compared to leaving out the setting (74 FPS compared to 76 FPS)

I did a BD25 test with a movie close in size to the one RobertM did (mine was 01:46:35.430, so a little longer)... and here are my results (no multiprocess set in ini):

----------------------
[04/28/13] BD Rebuilder v0.43.06 (beta)
[15:39:36] Source: Test Encode
- Input BD size: 29.79 GB
- Approximate total content: [01:46:35.430]
- Target BD size: 22.95 GB
- Windows Version: 6.1 [7601]
- MOVIE-ONLY mode enabled
- Auto Quality: Good (Very Fast), ABR
- Decoding/Frame serving: DirectShow
- Audio Settings: AC3=0 DTS=0 HD=1 Kbs=640
[15:39:36] PHASE ONE, Encoding
- [15:39:36] Processing: VID_00023 (1 of 1)
- [15:39:36] Extracting A/V streams [VID_00023]
- [15:43:04] Reencoding video [VID_00023]
- Source Video: MPEG-4 (AVC), 1920x1080
- Rate/Length: 23.976fps, 153,337 frames
- Bitrate: 24,570 Kbs
- [15:43:04] Reencoding: VID_00023, Pass 1 of 1
- [16:16:40] Video Encode complete
- [16:16:40] Processing audio tracks
- Track 4352 (eng): Keeping original audio
[16:16:40]PHASE ONE complete
[16:16:40]PHASE TWO - Rebuild Started
- [16:16:40] Rebuilding BD file Structure
[16:19:50] - Encode and Rebuild complete
- WORKFILES folder removed.
[16:19:50] JOB: Test Encode finished.

I will do the same file as a BD5 with blusky's ini to compare that as well :)

QB

[gonca]

QBhd
It does work well but the processor makes a difference in the result. I used to have a 1090t or 1100t,can't remember which, OCed th 4GHz which could not handle anything more than one instance of x264, it would just bog down. My present CPU, i7 3930K, can handle multiple instances quite well. If I use FFDshow for decoding I can get it to run with about 12 instances. Please note that MULTIPROCESS=n is not a linear relationship to time.

[Mark_Venture]

I have my source folder on the Raid 0 SSD drive but I use Virtual CloneDrive to mount the ISO file. My setup has a Boot SSD for windows and other Apps , 2 SSD's in raid 0 config and WD 4TB drive for storage , which is where my working folder is located. Not sure I did that exactly as you wanted ??So you rip your BD to ISO stored on the SSD (in Raid 0) and use Virtual CloneDrive to mount it, then your working folder for BD-Rebuilder is actually your WD 4TB drive?

For me, I rip to folder (instead of ISO) on my WD 1TB Black, and have the working folder on the same drive which is a bottle neck for me.

But at 44 min, its about 1/2 the time it takes me. That is a good gauge of what an upgrade could do for me. Time to start saving up.

Thank you for trying my settings and reporting back!!! I appreciate it!!

[RobertM]

So you rip your BD to ISO stored on the SSD (in Raid 0) and use Virtual CloneDrive to mount it, then your working folder for BD-Rebuilder is actually your WD 4TB drive?

I wonder if it would work better the other way around. Put the source on the 4TB drive and use the SSD array for the target. During the BD-Rebuilder process the first thing that happens is the extraction from the source to the working (target) drive. Then all the stuff happens on the working drive, I believe. So, it seems to me that it would be best to have the working drive as fast as possible.

So a good test, Blusky, would be to repeat one of your encodes, without changing any settings, but reverse the drives that you use and see if that makes any noticeable difference.

[gonca]

Blusky

RobertM might have hit the nail on the head. I compared your extract/ rebuild times to mine for MIB3 and your 4TB is presently your slow point. Using the raid as your working drive should shave a minute or two off your times.

[QBhd]

With the ridiculous speed of your SSD array you certainly should be do ALL work on it. In other words have the image file located on the array, and have the working directory also on the array. You will not have better read/write speeds using any other drives. It is what I do with my 4x500GB Caviar Black array, and that does not even come to the speed of your SSD's in RAID0.

Here is the latest test I did using your settings (no multiprocess):

----------------------
[04/28/13] BD Rebuilder v0.43.06 (beta)
[16:45:50] Source: Test Encode
- Input BD size: 29.79 GB
- Approximate total content: [01:46:35.430]
- Target BD size: 4.36 GB
- Windows Version: 6.1 [7601]
- MOVIE-ONLY mode enabled
- Auto Quality: High Quality (Default), Two Pass
- Decoding/Frame serving: DirectShow
- Audio Settings: AC3=0 DTS=0 HD=0 Kbs=640
[16:45:50] PHASE ONE, Encoding
- [16:45:50] Processing: VID_00023 (1 of 1)
- [16:45:50] Extracting A/V streams [VID_00023]
- [16:49:19] Reencoding video [VID_00023]
- Source Video: MPEG-4 (AVC), 1920x1080
- Rate/Length: 23.976fps, 153,337 frames
- Bitrate: 4,687 Kbs
- [16:49:19] Reencoding: VID_00023, Pass 1 of 2
- [17:24:05] Reencoding: VID_00023, Pass 2 of 2
- [18:37:49] Video Encode complete
- [18:37:49] Processing audio tracks
- Track 4352 (eng): Reencoding audio to AC3...
[18:41:38]PHASE ONE complete
[18:41:38]PHASE TWO - Rebuild Started
- [18:41:38] Rebuilding AVCHD file Structure
[18:42:10] - Encode and Rebuild complete
- WORKFILES folder removed.
[18:42:11] JOB: Test Encode finished.


Working Drive is a 4x500GB Caviar Black RAID0
CPU is an FX-8350 with zero tweaks for speed (4.0 GHz)
RAM is 8 GB @ 1866MHz with 7-10-8-27-1T timings

QB

[blusky]

QBhd
It does work well but the processor makes a difference in the result. I used to have a 1090t or 1100t,can't remember which, OCed th 4GHz which could not handle anything more than one instance of x264, it would just bog down. My present CPU, i7 3930K, can handle multiple instances quite well. If I use FFDshow for decoding I can get it to run with about 12 instances. Please note that MULTIPROCESS=n is not a linear relationship to time.

Thanks gonca,
I did check the Ini file and it does have MULTIPROCESS=4 at end of the options list.

I will give it a try as RobertM has suggested and switch working file to the raid 0 SSD's and the source file to the WD 4TB HDD and post back results.

Here is what I find interesting gonca. My Processor has a utilization on pass 1 averaging about 90%. on 2nd pas about 100%. This was before I changed the setting to MULTIPROCESS=4.
How can you be at 60% utilization and I be at 100%??

[RobertM]

How can you be at 60% utilization and I be at 100%??

The processor can only work with what it's given. If there a non-CPU bottleneck then the processor will be waiting for commands and will be less than 100% loaded. For instance, if you are doing a job that is easy for the processor but drive intensive, and you have a slow drive, then your processor will be lightly loaded (it could do more work, but the drive cannot feed it work fast enough). On the other hand, if you have a complex task for the processor, but one that doesn't depend on info from the drive, then the processor will likely be heavily loaded.

On my system, in a 2-pass high quality encode, pass 1 is usually 50 to 60% while pass 2 is almost 100%.

[QBhd]

blusky... just use your SSD RAID0 for ALL your work. You will not get better speeds by using a mechanical HDD in any step of the process. Your SSD array is sick fast and can easily handle reading and writing at the same time and still be 4-5 times faster than reading from an HDD.

QB

[gonca]

Thanks gonca,
I did check the Ini file and it does have MULTIPROCESS=4 at end of the options list.

I will give it a try as RobertM has suggested and switch working file to the raid 0 SSD's and the source file to the WD 4TB HDD and post back results.

Here is what I find interesting gonca. My Processor has a utilization on pass 1 averaging about 90%. on 2nd pas about 100%. This was before I changed the setting to MULTIPROCESS=4.
How can you be at 60% utilization and I be at 100%??

That was for the BD25 encode. If you post your ini file for the BD5 encode I'll run it and post the log for comparison.
Where the log says frame serving/ decoding Directshow it should have (4 way) if the multiprocess option was saved. It doesn't on your log.
Make sure you have indexing disabled on your ssd and, unless you a lot of searches on your hdd, on your 4TB.

[blusky]

That was for the BD25 encode. If you post your ini file for the BD5 encode I'll run it and post the log for comparison.
Where the log says frame serving/ decoding Directshow it should have (4 way) if the multiprocess option was saved. It doesn't on your log.
Make sure you have indexing disabled on your ssd and, unless you a lot of searches on your hdd, on your 4TB.

Thanks gonca for helping me tweak it out.

as for the multiprocess option I did as Jdobbs had suggested and Just added it to the config/ini file and saved it. I went and looked back in a previous post where I posted the ini file and it does show MULTIPROCESS=4 at the bottom of the ini.

Don't know why it is not working???

Ok here is the new reencode using the Source file located on the 4TB HDD and the Working folder located on the Raid 0 SSD's.

Log:
----------------------
[04/28/13] BD Rebuilder v0.43.06 (beta)
[19:56:19] Source: MEN_IN_BLACK_3_00800
- Input BD size: 26.88 GB
- Approximate total content: [01:45:50.385]
- Target BD size: 4.36 GB
- Windows Version: 6.2 [9200]
- MOVIE-ONLY mode enabled
- Auto Quality: High Quality (Default), Two Pass
- Decoding/Frame serving: DirectShow
- Audio Settings: AC3=0 DTS=0 HD=0 Kbs=640
[19:56:19] PHASE ONE, Encoding
- [19:56:19] Processing: VID_00800 (1 of 1)
- [19:56:19] Extracting A/V streams [VID_00800]
- [19:59:47] Reencoding video [VID_00800]
- Source Video: MPEG-4 (AVC), 1920x1080
- Rate/Length: 23.976fps, 152,257 frames
- Bitrate: 4,744 Kbs
- [19:59:47] Reencoding: VID_00800, Pass 1 of 2
- [20:24:52] Reencoding: VID_00800, Pass 2 of 2
- [21:17:52] Video Encode complete
- [21:17:52] Processing audio tracks
- Track 4352 (eng): Reencoding audio to AC3...
[21:19:55]PHASE ONE complete
[21:19:55]PHASE TWO - Rebuild Started
- [21:19:55] Rebuilding AVCHD file Structure
[21:20:03] - Encode and Rebuild complete
- WORKFILES folder removed.
[21:20:04] JOB: MEN_IN_BLACK_3 finished.


So looks like it took 1:24 minutes compared to the original encode which was 1:23

So it took one minute longer??

Tomorrow I will try both the source and working files on the Raid 0 array and see what that does.

I did not make a copy of the original encode .ini file but I believe these were the settings:

[Options]
VERSION=0.43.0.6
MODE=3
ENCODE_QUALITY=2
ONEPASS_ENCODING=0
AUTO_QUALITY=1
TARGET_SIZE=4469
AUDIO_TO_KEEP=eng;
SUBS_TO_KEEP=eng;
SD_CONVERT=0
OPEN_GOP=0
RESIZE_1080=0
DEINTERLACE=1
SD_TO_1080=0
CONVERT_WIDE=0
DTS_REENCODE=0
AC3_REENCODE=0
AC3_640=1
AC3_192=0
KEEP_HD_AUDIO=0
AVCHD=1
REMOVE_WORKFILES=1
MOVIE_ONLY_LOOP=1
REMOVE_OUTPUT=0
USE_FILTERS=0
BDMV_CERT_ONLY=0
USE_LAVF=0
IVTC_PULLDOWN=1
ASSUME_DVD_PAL=0
UNMASK_CHAPTER=1
COMPLETION_BEEP=0
DGDECNV=0
OUTPUT_3D=0
AUDIO_TRACK_LIMIT=1
SUBTITLE_TRACK_LIMIT=1
CUSTOM_TARGET_SIZE=23500
PRIORITY_CLASS=1
QUICK_EXTRAS=1
MOVIEONLY_TYPE=0
ALTCRF=20
ALT_TARGET=8096
ALTMETHOD=2
ALTAUTOCROP=0
[Paths]
SOURCE_PATH=H:\
WORKING_PATH=F:\WORKING\

Thanks gonca.

Oh , by the way I used a program called rea ltemp GT 3.70 and took a look at the core temps while at 100% cpu utilization . The average core temp was 56C. I was wondering if the H100i Liquid Cpu cooler was working well. On a side note I am getting this message on first startup of the day, "CPU Fan error! Press F1 to go into setup. Usually if I wait a few minutes and restart it will then go into windows. Sometimes I have had to restart 3 times to finally get it to boot into windows. I have checked my connections to the H100i and they are correct.
Tomorrow I will disable cpu fan sensor in bios and see what that does?? When I first start computer all fans go into high mode for about 10 seconds then they throttle down and when I start reincode they do throttle up again so I do believe the water cooler is working ok??

[gonca]

MULTIPROCESS isn't listed. Try it again and make sure to save it.

Also compare your extraction / encode /rebuild times as these relate to source drive /cpu /working drive.
Do you have antivirus running, write caching enabled etc.

[QBhd]

Write cache in Windows should NOT be enabled for a RAID array. At least that is the deal with AMD SB950 chipsets and I don't see it being different for Intel. The OS cache policy will interfere with the RAID's cache policies.

QB

[blusky]

MULTIPROCESS isn't listed. Try it again and make sure to save it.

Also compare your extraction / encode /rebuild times as these relate to source drive /cpu /working drive.
Do you have antivirus running, write caching enabled etc.

gonca, QBhd
will try it again MULTIPROCESS4 and see how it goes tomorrow.The only antivirus I have on is the one that comes with windows 8 which does not use much resources. I will look at the write cashe setting on the Raid 0.

Thanks.

,