BackupHDDVD Java speed improvements [Archive]

View Full Version : BackupHDDVD Java speed improvements

XKCorp

21st January 2007, 22:23

As I can't get good speed with my thread implementation in the copy process of BackupHDDVD, I have only implemented buffering to gain speed.
It was not difficult at all and I hope this will be implemented in the next version of the GUI, with new functions like stop and suspend the copy process.

http://www.sendspace.com/file/3n42a4
http://rapidshare.com/files/12911211/BackupHDDVD100-GUI008-Buffering.zip

------------------------------------
Hello

I am trying to speed up BackupHDDVD, the original one in Java.
The changes I have made are :
- Reading files, decrypting, writing files are run in separated threads
- Using buffers to read/write files

This mod is still in developpment, I don't have an HDDVD drive to test my work so it is difficult for me find bugs. I hope you could report me all errors you can find in this version :)

When this will run, it should be great to benchmark ;)

Thanks!

LokiHD

21st January 2007, 22:58

when i hit decrypt, both hdd+optical drive, kingkong,

BackupHDDVD starting.
=== Start analyse ===
Scaning video directory...
Files found ...
=== Start decrypting ===
Found valid HD-DVD source.
Disc Hash: 0E75082678AAD5CD4410A28A662D6832D21EB325
Look for this movie in my database...
Error! Aborting...

Nomadic

22nd January 2007, 10:37

2LokiHD:
Did you specify a keydb file?
For me works :)

snurregrekk

22nd January 2007, 10:51

lokihd, you seem to have had problem with almost every modded version of backuphddvd. what kind of drive do you have?

He-Man

22nd January 2007, 12:27

For me works :)
But is it any faster than the original version?
I guess that was the whole purpose of this new multi threaded edition.

Nomadic

22nd January 2007, 12:42

I am not sure...
On my small test disk as though even slower...

XKCorp

22nd January 2007, 17:18

What kind of test disk are you using? I am searching for a test CD image containing sames files as an HDDVD (smaller of course) to test if the app is working.

Jokin told me :
Ok, files are now the correct size but after the first file it gets those same errors and then slows down about 40-50% on the next file.

So there still this error :
Exception in thread "AWT-EventQueue-0" java.lang.NullPointerException
at javax.swing.plaf.basic.BasicTableUI.paintCell(Unknown Source)
at javax.swing.plaf.basic.BasicTableUI.paintCells(Unknown Source)
at javax.swing.plaf.basic.BasicTableUI.paint(Unknown Source)
at javax.swing.plaf.ComponentUI.update(Unknown Source)
at javax.swing.JComponent.paintComponent(Unknown Source)
at javax.swing.JComponent.paint(Unknown Source)
at javax.swing.JComponent.paintWithOffscreenBuffer(Unknown Source)
at javax.swing.JComponent.paintDoubleBuffered(Unknown Source)
at javax.swing.JComponent._paintImmediately(Unknown Source)
at javax.swing.JComponent.paintImmediately(Unknown Source)
at javax.swing.RepaintManager.paintDirtyRegions(Unknown Source)
at javax.swing.SystemEventQueueUtilities$ComponentWorkRequest.run(Unknown Source)
at java.awt.event.InvocationEvent.dispatch(Unknown Source)
at java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.awt.EventDispatchThread.pumpOneEventForHierarchy(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.run(Unknown Source)
This stack trace don't say anything about threads I added in the copy process, it may be a problem with the "observer" thread which update the main GUI (progress bar).
Do you get the same error with the original GUI 0.0.7 avaible on sourceforge?

XKCorp

22nd January 2007, 18:29

As a new version of GUI 0.0.8 is out, here is the multi-threaded version!
http://www.sendspace.com/file/v7iqjt
http://rapidshare.com/files/12880778/BackupHDDVD100-GUI008-MT-1.zip

Since I have connection problems with Sendspace, if you can't download on rapidshare please wait for a moment, I will post when sendspace is back :(

I hope I don't have added bugs in this new version, things have changed with the observer thread (GUI Mod) so the NullPointerException may have disappeared ;)

Thank you for testing, MT mod should be in the next GUI mod :cool:

LokiHD

22nd January 2007, 20:30

LokiHD

22nd January 2007, 21:32

i tried Nomadic's keydb and it freezes @ processing black.evo key..

XKCorp

22nd January 2007, 21:33

Nomadic, snurregrekk, XKcorp,

v0.0.8 has the same error.. but i tried Emon's keydb and now it worx, so something is wrong with the included keydb file

let u know how fast this 1 is in a few..

edit: i thought it worx now but it gets stuck/freezes here,

Processing BLACK.EVO key = 3 ...

can u guys tell me which keydb worx w/ this GUI ?

Did you try with another movie?
Do you get an error message?
Is this error happend with the official GUI 0.0.8 (can be downloaded on sourceforge) and with my MT mod ?

LokiHD

22nd January 2007, 21:35

i just posted that Nomadic's exe worx..

i dont have any other hd movie

2bigkings

22nd January 2007, 21:36

very slow (i copy only feature1 and feature2)
no error messages

XKCorp

22nd January 2007, 21:48

very slow (i copy only feature1 and feature2)
no error messages

Effectively my threading implementation is crapy, I made some tests and no way to go as fast as I would like :(

I will post soon a simple version with no threads, only buffering...

Anyone else would like to implement threading in BackupHDDVD?
I don't think it would be faster, it was just to please geeks ;)

2bigkings

22nd January 2007, 21:51

yes, that would be great xkcorp. thanks..
good luck with your next version!

XKCorp

22nd January 2007, 22:07

Here you are!

http://www.sendspace.com/file/3n42a4
http://rapidshare.com/files/12911211/BackupHDDVD100-GUI008-Buffering.zip

LokiHD

22nd January 2007, 22:38

Here you are!

http://www.sendspace.com/file/3n42a4
http://rapidshare.com/files/12911211/BackupHDDVD100-GUI008-Buffering.zip

this gui seems to be fast..

but, the keydb file that you are including doesnt work, i used Nomadic's keydb and it worx

jokin

22nd January 2007, 22:52

Here you are!

http://www.sendspace.com/file/3n42a4
http://rapidshare.com/files/12911211/BackupHDDVD100-GUI008-Buffering.zip

BackupHDDVD100-GUI008-Buffering seems to be alot better . Maybe only 10% slower on 2nd file but no errors.

Nice work.

2bigkings

22nd January 2007, 22:56

buffering version is one of the best mods at the moment, thank you!

LokiHD

22nd January 2007, 22:57

completed kingkong in 12 min 30 sec

so far yours is fastest

nice work!

if could you add a completed time..

XKCorp

22nd January 2007, 23:46

this gui seems to be fast..

but, the keydb file that you are including doesnt work, i used Nomadic's keydb and it worx

The are no keydb included, you have replace the jar file of the official GUI with this one.

Maybe it would be possible to speed up a little more, like I was trying with threads, but I was on the wrong way...

LokiHD

23rd January 2007, 00:05

The are no keydb included, you have replace the jar file of the official GUI with this one.

Maybe it would be possible to speed up a little more, like I was trying with threads, but I was on the wrong way...

i see.. since the 'Use "keydb.cfg' file in current directory' box is checked i assumed that you have included..

sorry guys i dont look at the files/codes all i do is test/bench

keep it up guys!

XKCorp

25th January 2007, 19:44

LokiHD

25th January 2007, 19:48

If someone could test this version and, if it works, compare total time needed to copy an HDDVD it would be great :

http://rapidshare.com/files/13361602/BackupHDDVD100-GUI010-Buffering.zip
http://www.sendspace.com/file/g6ozxa

Changes : increasing buffering size

=== Start analyse ===
Scaning video directory...
Files found ...

=== Start decrypting ===
Found valid HD-DVD source.
Disc Hash: 0E75082678AAD5CD4410A28A662D6832D21EB325
Look for this movie in my database...
Found movie: King Kong .
Valid Volume Unique key found.
HVDVD_TS folder created.
ADV_OBJ folder created.
MAP file(s) copied.
VTI file copied.
DAT file copied.
XPL file(s) copied.

Start decrypting at 01/25/07 10:46:06
Processing BLACK.EVO key = 3 ...

stops there

XKCorp

25th January 2007, 20:07

=== Start analyse ===
Scaning video directory...
Files found ...

=== Start decrypting ===
Found valid HD-DVD source.
Disc Hash: 0E75082678AAD5CD4410A28A662D6832D21EB325
Look for this movie in my database...
Found movie: King Kong .
Valid Volume Unique key found.
HVDVD_TS folder created.
ADV_OBJ folder created.
MAP file(s) copied.
VTI file copied.
DAT file copied.
XPL file(s) copied.

Start decrypting at 01/25/07 10:46:06
Processing BLACK.EVO key = 3 ...

stops there
Perhaps buffer too big?

http://www.sendspace.com/file/ldnvir

LokiHD

25th January 2007, 20:13

Perhaps buffer too big?

http://www.sendspace.com/file/ldnvir

worx..

completed @ 13:56

XKCorp

25th January 2007, 20:32

worx..

completed @ 13:56

Thanks, so this is not faster with bigger buffer. Perhaps faster if reading from HDDVD drive, but not with your stripped array. :(

LokiHD

25th January 2007, 20:38

Thanks, so this is not faster with bigger buffer. Perhaps faster if reading from HDDVD drive, but not with your stripped array. :(

maybe..

if someone would bench the xbox360 drive :D

LokiHD

25th January 2007, 23:04

im decrypting from the xbox360 drive to hdd array and looks like its gonna finish @ 1+hour, seems fast

if somebody would do this on a more normal system from the xbox360 drive to a single hdd

edit: completed @ 1 hour 2 min 7 sec

He-Man

26th January 2007, 00:40

LokiHD

26th January 2007, 01:04

And how long does it take to copy KK from the Xbox360 drive to the HDD without decryption? Technically speaking this time should be added to the HDD to HDD extraction time when comparing to extraction directly from the Xbox360 drive.

im copying to hdd right now..

edit: just copying kk to hdd @ 1 hour 2 min 30 sec vs 1 hour 2 min 7 sec when decrypting, hmmm...

the 2+hour xbox360 drive to hdd versions completely threw me off.. then when someone would report completed @ 1 hour 15 min, i thought that was hdd to hdd, instead its 360 drive to hdd, now i understand..