LameXP Benchmark --> Help required

[LoRd_MuldeR]

In an attempt to optimize the LameXP startup code, I'm trying to tweak the number of threads being used.

I have made a little benchmark to find the "optimal" number of threads; and calculate the factor that would derive this number from the number of CPU cores.

I'm hoping to construct a simple function which can determine a good factor for the majority of systems. That's why I need some numbers from you ;)

Download:
LameXP.BENCHMARK.2013-11-02.rar (http://sourceforge.net/projects/lamexp/files/Miscellaneous/Test%20Builds/LameXP.BENCHMARK.2013-11-02.rar/download)

The interesting part of the log should look like this:
----------------------------------------------
Benchmark Results:
----------------------------------------------
01 -> 4.4241
02 -> 2.3522
03 -> 1.7082
04 -> 1.5728
05 -> 1.5926
06 -> 1.4972
07 -> 1.4445
08 -> 1.3843
09 -> 1.3824
10 -> 1.3509
11 -> 1.3603
12 -> 1.4268
13 -> 1.4895
14 -> 1.3803
15 -> 1.3338
16 -> 1.3792
17 -> 1.3289
18 -> 1.3150
19 -> 1.4096
20 -> 1.4283
----------------------------------------------
BEST: 18 of 4 (factor: 4.5000)
----------------------------------------------

:thanks:

[jpsdr]

OS : Windows XP SP3, CPU : i7@860.


[W][3139] ----------------------------------------------
[W][3139] Benchmark Results:
[W][3139] ----------------------------------------------
[W][3139] 01 -> 0.3064
[W][3139] 02 -> 0.1981
[W][3139] 03 -> 0.1511
[W][3139] 04 -> 0.1398
[W][3139] 05 -> 0.1399
[W][3139] 06 -> 0.1372
[W][3139] 07 -> 0.1370
[W][3139] 08 -> 0.1371
[W][3139] 09 -> 0.1380
[W][3139] 10 -> 0.1368
[W][3139] 11 -> 0.1369
[W][3139] 12 -> 0.1344
[W][3139] 13 -> 0.1348
[W][3139] 14 -> 0.1393
[W][3139] 15 -> 0.1612
[W][3139] 16 -> 0.1622
[W][3139] 17 -> 0.1596
[W][3139] 18 -> 0.1601
[W][3139] 19 -> 0.1507
[W][3139] 20 -> 0.1577
[W][3139] 21 -> 0.1621
[W][3139] 22 -> 0.1620
[W][3139] 23 -> 0.1615
[W][3139] 24 -> 0.1606
[W][3139] 25 -> 0.1488
[W][3139] 26 -> 0.1586
[W][3139] 27 -> 0.1531
[W][3139] 28 -> 0.1525
[W][3139] 29 -> 0.1606
[W][3139] 30 -> 0.1579
[W][3139] 31 -> 0.1618
[W][3139] 32 -> 0.1639
[W][3139] 33 -> 0.1556
[W][3139] 34 -> 0.1627
[W][3139] 35 -> 0.1622
[W][3139] 36 -> 0.1628
[W][3139] 37 -> 0.1607
[W][3139] 38 -> 0.1626
[W][3139] 39 -> 0.1614
[W][3139] 40 -> 0.1634
[W][3139] ----------------------------------------------
[W][3139] BEST: 12 of 8 (factor: 1.5000)
[W][3139] ----------------------------------------------
[C][3139] Benchmark complete. Thanks and bye bye!

[Groucho2004]

I get a MessageBox with this error at the end:
LameXP.exe - Fatal Application Exit
The application has encountered a critical error and will exit now!

WinXP SP3, Intel i5 2500K @ 4 GHz

Results:
[W][1279] 01 -> 0.1906
[W][1279] 02 -> 0.0929
[W][1279] 03 -> 0.0743
[W][1279] 04 -> 0.0565
[W][1279] 05 -> 0.0630
[W][1279] 06 -> 0.0695
[W][1279] 07 -> 0.0657
[W][1279] 08 -> 0.0656
[W][1279] 09 -> 0.0685
[W][1279] 10 -> 0.0706
[W][1279] 11 -> 0.0662
[W][1279] 12 -> 0.0691
[W][1279] 13 -> 0.0650
[W][1279] 14 -> 0.0663
[W][1279] 15 -> 0.0677
[W][1279] 16 -> 0.0686
[W][1279] 17 -> 0.0675
[W][1279] 18 -> 0.0691
[W][1279] 19 -> 0.0663
[W][1279] 20 -> 0.0705
[W][1279] ----------------------------------------------
[W][1279] BEST: 4 of 4 (factor: 1.0000)


Also:
[I][1279] Nero encoder binaries not found -> AAC encoding support will be disabled!
[I][1279] FhgAacEnc binaries not found -> FhgAacEnc support will be disabled!
[I][1279] QAAC binaries not found -> QAAC support will be disabled!



Lastly, you don't clean up after yourself (%TEMP%). :D

[mastrboy]

Windows 8.1 Enterprise 64bit
SSD Samsung EVO 500GB
i5 4670k (non-overclocked)

[W][2855] ----------------------------------------------
[W][2855] Benchmark Results:
[W][2855] ----------------------------------------------
[W][2855] 01 -> 1.7571
[W][2855] 02 -> 0.9213
[W][2855] 03 -> 0.6783
[W][2855] 04 -> 0.5668
[W][2855] 05 -> 0.5520
[W][2855] 06 -> 0.5522
[W][2855] 07 -> 0.5277
[W][2855] 08 -> 0.5220
[W][2855] 09 -> 0.5449
[W][2855] 10 -> 0.5220
[W][2855] 11 -> 0.5171
[W][2855] 12 -> 0.5277
[W][2855] 13 -> 0.5388
[W][2855] 14 -> 0.5323
[W][2855] 15 -> 0.5245
[W][2855] 16 -> 0.5250
[W][2855] 17 -> 0.5364
[W][2855] 18 -> 0.5374
[W][2855] 19 -> 0.5134
[W][2855] 20 -> 0.5252
[W][2855] ----------------------------------------------
[W][2855] BEST: 19 of 4 (factor: 4.7500)
[W][2855] ----------------------------------------------

[LoRd_MuldeR]

Thanks for the results provided so far! :)

I get a MessageBox with this error at the end:
LameXP.exe - Fatal Application Exit
The application has encountered a critical error and will exit now!

Lastly, you don't clean up after yourself (%TEMP%). :D

That's okay. The benchmark really is nothing but an ugly hack and will be removed again ;)

Also:
[I][1279] Nero encoder binaries not found -> AAC encoding support will be disabled!
[I][1279] FhgAacEnc binaries not found -> FhgAacEnc support will be disabled!
[I][1279] QAAC binaries not found -> QAAC support will be disabled!

That's perfectly normal, if you don't have those external encoders in the same directory.

(Not needed for the benchmark at all)

[parsifal]

Hi LoRd_MuldeR! Read your email, I'm replying here:


[I][3324] CPU vendor id : AuthenticAMD (Intel: 0)
[I][3324] CPU brand string : AMD Athlon(tm) II X3 450 Processor
[I][3324] CPU signature : Family: 16, Model: 5, Stepping: 3
[I][3324] CPU capabilities : MMX: 1, SSE: 1, SSE2: 1, SSE3: 1, SSSE3: 0, x64: 1
[I][3324] Number of CPU's : 3
...
[I][3324] Running on Windows 7 or Windows Server 2008 R2.
...
[I][3324] Selected CPU is: CPU_TYPE_X64_GEN
...
[W][3358] ----------------------------------------------
[W][3358] Benchmark Results:
[W][3358] ----------------------------------------------
[W][3358] 01 -> 0.9503
[W][3358] 02 -> 0.5008
[W][3358] 03 -> 0.3914
[W][3358] 04 -> 0.4090
[W][3358] 05 -> 0.3780
[W][3358] 06 -> 0.3890
[W][3358] 07 -> 0.3933
[W][3358] 08 -> 0.3884
[W][3358] 09 -> 0.3891
[W][3358] 10 -> 0.3779
[W][3358] 11 -> 0.3981
[W][3358] 12 -> 0.3709
[W][3358] 13 -> 0.3778
[W][3358] 14 -> 0.3945
[W][3358] 15 -> 0.3786
[W][3358] ----------------------------------------------
[W][3358] BEST: 12 of 3 (factor: 4.0000)
[W][3358] ----------------------------------------------
[C][3358] Benchmark complete. Thanks and bye bye!


Cheers!

[littleD]

Win7 sp1 64bit

[I][1244] CPU vendor id : GenuineIntel (Intel: 1)
[I][1244] CPU brand string : Intel(R) Core(TM) i3 CPU M 370 @ 2.40GHz
[I][1244] CPU signature : Family: 6, Model: 37, Stepping: 5
[I][1244] CPU capabilities : MMX: 1, SSE: 1, SSE2: 1, SSE3: 1, SSSE3: 1, x64: 1
[I][1244] Number of CPU's : 4

first run
[W][1304] ----------------------------------------------
[W][1304] Benchmark Results:
[W][1304] ----------------------------------------------
[W][1304] 01 -> 1.2697
[W][1304] 02 -> 0.6904
[W][1304] 03 -> 0.5571
[W][1304] 04 -> 0.5298
[W][1304] 05 -> 0.5363
[W][1304] 06 -> 0.5264
[W][1304] 07 -> 0.5255
[W][1304] 08 -> 0.5355
[W][1304] 09 -> 0.5286
[W][1304] 10 -> 0.5145
[W][1304] 11 -> 0.5297
[W][1304] 12 -> 0.5272
[W][1304] 13 -> 0.5220
[W][1304] 14 -> 0.5049
[W][1304] 15 -> 0.5023
[W][1304] 16 -> 0.5500
[W][1304] 17 -> 0.5023
[W][1304] 18 -> 0.5105
[W][1304] 19 -> 0.5334
[W][1304] 20 -> 0.5211
[W][1304] ----------------------------------------------
[W][1304] BEST: 17 of 4 (factor: 4.2500)
[W][1304] ----------------------------------------------


second run

[W][1481] ----------------------------------------------
[W][1481] Benchmark Results:
[W][1481] ----------------------------------------------
[W][1481] 01 -> 1.2329
[W][1481] 02 -> 0.7012
[W][1481] 03 -> 0.5338
[W][1481] 04 -> 0.5182
[W][1481] 05 -> 0.5001
[W][1481] 06 -> 0.5019
[W][1481] 07 -> 0.5118
[W][1481] 08 -> 0.5201
[W][1481] 09 -> 0.4998
[W][1481] 10 -> 0.5037
[W][1481] 11 -> 0.4801
[W][1481] 12 -> 0.4941
[W][1481] 13 -> 0.4900
[W][1481] 14 -> 0.5315
[W][1481] 15 -> 0.4973
[W][1481] 16 -> 0.5033
[W][1481] 17 -> 0.4803
[W][1481] 18 -> 0.4786
[W][1481] 19 -> 0.4873
[W][1481] 20 -> 0.4938
[W][1481] ----------------------------------------------
[W][1481] BEST: 18 of 4 (factor: 4.5000)
[W][1481] ----------------------------------------------

[Sparktank]

[I][3414] CPU vendor id : GenuineIntel (Intel: 1)
[I][3414] CPU brand string : Intel(R) Core(TM) i5 CPU M 460 @ 2.53GHz
[I][3414] CPU signature : Family: 6, Model: 37, Stepping: 5
[I][3414] CPU capabilities : MMX: 1, SSE: 1, SSE2: 1, SSE3: 1, SSSE3: 1, x64: 1
[I][3414] Number of CPU's : 4

First Run (from RAMdisk):

[W][3596] ----------------------------------------------
[W][3596] Benchmark Results:
[W][3596] ----------------------------------------------
[W][3596] 01 -> 3.7013
[W][3596] 02 -> 2.1734
[W][3596] 03 -> 1.8496
[W][3596] 04 -> 1.7100
[W][3596] 05 -> 1.6896
[W][3596] 06 -> 1.6600
[W][3596] 07 -> 1.6240
[W][3596] 08 -> 1.6294
[W][3596] 09 -> 1.6698
[W][3596] 10 -> 1.6252
[W][3596] 11 -> 1.6367
[W][3596] 12 -> 1.6140
[W][3596] 13 -> 1.6451
[W][3596] 14 -> 1.5958
[W][3596] 15 -> 1.6226
[W][3596] 16 -> 1.6156
[W][3596] 17 -> 1.6028
[W][3596] 18 -> 1.6139
[W][3596] 19 -> 1.5970
[W][3596] 20 -> 1.6441
[W][3596] ----------------------------------------------
[W][3596] BEST: 14 of 4 (factor: 3.5000)
[W][3596] ----------------------------------------------

Second Run (from HDD):

[W][0376] ----------------------------------------------
[W][0376] Benchmark Results:
[W][0376] ----------------------------------------------
[W][0376] 01 -> 3.7054
[W][0376] 02 -> 2.2126
[W][0376] 03 -> 1.8383
[W][0376] 04 -> 1.7059
[W][0376] 05 -> 1.6844
[W][0376] 06 -> 1.6751
[W][0376] 07 -> 1.6503
[W][0376] 08 -> 1.6373
[W][0376] 09 -> 1.6354
[W][0376] 10 -> 1.6583
[W][0376] 11 -> 1.6450
[W][0376] 12 -> 1.6406
[W][0376] 13 -> 1.6340
[W][0376] 14 -> 1.6144
[W][0376] 15 -> 1.6195
[W][0376] 16 -> 1.6428
[W][0376] 17 -> 1.6377
[W][0376] 18 -> 1.6443
[W][0376] 19 -> 1.6307
[W][0376] 20 -> 1.6043
[W][0376] ----------------------------------------------
[W][0376] BEST: 20 of 4 (factor: 5.0000)
[W][0376] ----------------------------------------------

[LoRd_MuldeR]

Ignoring a few outlieres, I think I see a tendency here:

http://i.imgur.com/rXCowKF.png

[Gulliver_69]

Hi, LoRd_MuldeR.

My system is:
Gigabyte P67A-UD3-B3 (UEFI BIOS U1B)
Intel i5-2500
2x4GB DDR3 Corsair @1600MHz

FIRST RUN:

[W][0967] ----------------------------------------------
[W][0967] Benchmark Results:
[W][0967] ----------------------------------------------
[W][0967] 01 -> 2.1354
[W][0967] 02 -> 1.1212
[W][0967] 03 -> 0.8067
[W][0967] 04 -> 0.6762
[W][0967] 05 -> 0.6558
[W][0967] 06 -> 0.6490
[W][0967] 07 -> 0.6184
[W][0967] 08 -> 0.6280
[W][0967] 09 -> 0.6158
[W][0967] 10 -> 0.6305
[W][0967] 11 -> 0.6461
[W][0967] 12 -> 0.6431
[W][0967] 13 -> 0.6507
[W][0967] 14 -> 0.6558
[W][0967] 15 -> 0.6672
[W][0967] 16 -> 0.6757
[W][0967] 17 -> 0.6981
[W][0967] 18 -> 0.6912
[W][0967] 19 -> 0.6728
[W][0967] 20 -> 0.6768
[W][0967] ----------------------------------------------
[W][0967] BEST: 9 of 4 (factor: 2.2500)
[W][0967] ----------------------------------------------
[C][0967] Benchmark complete. Thanks and bye bye!

SECOND RUN:

[W][1301] ----------------------------------------------
[W][1301] Benchmark Results:
[W][1301] ----------------------------------------------
[W][1301] 01 -> 2.1340
[W][1301] 02 -> 1.1239
[W][1301] 03 -> 0.8089
[W][1301] 04 -> 0.6715
[W][1301] 05 -> 0.6536
[W][1301] 06 -> 0.6522
[W][1301] 07 -> 0.6173
[W][1301] 08 -> 0.6271
[W][1301] 09 -> 0.6337
[W][1301] 10 -> 0.6342
[W][1301] 11 -> 0.6467
[W][1301] 12 -> 0.6757
[W][1301] 13 -> 0.6554
[W][1301] 14 -> 0.6796
[W][1301] 15 -> 0.6673
[W][1301] 16 -> 0.6681
[W][1301] 17 -> 0.6720
[W][1301] 18 -> 0.6975
[W][1301] 19 -> 0.7001
[W][1301] 20 -> 0.6847
[W][1301] ----------------------------------------------
[W][1301] BEST: 7 of 4 (factor: 1.7500)
[W][1301] ----------------------------------------------
[C][1301] Benchmark complete. Thanks and bye bye!

THIRD RUN:

[W][1657] ----------------------------------------------
[W][1657] Benchmark Results:
[W][1657] ----------------------------------------------
[W][1657] 01 -> 2.1566
[W][1657] 02 -> 1.1420
[W][1657] 03 -> 0.8150
[W][1657] 04 -> 0.7035
[W][1657] 05 -> 0.6795
[W][1657] 06 -> 0.6657
[W][1657] 07 -> 0.6851
[W][1657] 08 -> 0.6787
[W][1657] 09 -> 0.6792
[W][1657] 10 -> 0.6591
[W][1657] 11 -> 0.6536
[W][1657] 12 -> 0.6838
[W][1657] 13 -> 0.6922
[W][1657] 14 -> 0.6914
[W][1657] 15 -> 0.7017
[W][1657] 16 -> 0.7231
[W][1657] 17 -> 0.7232
[W][1657] 18 -> 0.7093
[W][1657] 19 -> 0.7396
[W][1657] 20 -> 0.7529
[W][1657] ----------------------------------------------
[W][1657] BEST: 11 of 4 (factor: 2.7500)
[W][1657] ----------------------------------------------
[C][1657] Benchmark complete. Thanks and bye bye!

:-)

[casio7131]

trying to run this on my acer d270 netbook (Atom 1.6GHz, 2GB RAM), but keep running into "deadlock in initialisation thread encountered!" error after a few minutes, so i can never complete the test.

in case my results are still useful, i've posted the log here: http://pastebin.com/ySEvh1Hs (expires in 1 week).

[LoRd_MuldeR]

It means that the benchmark takes far too long on your system. Which is not surprising on such a low-end machine ;)

In theory I could increase the timeout in order to make sure the benchmark can complete. But I don't think results from your system would be representative. On such system things will always be slow, no matter what.

Thanks for your efforts anyway!

[littleD]

Mind results from Windows 8.1? My results on video decoding shows that this partuclar OS version has improved multithreading (hyperthreading) Not sure if benchmark results are better because i can't read it.
First run says something like Best: 20 of 4 result 3.25, i didn't save log. Both benches were long and sound coming from laptop was like from hair dryer.

Second run
[I][1442] CPU vendor id : GenuineIntel (Intel: 1)
[I][1442] CPU brand string : Intel(R) Core(TM) i3 CPU M 370 @ 2.40GHz
[I][1442] CPU signature : Family: 6, Model: 37, Stepping: 5
[I][1442] CPU capabilities : MMX: 1, SSE: 1, SSE2: 1, SSE3: 1, SSSE3: 1, x64: 1
[I][1442] Number of CPU's : 4
[W][1653] ----------------------------------------------
[W][1653] Benchmark Results:
[W][1653] ----------------------------------------------
[W][1653] 01 -> 4.6046
[W][1653] 02 -> 2.6791
[W][1653] 03 -> 2.2660
[W][1653] 04 -> 2.0430
[W][1653] 05 -> 1.9640
[W][1653] 06 -> 1.9388
[W][1653] 07 -> 1.8931
[W][1653] 08 -> 1.8678
[W][1653] 09 -> 1.9147
[W][1653] 10 -> 1.9218
[W][1653] 11 -> 1.8661
[W][1653] 12 -> 1.8540
[W][1653] 13 -> 1.8979
[W][1653] 14 -> 1.8630
[W][1653] 15 -> 1.9309
[W][1653] 16 -> 1.8519
[W][1653] 17 -> 2.0130
[W][1653] 18 -> 1.8616
[W][1653] 19 -> 1.8771
[W][1653] 20 -> 1.8945
[W][1653] ----------------------------------------------
[W][1653] BEST: 16 of 4 (factor: 4.0000)
[W][1653] ----------------------------------------------

[casio7131]

now some results from my proper computer (win7 x64):

[I][2735] CPU vendor id : AuthenticAMD (Intel: 0)
[I][2735] CPU brand string : AMD Athlon(tm) II X4 640 Processor
[I][2735] CPU signature : Family: 16, Model: 5, Stepping: 3
[I][2735] CPU capabilities : MMX: 1, SSE: 1, SSE2: 1, SSE3: 1, SSSE3: 0, x64: 1
[I][2735] Number of CPU's : 4
[W][2895] ----------------------------------------------
[W][2895] Benchmark Results:
[W][2895] ----------------------------------------------
[W][2895] 01 -> 4.0880
[W][2895] 02 -> 2.1816
[W][2895] 03 -> 1.5990
[W][2895] 04 -> 1.4122
[W][2895] 05 -> 1.3118
[W][2895] 06 -> 1.4172
[W][2895] 07 -> 1.5563
[W][2895] 08 -> 1.4237
[W][2895] 09 -> 1.3935
[W][2895] 10 -> 1.2626
[W][2895] 11 -> 1.2880
[W][2895] 12 -> 1.3447
[W][2895] 13 -> 1.4779
[W][2895] 14 -> 1.3826
[W][2895] 15 -> 1.4733
[W][2895] 16 -> 1.4665
[W][2895] 17 -> 1.3153
[W][2895] 18 -> 1.3152
[W][2895] 19 -> 1.2568
[W][2895] 20 -> 1.2676
[W][2895] ----------------------------------------------
[W][2895] BEST: 19 of 4 (factor: 4.7500)
[W][2895] ----------------------------------------------
[C][2895] Benchmark complete. Thanks and bye bye!

[LoRd_MuldeR]

Thanks! I think we have enough results for now.