harmony-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stefano Mazzocchi <stef...@apache.org>
Subject Re: [performance] harmony 'release' results included
Date Wed, 22 Nov 2006 07:18:03 GMT
Robin Garner wrote:
> Stefano,
> 
> Which iteration of the benchmark are you timing ?  

ehm, the first.

> This can make a huge
> difference (our postion is argued in our OOPSLA paper here
> http://www.dacapobench.org/dacapo-oopsla-2006.pdf).

I can't seem to be able to read this PDF file, acrobat complains and
macosx preview reads only parts of it. am I the only one having trouble
with this?

> It would be really informative to see these results plotted for 1st, 2nd
> and 3rd iteration, for a range of heap sizes.

I'll see what I can do. I'll try to run dacapo as well.

> cheers
> 
> Stefano Mazzocchi wrote:
>> I've built a 'release' version of Harmony and I'm incorporating the new
>> results in the previous runs.
>>
>> --------------------------------------------------------------------------
>>
>>
>> harmony-debug
>> -------------
>> Apache Harmony Launcher : (c) Copyright 1991, 2006 The Apache Software
>> Foundation or its licensors, as applicable.
>> java version "1.5.0"
>> pre-alpha : not complete or compatible
>> svn = r476006, (Nov 16 2006), Linux/em64t/gcc 4.0.3, debug build
>>
>> harmony-release
>> ---------------
>> Apache Harmony Launcher : (c) Copyright 1991, 2006 The Apache Software
>> Foundation or its licensors, as applicable.
>> java version "1.5.0"
>> pre-alpha : not complete or compatible
>> svn = r476234, (Nov 17 2006), Linux/em64t/gcc 4.0.3, release build
>>
>> sun5
>> ---
>> java version "1.5.0_09"
>> Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_09-b03)
>> Java HotSpot(TM) 64-Bit Server VM (build 1.5.0_09-b03, mixed mode)
>>
>> sun6
>> ----
>> java version "1.6.0-rc"
>> Java(TM) SE Runtime Environment (build 1.6.0-rc-b104)
>> Java HotSpot(TM) 64-Bit Server VM (build 1.6.0-rc-b104, mixed mode)
>>
>> ibm
>> ---
>> java version "1.5.0"
>> Java(TM) 2 Runtime Environment, Standard Edition (build
>> pxa64dev-20061002a (SR3) )
>> IBM J9 VM (build 2.3, J2RE 1.5.0 IBM J9 2.3 Linux amd64-64
>> j9vmxa6423-20061001 (JIT enabled)
>> J9VM - 20060915_08260_LHdSMr
>> JIT  - 20060908_1811_r8
>> GC   - 20060906_AA)
>> JCL  - 20061002
>>
>> bea
>> ---
>> java version "1.5.0_06"
>> Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_06-b05)
>> BEA JRockit(R) (build
>> R26.4.0-63-63688-1.5.0_06-20060626-2259-linux-x86_64, )
>>
>>
>> --------------------------------------------------------------------------
>>
>>
>> Test #1: java scimark2 (http://math.nist.gov/scimark2/)
>>
>> command: java jnt.scimark2.commandline
>>
>> Sun6
>> Composite Score: 364.5832265230057
>> FFT (1024): 220.8458713892794
>> SOR (100x100):   696.1542342357722
>> Monte Carlo : 149.37978088875656
>> Sparse matmult (N=1000, nz=5000): 326.37451873283845
>> LU (100x100): 430.1617273683819
>>
>> BEA
>> Composite Score: 359.13480378697835
>> FFT (1024): 303.8746880751562
>> SOR (100x100):   454.25628897202307
>> Monte Carlo : 93.23913192138497
>> Sparse matmult (N=1000, nz=5000): 530.44112637391
>> LU (100x100): 413.8627835924175
>>
>> Sun5
>> Composite Score: 332.84987587548574
>> FFT (1024): 216.5144595799027
>> SOR (100x100):   689.429322146947
>> Monte Carlo : 25.791262124978065
>> Sparse matmult (N=1000, nz=5000): 317.5193965699373
>> LU (100x100): 414.99493895566377
>>
>> IBM
>> Composite Score: 259.8249218693683
>> FFT (1024): 296.8415012789055
>> SOR (100x100):   428.974881649179
>> Monte Carlo : 89.15159857584082
>> Sparse matmult (N=1000, nz=5000): 144.3524241203982
>> LU (100x100): 339.8042037225181
>>
>> Harmony-release
>> Composite Score: 124.6867792398682
>> FFT (1024): 214.17495491343038
>> SOR (100x100):   243.36384871876157
>> Monte Carlo : 14.886614559623572
>> Sparse matmult (N=1000, nz=5000): 71.70240430885481
>> LU (100x100): 79.30607369867067
>>
>> Harmony-debug
>> Composite Score: 113.65082278962575
>> FFT (1024): 203.76641991778123
>> SOR (100x100):   224.37761309236748
>> Monte Carlo : 9.063866256533116
>> Sparse matmult (N=1000, nz=5000): 65.4051866327227
>> LU (100x100): 65.6410280487242
>>
>> --------------------------------------------------------------------------
>>
>>
>> Test 2: Dhrystones (http://www.c-creators.co.jp/okayan/DhrystoneApplet/)
>>
>> command: java dhry 100000000
>>
>> sun6:             8552856 dhrystones/sec
>> sun5:             6605892
>> bea:              5678914
>> harmony-release   1132348
>> harmony-debug      669734
>> ibm:               501562
>>
>> --------------------------------------------------------------------------
>>
>>
>> Test 3: Sieve (part of http://www.sax.de/~adlibit/tya18.tgz)
>>
>> command: java Sieve 30
>>
>> sun6            8545 sieves/sec
>> sun5            8364
>> bea             6174
>> harmony-release 1848
>> harmony-debug   1836
>> ibm              225
>>
>>
> 
> 


-- 
Stefano.


Mime
View raw message