harmony-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Geir Magnusson Jr." <g...@pobox.com>
Subject Re: [classlib][general] How to test the performance of Harmony
Date Fri, 26 Jan 2007 21:15:58 GMT
One issue will be repeatability.  We should prejudice our benchmark  
tracking based on configurations using project facilities, like build- 
test.

geir


On Jan 26, 2007, at 11:58 AM, Rana Dasgupta wrote:

> That sounds like the right way. We will,  put up a page on Harmony  
> with
> results on some typical benchmarks like Scimark, DaCapo including
> configuration used, results etc. We can use that as a start to  
> understand
> progress over time.
>
> If folks are interested in tracking more benchmarks, they can add  
> to the
> page and post results that they are actively tracking.
>
> Rana
>
>
>
> On 1/25/07, Alexey Petrenko <alexey.a.petrenko@gmail.com> wrote:
>>
>> 2007/1/26, Robin Garner <robin.garner@anu.edu.au>:
>> > Two suggestions:
>> >
>> > 1) Control (and report!) the heap size (using -Xmx and -Xms).
>> There is a lot of VM options which affects performance and we
>> definetly plan to report full config: hardware/software configuration
>> and list of options.
>>
>> > 2) Use '-n 3' and report all 3 iterations.
>> >
>> > cheers
>> >
>> > > We are planning to start running benchmarks regularly on  
>> Harmony in
>> > > the nearest future. We are testing the infrastructure now...
>> > >
>> > > SY, Alexey
>> > >
>> > > 2007/1/25, Leo Li <liyilei1979@gmail.com>:
>> > >> Hi, all:
>> > >>     With the progress of Harmony project, I think,  
>> performance is
>> > >> gradually
>> > >> becoming an important feature for our real customers. Besides  
>> the
>> > >> stability
>> > >> and compatibility, users would incline to choose the one with  
>> higher
>> > >> speed. Aside from VM, classlib itself also plays a  
>> significant role
>> in
>> > >> performance.
>> > >>    Although we now know some issues that are performance  
>> related, in
>> a
>> > >> long
>> > >> run, we need performace test results to pick out the hotspot in
>> Harmony
>> > >> project. Without data, we are like blind men running in the  
>> dark, in
>> the
>> > >> area of performance.
>> > >>    Is there any advice about the tools to test the  
>> performance of
>> > >> Harmony?
>> > >>    Actually, if my remember is right, some guys have actually  
>> run the
>> > >> performance tests. (But I forget where the mail is.)Maybe we  
>> can post
>> > >> the
>> > >> result on Harmony wiki thus we can have a baseline to improve  
>> our
>> > >> code.:)
>> > >>
>> > >> Thanks.
>> > >> --
>> > >> Leo Li
>> > >> China Software Development Lab, IBM
>> > >>
>> > >>
>> > >
>> >
>> >
>> >
>>


Mime
View raw message