Mailing-List: contact dev-help@harmony.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@harmony.apache.org
Received-SPF: pass (nike.apache.org: domain of alexey.v.varlamov@gmail.com
 designates 74.125.46.157 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=message-id:date:from:to:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references;
        b=QY+X2WEcCC0sfZ6kyy9vjQMQ5or90D7ee9++Khh6k0GfW9VRDRuUQDQR7hctg90SLINjTbcWO1F73GNKfs9IifMQyWnz6M4YFBUYuCLBgLVULlQxYAfhTa+YiL1xLDoljsOj6CvXBvQjxPtgvlLVC1I3Qt/UTx3x1XQqmnbygR0=
Message-ID: <f944d83d0804152232m1238c82ap3f41f5ec7ab8f697@mail.gmail.com>
Date: Wed, 16 Apr 2008 12:32:57 +0700
From: "Alexey Varlamov" <alexey.v.varlamov@gmail.com>
To: dev@harmony.apache.org
Subject: Re: [general][repos] Benchmark repository
In-Reply-To: <6e47b64f0804152203u237b78c9xe5e423d6eda94324@mail.gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
References: <4bebff790804150625v76a01165pc2c06cc5226cfcac@mail.gmail.com>
	 <211709bc0804152014j6dd7d8damef7407522a4fea4@mail.gmail.com>
	 <f944d83d0804152137j4a1e2b29y789216ee53f0d826@mail.gmail.com>
	 <6e47b64f0804152203u237b78c9xe5e423d6eda94324@mail.gmail.com>

2008/4/16, Stepan Mishura <stepan.mishura@gmail.com>:
> On 4/16/08, Alexey Varlamov <alexey.v.varlamov@gmail.com> wrote:
> > 2008/4/16, Tony Wu <wuyuehao@gmail.com>:
> > > Is it possible to integrate into BTI? if not we can consider the enhanced/tools/
> >
> > There is one already in drlvm trunk, see working_vm/src/test/microbenchmark.
> > There is no infrastructure around, it is mere store holder for now.
> > Feel free to add benches there, they are not intended to be
> > VM-specific.
> >
>
> I would say opposite if they are DRLVM specific then it is OK to put
> them to the folder. Otherwise (i.e. they are not VM-specific) we
> should integrate them to BTI.
>
> Th point is that DRLVM workspace should contain only DRLVM specific
> tests. For example, IMO DRLVM workspace is not the right place for
> EHWA-API scenario.

This is too radical position IMO. Absolute majority of tests in DRLVM
are functional and not impl-specific, should we move them all to BTI?

Sometimes convenience of using and extending is more important for
success. If we had appropriate infra for benchmarks I wouldn't argue,
but now I'm afraid most contributors would rather leave a bench-case
hanging in JIRA than dare to hack BTI. I'm happy to be proven wrong,
though.

Regards,
Alexey
>
> Thanks,
> Stepan.
>
> > Re integration to BTI, this would require fair amount of efforts and
> > usage model is not clear to me.
> >
> > >
> > > On 4/15/08, Aleksey Shipilev <aleksey.shipilev@gmail.com> wrote:
> > > > Hi Tony, all!
> > > >
> > > > Does it make sense to create special place in our repository for
> > > > storing the benchmarks like this one I've used in my performance
> > > > researches on Harmony? It would be great to have them synchronized in
> > > > repos rather than store in JIRA.
> > > >
> > > > Thanks,
> > > > Aleksey.
> > > >
> > > > On Tue, Apr 15, 2008 at 11:00 AM, Tony Wu <wuyuehao@gmail.com> wrote:
> > > > > Aleksey,
> > > > >  I think keep the benchmark somewhere such as JIRA is also ok.
> > > >
> > >
> > >
> > > --
> > > Tony Wu
> > > China Software Development Lab, IBM
> > >
> >
>