harmony-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Volynets, Vera" <vera.volyn...@intel.com>
Subject RE: [classlib][test] Site to collect classlib test statistics
Date Fri, 06 Oct 2006 12:51:01 GMT
Alexey,
Thank you for your response.
As I understood I'm working on the same problem,
I write scripts to run different tests(cunit, classlib, smoke, kernel,
specjvm98) and collect statistics. 
I do it to track patch which was reason of failure of any test. So bug
propagation would be stopped.
The final result is presented like table with name and state
(passed/failed).  
My next step was to use mysql database, php and Apache server to make my
system user-friendly. Also I need to think out algorithm to find
"guilty" revision. Now I run tests only on Windows and only on my
machine.
I think it's a good idea to keep in touch and collaborate!
It's useful to have this system on Harmony,
because each contributor can see how his patch effect the virtual
machine!!! 

With best regards, Vera!

-----Original Message-----
From: Alexey Varlamov [mailto:alexey.v.varlamov@gmail.com] 
Sent: Friday, October 06, 2006 4:14 PM
To: harmony-dev@incubator.apache.org
Subject: Re: [classlib][test] Site to collect classlib test statistics

Thanks for prompt response!
Those 554 errors on interpreter are due to fork mode="once", it is a
single error affecting the whole run. Is there a way to delete an
uploaded run?

Better yet, to be able select a range of runs to include to analysis.
The appetite comes with eating :)
Criteria to select can vary, one of many possible is execution engine
- it would be nice to have such characteristic of a run ...


2006/10/6, Anton Luht <anton.luht@gmail.com>:
> Alexey,
>
> I've added both options - search by test name and list of tests that
> ever failed. The second one is very big because of results you've
> uploaded for DRLVM/Linux with 554 errors. Please tell me if you want
> to change anything in the interface.
>
> On 10/6/06, Alexey Varlamov <alexey.v.varlamov@gmail.com> wrote:
> > Anton,
> >
> > Many thanks for exploring this area, it looks quite promising.
> > An idea: this service would become more valuable if presented
> > transparent search/comparison of results for particular tests over
all
> > uploaded runs.
> > Let user enter name of a test and show in one table all known
results
> > for this test, or even better, provide a table of all ever failed
> > tests with links to individual consolidated tables.
> > This would help analyzing failures very much.
> >
> > --
> > Regards,
> > Alexey
> >
> > 2006/10/4, Anton Luht <anton.luht@gmail.com>:
> > > Hello,
> > >
> > > > Could you tell about it in more detail?
> > > > 1) Who can upload test results?
> > >
> > > Everyone - no authorization is needed, you can include file upload
to
> > > your regular builds if you want - authorized users can remove them
> > > later if something goes wrong :) If you want to modify uploaded
tests'
> > > data - add JIRA issues to failures, add comments, etc - please
send me
> > > login/password and I'll create an account.
> > >
> > > > 2) How are you going to develop this site, structure, data base
and
> > > > etc.?
> > >
> > > I'll try to implement all feature requests that community members
will
> > > express. One of possible directions I see is support for new test
> > > suites  - currently it  recognises only Harmony  classlib JUnit
tests
> > > output. If you have another test suite you want to upload to that
site
> > > - just send me an archive and I'll  try to add support for this
kind
> > > of tests.
> > >
> > > Sources of that app are not in SVN now - if you want to
> > > review/fix/improve something - I can send you an archive.
> > > --
> > > Regards,
> > > Anton Luht,
> > > Intel Middleware Products Division
> > >
> > >
---------------------------------------------------------------------
> > > Terms of use : http://incubator.apache.org/harmony/mailing.html
> > > To unsubscribe, e-mail:
harmony-dev-unsubscribe@incubator.apache.org
> > > For additional commands, e-mail:
harmony-dev-help@incubator.apache.org
> > >
> > >
> >
> >
---------------------------------------------------------------------
> > Terms of use : http://incubator.apache.org/harmony/mailing.html
> > To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> > For additional commands, e-mail:
harmony-dev-help@incubator.apache.org
> >
> >
>
>
> --
> Regards,
> Anton Luht,
> Intel Middleware Products Division
>
> ---------------------------------------------------------------------
> Terms of use : http://incubator.apache.org/harmony/mailing.html
> To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> For additional commands, e-mail: harmony-dev-help@incubator.apache.org
>
>

---------------------------------------------------------------------
Terms of use : http://incubator.apache.org/harmony/mailing.html
To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
For additional commands, e-mail: harmony-dev-help@incubator.apache.org

---------------------------------------------------------------------
Terms of use : http://incubator.apache.org/harmony/mailing.html
To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
For additional commands, e-mail: harmony-dev-help@incubator.apache.org


Mime
View raw message