harmony-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anton Luht" <anton.l...@gmail.com>
Subject Re: [testing] Tests scores on http://harmonytest.org Was: [DRLVM] General stability
Date Mon, 13 Nov 2006 06:57:01 GMT
Alexei,

> I like your approach to result comparison. 10% can be default value
> for some form field - anyone can change it if needed.

OK, let's try it and see if it satisfies the community/

> Probably more conventional would be to parse
> <system-out><![CDATA[]]></system-out> for some metric. Does the site
> already parse TEST-* files?

It parses TESTS-TestSuites.xml  - as far as I can see, it contains the
same information as TEST-* files. Is there a common format of output
of stress tests you're talking about?


>
> Thank you, Alexei
>
> On 11/10/06, Anton Luht <anton.luht@gmail.com> wrote:
> > Hello, Alexei,
> >
> > > I have related question. How can we improve http://harmonytest.org to
> > > make it possible to publish not just pass, fail, or error but numeric
> > > test scores?
> >
> > Easily - test results in JUnit reports have 'time' property -
> > execution time in seconds. We can import and show them in the results.
> > What else is needed? Maybe add something like 'show regressions' to
> > the the 'compare runs' page? For example, show tests that increased
> > execution time by more than 10% sorted by increase rate desc?
> >
> > --
> > Regards,
> > Anton Luht,
> > Intel Java & XML Engineering
> >
>
>
> --
> Thank you,
> Alexei
>


-- 
Regards,
Anton Luht,
Intel Java & XML Engineering

Mime
View raw message