harmony-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stepan Mishura" <stepan.mish...@gmail.com>
Subject Re: classlib test suite status emails?
Date Tue, 11 Apr 2006 07:10:53 GMT
On 4/11/06, Mark Hindess wrote:

> Stepan,
>
> I have another build running (but without notifications going to the
> list) that runs:
>
> 1) build (with reference jdk)
> 2) build with what we created with 1)
> 3) test
> 4) create classlists and compare with class load data for applications
>    (tomcat, geronimo, continuum, etc.)
> 5) generate JAPI results
>
> I'd like to fail this build at step 3, but I can't see an easy way to
> get 'ant -f make/build.xml test' to run all tests and then fail if any
> of the module test sub-targets had test failures.  I could parse the
> output I suppose, but I'd rather get ant to propagate the junit tasks
> failure property back up to the top level.  I've tried a couple of
> things and none seem to work.  Any suggestions welcome.


 Mark, did you try failureproperty parameter for junit task?
We may add it to ant sub-targets to raise a flag, for example, create file "
TESTS.FAILED" in the root,  when tests for some module fail. And in the end
of tests suite run check whether this file exists on not.

Thanks,
Stepan.


Regards,
> Mark.
>
> On 4/11/06, Stepan Mishura <stepan.mishura@gmail.com> wrote:
> > Hi,
> >
> > I've checked out at morning last updates, built the code base and run
> the
> > tests …and there are 24 tests failures!
> >
> > There are 9 tests failures in
> > org.apache.harmony.tests.java.nio.channels.DatagramChannelTest – I saw
> these
> > failures before from time to time. It seems that tests depend on some
> race
> > conditions because they may pass if I rerun them. Paulex, are these
> tests
> > passing for you?
> >
> > And there are new 15 test failures.  So now if I'll make a code update
> or a
> > bug fix how I can be 100% sure that I don't do any regression?
> >
> > Currently if a commit breaks the Harmony classlib build a notification
> with
> > subject: "[continuum] BUILD FAILURE: Classlib/linux.ia32" will be send
> to
> > harmony-commits mailing list. Is it possible to have the same for tests?
> I
> > mean that after completing automatic build the existing classlib tests
> suite
> > should be run. If there are failing tests then a report notification
> with
> > corresponding subject will be send.
> >
> > Thanks,
> > Stepan Mishura
> > Intel Middleware Products Division
>
> --
> Mark Hindess <mark.hindess@googlemail.com>
> IBM Java Technology Centre, UK.
>
> ---------------------------------------------------------------------
> Terms of use : http://incubator.apache.org/harmony/mailing.html
> To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> For additional commands, e-mail: harmony-dev-help@incubator.apache.org
>
>


--
---------------------------------------------------------------------
Terms of use : http://incubator.apache.org/harmony/mailing.html
To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
For additional commands, e-mail: harmony-dev-help@incubator.apache.org

Thanks,
Stepan Mishura
Intel Middleware Products Division

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message