harmony-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "LvJimmy,Jing" <firep...@gmail.com>
Subject Re: classlib test suite status emails?
Date Wed, 12 Apr 2006 02:29:14 GMT
So it really happens... platform dependency, or platform-release dependenecy
make things in mess.
In my opinion, George Harley's method of grouping test above and in the
threads of "matching reference implementation exception behaviour" is fairly
good.
And another serious problem leaves here: how can we know, the test is
platfrom dependency? Yes, some of them are obvious, but the other, just like
the problems here, are not.

2006/4/11, Paulex Yang <paulex.yang@gmail.com>:
>
> Stepan Mishura wrote:
> > On 4/11/06, Paulex Yang wrote:
> >
> >
> >> Stepan Mishura wrote:
> >>
> >>> Hi,
> >>>
> >>> I've checked out at morning last updates, built the code base and run
> >>>
> >> the
> >>
> >>> tests ¡­and there are 24 tests failures!
> >>>
> >>> There are 9 tests failures in
> >>> org.apache.harmony.tests.java.nio.channels.DatagramChannelTest ¨C I saw
> >>>
> >> these
> >>
> >>> failures before from time to time. It seems that tests depend on some
> >>>
> >> race
> >>
> >>> conditions because they may pass if I rerun them. Paulex, are these
> >>>
> >> tests
> >>
> >>> passing for you?
> >>>
> >>>
> >>>
> >> Mishura
> >>
> >> the channels test cases on my workstations(yes I tried on several
> >> machines) always pass, but it is still possible that some of them are
> >> unstable and depend on race condition for others, I might miss to catch
> >> them by mistake. Would you pls. give me more details about the failure?
>
> >> I'll  try to investigate them further. thank you.
> >>
> >
> >
> > I've run tests on Linux. They fail on the same assertion:
> >     [junit] Testcase: testReceiveSend_Block_Normal(
> > org.apache.harmony.tests.java.nio.channels.DatagramChannelTest):
> FAILED
> >     [junit] expected:<...> but was:<....localdomain>
> >     [junit] junit.framework.ComparisonFailure: expected:<...> but
> > was:<....localdomain>
> >     [junit]     at
> >
> org.apache.harmony.tests.java.nio.channels.DatagramChannelTest.receiveByChannel
> > (DatagramChannelTest.java:1681)
> >     [junit]     at
> >
> org.apache.harmony.tests.java.nio.channels.DatagramChannelTest.testReceiveSend_Block_Normal
> > (DatagramChannelTest.java:1419)
> >     [junit]     at java.lang.reflect.AccessibleObject.invokeV(
> > AccessibleObject.java :205)
> >
> Stepan,
>
> Thank you for the information.
> > As far as JUnit didn't print what result was expected to get I inserted
> > printing to the test and got the following:
> > Expected host: localhost.localdomain
> > Recieved host:  localhost
> >
> > Why do you expect that on Linux "localhost.localdomain" should be
> returned?
> >
> Well,  that is because both RI/Harmony return this value on my test
> machines(Redhat ES 3, Redhat 9 and latest stable Debian),  and I didn't
> expect this value is dependent on configuration(or Linux distribution?
> ), but as your test result shows, it probably does! So would you tell me
> your linux distro version and configuration( for example, what it looks
> like of the item on localhost in /etc/hosts)? so that I can check if
> this constant value(localhost.localdomain) is platform dependent.
>
> And I'll also look more inside to see if there can be other cause except
> for the possible platform difference.
> > Thanks,
> > Stepan.
> >
> >
> >
> >> And before everything's OK, I'm fine if you choose to add
> >> DatagramChannelTest into exclude list, by adding it to Ln.94 of
> >> modules/nio/make/common/build.xml, just as ServerSocketChannelTest.
> >>
> >> Sorry for the inconvenience caused.
> >>
> >>> And there are new 15 test failures.  So now if I'll make a code update
>
> >>>
> >> or a
> >>
> >>> bug fix how I can be 100% sure that I don't do any regression?
> >>>
> >>> Currently if a commit breaks the Harmony classlib build a notification
>
> >>>
> >> with
> >>
> >>> subject: "[continuum] BUILD FAILURE: Classlib/linux.ia32" will be send
> >>>
> >> to
> >>
> >>> harmony-commits mailing list. Is it possible to have the same for
> tests?
> >>>
> >> I
> >>
> >>> mean that after completing automatic build the existing classlib tests
> >>>
> >> suite
> >>
> >>> should be run. If there are failing tests then a report notification
> >>>
> >> with
> >>
> >>> corresponding subject will be send.
> >>>
> >>> Thanks,
> >>> Stepan Mishura
> >>> Intel Middleware Products Division
> >>> ---------------------------------------------------------------------
> >>> Terms of use : http://incubator.apache.org/harmony/mailing.html
> >>> To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> >>> For additional commands, e-mail: harmony-dev-help@incubator.apache.org
> >>>
> >>>
> >>>
> >> --
> >> Paulex Yang
> >> China Software Development Lab
> >> IBM
> >>
> >>
> >>
> >> ---------------------------------------------------------------------
> >> Terms of use : http://incubator.apache.org/harmony/mailing.html
> >> To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> >> For additional commands, e-mail: harmony-dev-help@incubator.apache.org
> >>
> >>
> >>
> >
> >
> > --
> > ---------------------------------------------------------------------
> > Terms of use : http://incubator.apache.org/harmony/mailing.html
> > To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> > For additional commands, e-mail: harmony-dev-help@incubator.apache.org
> >
> > Thanks,
> > Stepan Mishura
> > Intel Middleware Products Division
> >
> >
>
>
> --
> Paulex Yang
> China Software Development Lab
> IBM
>
>
>
> ---------------------------------------------------------------------
> Terms of use : http://incubator.apache.org/harmony/mailing.html
> To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> For additional commands, e-mail: harmony-dev-help@incubator.apache.org
>
>


--

Best Regards!

Jimmy, Jing Lv
China Software Development Lab, IBM
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message