harmony-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "chunrong lai" <chunrong...@gmail.com>
Subject Re: [general] M8 code freeze now in effect
Date Mon, 10 Nov 2008 08:15:00 GMT
hi, colleagues:

I uploaded the testing results of the reliabilities testing suite also:
 (12) Reliability testing
      In our batch-mode running of the 73 reliability test cases, 2 of them
failed in Linux X86 and 5 of them failed in Windows X86_64.
      Linux_x86:
         api.kernel.thread.ThreadSuspendResume.ThreadSuspendResume
(ireproducible)
         api.kernel.threadgroup.EnumerateTest(irreproducible)

      Windows x86_64:
         api.kernel.hooks.ShtdwnHooksCornerCaseTest (irreproducible)
         api.kernel.string.InternThreadingTest(irreproducible)
         api.net.DatagramTest(irreproducible, HARMONY-5531)
         api.text.DecimalFormat_Locales(ireproducible, HARMONY-5810)
         api.zip.ZipEntryIterateThreadingTest(irreproducible)

       As marked, I can not reproduce any of the failure in standalone
running.
       I talked with Yakushev and got guessed-cause as instable/stress OS
state that we can often eliminate the errors by rebooting machine.
On Fri, Nov 7, 2008 at 11:05 PM, chunrong lai <chunronglai@gmail.com> wrote:

>
> Here is the M8 candidate (r710036) testing status (
> http://people.apache.org/~chunrong/snapshots/r710036/index.html):
>
> The passed test suites are: Ant Scenario (self-hosting), Axis, DRLVM
> regression, DRLVM tests, Eclipse TPTP, scimark, Tomcat Scenario, VTS VM test
> suites.
>
> (1) ClasslibTest:
>      (1.1) All passed in windows x86_64.
>      (1.2) org.apache.harmony.xnet.provider.jsse.SSLSocketImplTest  fails
> in Linux_x86, since r691267 (removed the hy.no.sig option)
>      (1.3) More concurrent test errors in Linux_x86, these failures only
> happens with release binary so not observed in integrity testing (debug
> build),
>              on the other hand RI passes those test so far,
>                       AtomicLongArrayTest
>                              testCompareAndSet
>                              testCompareAndSetInMultipleThreads
>                              testCountingInMultipleThreads
>                       AtomicLongFieldUpdaterTest
>                              testCompareAndSet
>                              testCompareAndSetInMultipleThreads
>                       AtomicLongTest
>                              testCompareAndSet
>                              testCompareAndSetInMultipleThreads
> (2) Dacapo:
>      (2.1) It is reported PASSED in the snapshot testing, while running
> with default VM options.
>      (2.2) Buqi reported that antlr will get failed with option -Xem:opt or
> -Xem:server, in HARMONY-5993.
>              I have not checked previous Dacapo running with such options
> so I do not know when the error started from.
>      (2.3)  Running more VM options seperatedly, I also see that xalan will
> failed with -Xem:server, in 32bits platforms (OK in 64bits platforms).
>
> (3) EUTs:
>       In Linux x86 platform, the pass rate is 99.38%, slightly higher than
> the 99.36% in M7.
>
> (4) Eclipse HelloWorld:
>       A freshed running reports error since r641928, as filed in
> HARMONY-5954.
>       The test will pass, if it is setup/configured successfully before, as
> in integrity testing, or the introduced workaround for an old SUN
> JDK/Eclipse bundle (https://bugs.eclipse.org/bugs/show_bug.cgi?id=103263).
>
> (5) Functional tests:
>       The pass rate is 99.2%, the status is almost same as in M7 and we
> have 1 less total failures in the two platforms.
>       There is only 1 new regression in Window x86_64 platform.
>       (5.1) Old regressions in two platforms:
>            api/java/text/MessageFormat/MessageFormatTest (HARMONY-5430)
>            api/java/util/jar/Manifest/ManifestTest (HARMONY-5473)
>            java/beans/beancontext/BeanContextTest
>            api/java/beans/persistence/EncoderDecoderTest
>            api/java/beans/persistence/EncoderTest
>            reg/vm/btest5625/Btest5625
>       (5.2) Old regression in 1 platform
>            api/java/rmi/basicexception/BasicException (HARMONY-5823)
>            api/java/rmi/basicregistry/RemoteServerTest(HARMONY-5823)
>
> api/java/math/F_BigIntegerMatrixMultiplyTest_01/F_BigIntegerMatrixMultiplyTest_01
> (Timeout)
>            org/apache/harmony/test/func/reg/jit/btest5710/Btest5710
>            org/apache/harmony/test/func/reg/jit/btest8029/Btest8029
>            org/apache/harmony/test/func/jpda/jdwp/scenario/ST07/ST07Test
>            org/apache/harmony/test/func/reg/vm/btest5717/Btest5717
> (Timeout, test too heavy)
>            jit/HLO/devirt/Runtime/RuntimeExtend1/RuntimeExtend1 (not a
> regression?)
>            jit/HLO/inline/ControlFlow/IfElse/IfElse1/IfElseTest1 (looks
> like issue in test)
>            org/apache/harmony/test/func/reg/vm/btest6353/Btest6353  (might
> be issue with the test)
>       (5.3) New regression in 1 platform
>            api/java/io/DataInputStream/DataInputStreamTest
>
>   6: Geronimo Unit Tests:
>        The pass rate is 99.6%. There are 3 error tests with similar
> java.lang.NoClassDefFoundError for CORBA some related classes,
>         after we updated the YOKO dependencies, as filed in HARMONY-5983.
>
>   7:  JDK tools Test.
>        We have same timeout issues as M7.
>
>   8: Jetty Scanerio.
>        We have same Linux failure due to the unresolved HARMONY-5219.
>
>   9: SpecJVM 2008.
>        The test suite pass in Windows X86_64.
>         It also pass in Linux32 system with default options.
>         However one of the benchmark: compress, will hang in Linux 32 bits
> platform if with -Xem:server option.
>
>  10: Stress Test:
>         Besides similar failures as M7 I observed two looks-new regressions
> from jpda tests:
>          jpda/jdwp/scenario/MIXED002/MixedTest002
>          jpda/jdwp/scenario/EVENT001/EventTest001
>         The pass rate is 97.2% in Linux x86 and 98.3% in Windows X86_64
> platform, 0.5% lower than M7.
>
>  11: Struts.
>          Same status as M7.
>
>
>   11:
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> On Fri, Nov 7, 2008 at 9:20 PM, Sian January <sianjanuary@googlemail.com>wrote:
>
>> Great - thanks Chunrong.  In that case I think we should leave the
>> vote until next week as there is testing still ongoing.
>>
>> 2008/11/7 chunrong lai <chunronglai@gmail.com>:
>>  >  I will upload the snapshot testing result page soon.
>> >  The reliability testing has not been finished.
>> >
>> >
>> > On Fri, Nov 7, 2008 at 7:12 PM, Sian January <
>> sianjanuary@googlemail.com>wrote:
>> >
>> >> Are there any objections to starting a vote for M8 later today?
>> >>
>> >> --
>> >>  Unless stated otherwise above:
>> >> IBM United Kingdom Limited - Registered in England and Wales with
>> number
>> >> 741598.
>> >> Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6
>> 3AU
>> >>
>> >
>>
>>
>>
>> --
>>  Unless stated otherwise above:
>> IBM United Kingdom Limited - Registered in England and Wales with number
>> 741598.
>> Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message