harmony-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sian January" <sianjanu...@googlemail.com>
Subject Re: [general] M8 code freeze now in effect
Date Mon, 10 Nov 2008 11:49:22 GMT
Thanks Chunrong.

Are there any more comments before we start the vote, or any issues
that could be considered blockers?  If not I'll start it off in the
next few hours.

Also we'll be voting on r711744, and not r710036.  Most of the
extended testing has been done on the earlier revision, although the
integrity testing has caught up to the new one.  The changes were
extremely minor so I don't personally think this is a problem, but I
just wanted to clarify the situation before voting in case anyone else
is concerned.



2008/11/10 chunrong lai <chunronglai@gmail.com>:
> hi, colleagues:
>
> I uploaded the testing results of the reliabilities testing suite also:
>  (12) Reliability testing
>      In our batch-mode running of the 73 reliability test cases, 2 of them
> failed in Linux X86 and 5 of them failed in Windows X86_64.
>      Linux_x86:
>         api.kernel.thread.ThreadSuspendResume.ThreadSuspendResume
> (ireproducible)
>         api.kernel.threadgroup.EnumerateTest(irreproducible)
>
>      Windows x86_64:
>         api.kernel.hooks.ShtdwnHooksCornerCaseTest (irreproducible)
>         api.kernel.string.InternThreadingTest(irreproducible)
>         api.net.DatagramTest(irreproducible, HARMONY-5531)
>         api.text.DecimalFormat_Locales(ireproducible, HARMONY-5810)
>         api.zip.ZipEntryIterateThreadingTest(irreproducible)
>
>       As marked, I can not reproduce any of the failure in standalone
> running.
>       I talked with Yakushev and got guessed-cause as instable/stress OS
> state that we can often eliminate the errors by rebooting machine.
> On Fri, Nov 7, 2008 at 11:05 PM, chunrong lai <chunronglai@gmail.com> wrote:
>
>>
>> Here is the M8 candidate (r710036) testing status (
>> http://people.apache.org/~chunrong/snapshots/r710036/index.html):
>>
>> The passed test suites are: Ant Scenario (self-hosting), Axis, DRLVM
>> regression, DRLVM tests, Eclipse TPTP, scimark, Tomcat Scenario, VTS VM test
>> suites.
>>
>> (1) ClasslibTest:
>>      (1.1) All passed in windows x86_64.
>>      (1.2) org.apache.harmony.xnet.provider.jsse.SSLSocketImplTest  fails
>> in Linux_x86, since r691267 (removed the hy.no.sig option)
>>      (1.3) More concurrent test errors in Linux_x86, these failures only
>> happens with release binary so not observed in integrity testing (debug
>> build),
>>              on the other hand RI passes those test so far,
>>                       AtomicLongArrayTest
>>                              testCompareAndSet
>>                              testCompareAndSetInMultipleThreads
>>                              testCountingInMultipleThreads
>>                       AtomicLongFieldUpdaterTest
>>                              testCompareAndSet
>>                              testCompareAndSetInMultipleThreads
>>                       AtomicLongTest
>>                              testCompareAndSet
>>                              testCompareAndSetInMultipleThreads
>> (2) Dacapo:
>>      (2.1) It is reported PASSED in the snapshot testing, while running
>> with default VM options.
>>      (2.2) Buqi reported that antlr will get failed with option -Xem:opt or
>> -Xem:server, in HARMONY-5993.
>>              I have not checked previous Dacapo running with such options
>> so I do not know when the error started from.
>>      (2.3)  Running more VM options seperatedly, I also see that xalan will
>> failed with -Xem:server, in 32bits platforms (OK in 64bits platforms).
>>
>> (3) EUTs:
>>       In Linux x86 platform, the pass rate is 99.38%, slightly higher than
>> the 99.36% in M7.
>>
>> (4) Eclipse HelloWorld:
>>       A freshed running reports error since r641928, as filed in
>> HARMONY-5954.
>>       The test will pass, if it is setup/configured successfully before, as
>> in integrity testing, or the introduced workaround for an old SUN
>> JDK/Eclipse bundle (https://bugs.eclipse.org/bugs/show_bug.cgi?id=103263).
>>
>> (5) Functional tests:
>>       The pass rate is 99.2%, the status is almost same as in M7 and we
>> have 1 less total failures in the two platforms.
>>       There is only 1 new regression in Window x86_64 platform.
>>       (5.1) Old regressions in two platforms:
>>            api/java/text/MessageFormat/MessageFormatTest (HARMONY-5430)
>>            api/java/util/jar/Manifest/ManifestTest (HARMONY-5473)
>>            java/beans/beancontext/BeanContextTest
>>            api/java/beans/persistence/EncoderDecoderTest
>>            api/java/beans/persistence/EncoderTest
>>            reg/vm/btest5625/Btest5625
>>       (5.2) Old regression in 1 platform
>>            api/java/rmi/basicexception/BasicException (HARMONY-5823)
>>            api/java/rmi/basicregistry/RemoteServerTest(HARMONY-5823)
>>
>> api/java/math/F_BigIntegerMatrixMultiplyTest_01/F_BigIntegerMatrixMultiplyTest_01
>> (Timeout)
>>            org/apache/harmony/test/func/reg/jit/btest5710/Btest5710
>>            org/apache/harmony/test/func/reg/jit/btest8029/Btest8029
>>            org/apache/harmony/test/func/jpda/jdwp/scenario/ST07/ST07Test
>>            org/apache/harmony/test/func/reg/vm/btest5717/Btest5717
>> (Timeout, test too heavy)
>>            jit/HLO/devirt/Runtime/RuntimeExtend1/RuntimeExtend1 (not a
>> regression?)
>>            jit/HLO/inline/ControlFlow/IfElse/IfElse1/IfElseTest1 (looks
>> like issue in test)
>>            org/apache/harmony/test/func/reg/vm/btest6353/Btest6353  (might
>> be issue with the test)
>>       (5.3) New regression in 1 platform
>>            api/java/io/DataInputStream/DataInputStreamTest
>>
>>   6: Geronimo Unit Tests:
>>        The pass rate is 99.6%. There are 3 error tests with similar
>> java.lang.NoClassDefFoundError for CORBA some related classes,
>>         after we updated the YOKO dependencies, as filed in HARMONY-5983.
>>
>>   7:  JDK tools Test.
>>        We have same timeout issues as M7.
>>
>>   8: Jetty Scanerio.
>>        We have same Linux failure due to the unresolved HARMONY-5219.
>>
>>   9: SpecJVM 2008.
>>        The test suite pass in Windows X86_64.
>>         It also pass in Linux32 system with default options.
>>         However one of the benchmark: compress, will hang in Linux 32 bits
>> platform if with -Xem:server option.
>>
>>  10: Stress Test:
>>         Besides similar failures as M7 I observed two looks-new regressions
>> from jpda tests:
>>          jpda/jdwp/scenario/MIXED002/MixedTest002
>>          jpda/jdwp/scenario/EVENT001/EventTest001
>>         The pass rate is 97.2% in Linux x86 and 98.3% in Windows X86_64
>> platform, 0.5% lower than M7.
>>
>>  11: Struts.
>>          Same status as M7.
>>
>>
>>   11:
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> On Fri, Nov 7, 2008 at 9:20 PM, Sian January <sianjanuary@googlemail.com>wrote:
>>
>>> Great - thanks Chunrong.  In that case I think we should leave the
>>> vote until next week as there is testing still ongoing.
>>>
>>> 2008/11/7 chunrong lai <chunronglai@gmail.com>:
>>>  >  I will upload the snapshot testing result page soon.
>>> >  The reliability testing has not been finished.
>>> >
>>> >
>>> > On Fri, Nov 7, 2008 at 7:12 PM, Sian January <
>>> sianjanuary@googlemail.com>wrote:
>>> >
>>> >> Are there any objections to starting a vote for M8 later today?
>>> >>
>>> >> --
>>> >>  Unless stated otherwise above:
>>> >> IBM United Kingdom Limited - Registered in England and Wales with
>>> number
>>> >> 741598.
>>> >> Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6
>>> 3AU
>>> >>
>>> >
>>>
>>>
>>>
>>> --
>>>  Unless stated otherwise above:
>>> IBM United Kingdom Limited - Registered in England and Wales with number
>>> 741598.
>>> Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU
>>>
>>
>>
>



-- 
Unless stated otherwise above:
IBM United Kingdom Limited - Registered in England and Wales with number 741598.
Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

Mime
View raw message