Mailing-List: contact dev-help@harmony.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@harmony.apache.org
Received-SPF: pass (athena.apache.org: domain of vladimir.k.beliaev@gmail.com
 designates 64.233.166.180 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=message-id:date:from:to:subject:in-reply-to:mime-version:content-type:references;
        b=c2uaAEdWIJTfB2GMHKWHOWb7XU/m19uMYLaLn5MaR8bTEB5emoKHPK4K/0i6LVDy0m866aHuXZESgxICAGYNtuWH9SCE/O8r2wcyx5BvsiXjXJHTkIRaJseMEzyBvF5/Vmn7bLa7IXqr83oBPDlNnbTjpHGg2cSrPZX1voaeOeg=
Message-ID: <587698b80805120513x39b75ae8u2341559562be792e@mail.gmail.com>
Date: Mon, 12 May 2008 16:13:16 +0400
From: "Vladimir Beliaev" <vladimir.k.beliaev@gmail.com>
To: dev@harmony.apache.org
Subject: Re: [testing] first M6 candidate (r653525) testing status.
In-Reply-To: <6e47b64f0805070304l38845ee0se01fb93fbfc05586@mail.gmail.com>
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----=_Part_742_21791556.1210594396816"
References: <6e47b64f0805070304l38845ee0se01fb93fbfc05586@mail.gmail.com>

------=_Part_742_21791556.1210594396816
Content-Type: text/plain; charset=WINDOWS-1252
Content-Transfer-Encoding: quoted-printable
Content-Disposition: inline

Hello, Stepan,

> 3) EUTs:
> =95 Windows x86:    99.66%
> =95 Linux   x86:    99.53%
> =95 Linux   x86_64: 99.79%

I would not call this as M6 blockers - first of all because pass rate is
over 99.5%. So we can move forward with release.

Thanks
Vladimir

2008/5/7, Stepan Mishura <stepan.mishura@gmail.com>:
>
> Hi all,
>
> Here is r653525 snapshot testing status. Briefly, there are several
> failures: some of them are intermittent (many in functional suite)
> and/or known issues (i.e there is JIRA for tracking, some of them are
> quite old). Also there are several new regressions (sigh, as usual
> :-() for investigation if they are blockers for M6 or not.
>
> Please add your comments and clarifications.
>
> 1) Classlib:
>
> Regressions on all platforms:
> org.apache.harmony.lang.management.MemoryPoolMXBeanImplTest
>
> org.apache.harmony.lang.management.tests.java.lang.management.MemoryPoolM=
XBeanTest
> org.apache.harmony.luni.tests.java.lang.ProcessBuilderTest
> org.apache.harmony.luni.tests.java.util.GregorianCalendarTest (2)
>
> New test:
> org.apache.harmony.unpack200.tests.ArchiveTest
>
> =95 Windows_x86: +1 failure
> Regression:
> org.apache.harmony.luni.tests.java.net.MulticastSocketTest
>
> =95 Linux_x86: +2 failures
> New test:
>    org.apache.harmony.nio.tests.java.nio.MappedByteBufferTest#test_isload
> Regression:
>    tests.api.java.security.PermissionCollectionTest
>
> =95 Linux_x86_64: +2 failures
> New test:
>    org.apache.harmony.nio.tests.java.nio.MappedByteBufferTest#test_isload
> Regression:
>    tests.api.java.security.PermissionCollectionTest
>
> 2) DRLVM tests:
> =95 Windows_x86_64: stress.Threads_srv (regression/crash)
>
> 3) EUTs:
> =95 Windows x86:    99.66%
> =95 Linux   x86:    99.53%
> =95 Linux   x86_64: 99.79%
>
> 4) Functional:
>
> Old regressions on all platforms:
> api.java.security.F_KeyFactoryTest_01
>    HARMONY-4857 : Bug in third-party component, regression introduced in
> M3
> api.java.text.MessageFormat
>    HARMONY-5430 : regression caused by migration to ICU
> api.java.util.jar.Manifest
>    HARMONY-5473 : regression introduced by the fix
> api.java.beans.beancontext.BeanContextTest
>    regression caused by changes in locale data
>
> New regressions on all platforms:
> api.java.beans.persistence (2)
> reg.vm.btest5625
>
> =95 Windows_x86: + 1 failure
> Regression:
>    api.java.io.ObjectOutputStream.writeObjectReadObject0030
>
> Not regression (started to fail on M5):
>    jit.HLO.devirt.Runtime.RuntimeExtend1
>
> =95 Linux_x86: +8 failures
> Regression:
>    java.math.F_BigIntegerMatrixMultiplyTest_01
>    api.java.rmi.basicexception
>    api.java.rmi.basicregistry
>    api.java.security.F_AlgorithmParametersTest_01
>    api.java.security.F_SecureRandomTest_02
>    api.java.security.F_SecureRandomTest_04
>    api.java.security.F_SecureRandomTest_05
>
> Intermittent(?):
>    api.java.net.ServerSocket
>
> =95 Windows_x86_64: +8 failures
> Regression since M4:
>    jpda.jdwp.scenario.ST07
>
> Not regression (started to fail on M5):
>    jit.HLO.devirt.Runtime.RuntimeExtend1
>
> Regression since M3,looked intermittent in M4-M5 but it stably fails
>    jit.HLO.inline.ControlFlow.IfElse.IfElse1
>    reg.vm.btest5717
>    reg.vm.btest7214
>
> Failed on M3 too, (Andrey said might be issue with the test)
>    reg.vm.btest6353
>
> Intermittent(?):
>    api.java.io.ObjectOutputStream.writeObjectReadObject0003
>    api.java.io.ObjectOutputStream.writeObjectReadObject0021
>    reg.jit.btest4318
>
> =95 Linux_x86_64:
>
> Regressions:
>    api.java.math.F_BigIntegerMatrixMultiplyTest_01
>    api.java.rmi.basicexception
>    api.java.rmi.basicregistry
>    api.java.security.F_AlgorithmParametersTest_01
>    api.java.security.F_SecureRandomTest_02
>    api.java.security.F_SecureRandomTest_04
>    api.java.security.F_SecureRandomTest_05
>    reg.jit.btest6569
>
> Regression since M4
>    jpda.jdwp.scenario.ST07
>    reg.jit.btest4318
>
> Failed on M3 too, (Andrey said might be issue with the test)
>    reg.vm.btest6353
>
> Intermittent(?):
>    api.java.math.F_BigIntegerExtEuclidTest_01
>    api.java.math.F_BigIntegerRSATest_01
>    api.java.io.ObjectOutputStream.writeObject0001
>    api.java.io.ObjectOutputStream.writeObject0003
>    api.java.io.ObjectOutputStream.writeObjectReadObject0003
>    api.java.io.ObjectOutputStream.writeObjectReadObject0007
>    api.java.io.ObjectOutputStream.writeObjectReadObject0011
>    api.java.io.ObjectOutputStream.writeObjectReadObject0015
>    api.java.io.ObjectOutputStream.writeObjectReadObject0016
>    api.java.io.ObjectOutputStream.writeObjectReadObject0022
>    api.java.io.ObjectOutputStream.writeObjectReadObject0028
>    api.java.io.ObjectOutputStream.writeObjectReadObject0040
>    api.java.io.ObjectOutputStream.writeObjectReadObject0041
>    reg.jit.btest1487
>    reg.vm.btest6008
>    reg.vm.btest7006
>
> 5) Geronimo Unit Tests
>
> =95 Linux_x86: 2 failures
> org.apache.geronimo.tomcat.ContainerTest - intermittent(?)
>
> =95 Linux_x86_64: 2 failures
> org.apache.geronimo.timer.TransactionalThreadPooledTimerTest
> - intermittent(?)
>
> 6) Reliability:
>
> =95 Windows_x86: 2 failures
> api.net.DatagramTest - HARMONY-5531
> api.net.SingleConnectTest - ???
>
> =95 Linux_x86: 3 failures
> api.net.SingleConnectTest - ???
> api.nio.charset.EncodingModesTest - intermittent(?)
> api.text.DecimalFormat_Locales - looked intermittent in M5 but it stably
> fails
>
> =95 Linux x86 64 bit: test host was down, rebooted
>
> 7) Stress: need investigation
>
> =95 Windows_x86: 4 failures
>
> Regression:
>    exceptions.catcher.StackUnwindingManyObjectsTests
>
> Intermittent:
>    classloader.NotSynchThreads.SupIntf
>    exceptions.catcher.StackUnwindingTests
>    jpda.jdwp.scenario.MIXED001
>
> =95 Linux_x86: 4 failures
> Regression:
>    exceptions.catcher.StackUnwindingManyObjectsTests
>
> HARMONY-5159 (failed on M4-M5 too):
>    gc.frag.Fragmentation
>    gc.frag.FragmentationFinalizer
>    gc.frag.FragmentationReference
>
> =95 Windows_x86_64: 3 failures
> Regression:
>    gc.mem.MemoryTest3
>    threads.StressThreads12Test
>
> Intermittent:
>    classloader.MixThreads.LargeClassName
>
> =95 Linux_x86_64: 4 failures
> Regression:
>    gc.mem.MemoryTest3
>
> Intermittent:
>    classloader.SynchThreads.LargeClassName
>    exceptions.catcher.StackUnwindingTests
>    gc.frag.FragmentationFinalizer
>
> 8) Struts & EGA: seems that both scenarios are broken
>
> Thanks,
> Stepan
>


--=20
Vladimir Beliaev
Intel Middleware Products Division

------=_Part_742_21791556.1210594396816--