harmony-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mark Hindess <mark.hind...@googlemail.com>
Subject Re: [jchevm+classlibadapter] Running classlib tests
Date Thu, 08 Jun 2006 12:52:14 GMT

On 7 June 2006 at 20:50, "Mark Hindess" <mark.hindess@googlemail.com> wrote:
> 
> With HARMONY-569, HARMONY-572 and a couple of simple hacks - like
> removing the -showversion jvm arguments from test runs - I've been
> able to run 63% of the classlib tests.  I should get more running with
> a little more effort.  The test results were:
> 
>   Tests      Failures        Errors       Success rate
>   5601       360             744          80.29%
> 
> which is v. impressive.

I've improved my wrapper script (linux only sorry) to ignore 
-showversion and handle -Xbootclasspath/[ap] appropriately.  I've 
attached this to HARMONY-583.

I had to exclude two luni tests which were causing the vm to hang:

  tests/api/java/lang/IllegalThreadStateExceptionTest.java
  tests/api/java/lang/ThreadTest.java 

But the new test results are:

  Tests      Failures        Errors       Success rate
  8348       1295            892          73.80%

which is progress even though the success rate went down.

Many of the failures share the same root causes so I think this
figure could improved pretty quickly.

I wish there was a tool to summarise the root failures out of 2000+ 
junit test reports!  Just scanning at random, the most common errors
seem to be:

1)

 not implemented                  

 java.lang.RuntimeException: not implemented at
 java.lang.ClassLoader.getResources(ClassLoader.java:224) at
 org.apache.harmony.jndi.internal.EnvironmentReader.readMultipleResourceFiles
 (EnvironmentReader.java:227) at
 org.apache.harmony.jndi.internal.EnvironmentReader$2.run
 (EnvironmentReader.java:280) at java.security.AccessController.doPrivileged
 (AccessController.java:241) at
 org.apache.harmony.jndi.internal.EnvironmentReader.readApplicationResourceFiles
 (EnvironmentReader.java:278) at javax.naming.InitialContext.internalInit
 (InitialContext.java:207) at javax.naming.InitialContext.<init>
 (InitialContext.java:151) at
 org.apache.harmony.jndi.tests.javax.naming.InitialContextMockTest.setUp
 (InitialContextMockTest.java:50)

2)

not implemented

java.lang.RuntimeException: not implemented at
org.apache.harmony.kernel.vm.VM.getNonBootstrapClassLoader(VM.java:77) at
java.io.ObjectInputStream.readObject(ObjectInputStream.java:1942) at
java.io.ObjectInputStream.readObject(ObjectInputStream.java:1901) at
javax.security.auth.SubjectTest.test_PrincipalSetInvalidSerForm
(SubjectTest.java:1297) at java.lang.reflect.Method.invokeNative
(Method.java) at org.apache.harmony.auth.internal.SecurityTest.runTest
(SecurityTest.java:109)

3) Many of the crypto/auth/security tests are failing with "implementation
   not found" type errors.

4)

META-INF/ALICE.SF has invalid digest for Test.class in /var/tmp/               
hyts_resources45209/TestCodeSigners.jar

java.lang.SecurityException: META-INF/ALICE.SF has invalid digest for
Test.class in /var/tmp/hyts_resources45209/TestCodeSigners.jar at
java.util.jar.JarVerifier.verifyCertificate(JarVerifier.java:331) at
java.util.jar.JarVerifier.readCertificates(JarVerifier.java:242) at
java.util.jar.JarFile.getInputStream(JarFile.java:340) at
org.apache.harmony.archive.tests.java.util.jar.JarEntryTest.test_getCodeSigners
(JarEntryTest.java:122) at java.lang.reflect.Method.invokeNative(Method.java)

Regards,
 Mark.



---------------------------------------------------------------------
Terms of use : http://incubator.apache.org/harmony/mailing.html
To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
For additional commands, e-mail: harmony-dev-help@incubator.apache.org


Mime
View raw message