harmony-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Harmony Wiki] Trivial Update of "Reliability Tests on DRLVM" by AndreyYakushev
Date Tue, 29 Jan 2008 10:21:53 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Harmony Wiki" for change notification.

The following page has been changed by AndreyYakushev:
http://wiki.apache.org/harmony/Reliability_Tests_on_DRLVM

------------------------------------------------------------------------------
  
  '''Here are the results of failures analysis'''
  
- Pass rates according to [http://people.apache.org/~mloenko/snapshot_testing/script/r612947/index.html
cruise control results]:
+ Pass rates according to [http://people.apache.org/~mloenko/snapshot_testing/script/r615453/index.html
cruise control results]:
  
  ||Platform    ||Valid||Failed||Excluded||Failed+excluded||Pass rate||Covered by JIRA||
  ||Windows x86 ||86   ||12    ||10      ||             22||      75%||             10||
- ||Linux x86   ||86   || 7    ||12      ||             19||      78%||             15||
+ ||Linux x86   ||86   || 5    ||12      ||             17||      80%||             15||
- ||Linux x86_64||86   || 3    ||28      ||             31||      63%||             31||
+ ||Linux x86_64||86   || 3    ||27      ||             30||      65%||             30||
  
  
  Results for Windows x86 are very old, no valid CC run on December and January. I obtained
only 3 fail in my local test run.
@@ -39, +39 @@

  ||12||api.text.CollationKeyTest|| [https://issues.apache.org/jira/browse/HARMONY-2752 HARMONY-2752
], hang|| No - ICU bug||
  ||13||api.text.CollationKeyTest_ArrHash|| [https://issues.apache.org/jira/browse/HARMONY-2752
HARMONY-2752 ], hang|| No - ICU bug||
  ||14||api.text.getAvailableLocals_RBC|| [https://issues.apache.org/jira/browse/HARMONY-2742
HARMONY-2742 ], HARMONY-3224, hang||  ||
- ||15||api.text.getSentenceInstance|| [https://issues.apache.org/jira/browse/HARMONY-4215
HARMONY-4215 ], mostly reproduced on release build||  ||
- ||16||api.text.getSentenceInstance_check|| [https://issues.apache.org/jira/browse/HARMONY-62
HARMONY-62 ]|| No - ICU bug||
+ ||15||api.text.getSentenceInstance_check|| [https://issues.apache.org/jira/browse/HARMONY-62
HARMONY-62 ]|| No - ICU bug||
- ||17||vm.classloading.ClassAttributesTest|| [https://issues.apache.org/jira/browse/HARMONY-3680
HARMONY-3680 ], reproduced on release build only||  ||
+ ||16||vm.classloading.ClassAttributesTest|| [https://issues.apache.org/jira/browse/HARMONY-3680
HARMONY-3680 ], reproduced on release build only||  ||
- ||18||vm.classloading.ClassReflectionTest|| [https://issues.apache.org/jira/browse/HARMONY-3680
HARMONY-3680 ], reproduced on release build only||  ||
+ ||17||vm.classloading.ClassReflectionTest|| [https://issues.apache.org/jira/browse/HARMONY-3680
HARMONY-3680 ], reproduced on release build only||  ||
- ||19||vm.classloading.ClassUnloadingTest|| [https://issues.apache.org/jira/browse/HARMONY-2039
HARMONY-2039 ], no class unloading|| no class unloading||
+ ||18||vm.classloading.ClassUnloadingTest|| [https://issues.apache.org/jira/browse/HARMONY-2039
HARMONY-2039 ], no class unloading|| no class unloading||
- ||20||vm.classloading.MultiThreadedLoading|| [https://issues.apache.org/jira/browse/HARMONY-2039
HARMONY-2039 ], no class unloading|| no class unloading||
+ ||19||vm.classloading.MultiThreadedLoading|| [https://issues.apache.org/jira/browse/HARMONY-2039
HARMONY-2039 ], no class unloading|| no class unloading||
- ||21||vm.finalization.ArrayElemFinalizationTest|| [https://issues.apache.org/jira/browse/HARMONY-4413
HARMONY-4413 ]   - test issue||test issue||
+ ||20||vm.finalization.ArrayElemFinalizationTest|| [https://issues.apache.org/jira/browse/HARMONY-4413
HARMONY-4413 ]   - test issue||test issue||
- ||22||vm.stack.StackFramesRestoreTest|| [https://issues.apache.org/jira/browse/HARMONY-2039
HARMONY-2039 ], no class unloading||no class unloading||
+ ||21||vm.stack.StackFramesRestoreTest|| [https://issues.apache.org/jira/browse/HARMONY-2039
HARMONY-2039 ], no class unloading||no class unloading||
- ||23||api.kernel.hooks.AddRmPropertiesHooksTest|| [https://issues.apache.org/jira/browse/HARMONY-5172
HARMONY-5172 ], assert in debug mode||||
+ ||22||api.kernel.hooks.AddRmPropertiesHooksTest|| [https://issues.apache.org/jira/browse/HARMONY-5172
HARMONY-5172 ], assert in debug mode||||
- ||24||api.kernel.thread.VolatileVariableTest.DekkerTest|| [https://issues.apache.org/jira/browse/HARMONY-5295
HARMONY-5295 ]||intermittent hang, also sometimes failed on SUN and BEA; probably test issue||
+ ||23||api.kernel.thread.VolatileVariableTest.DekkerTest|| [https://issues.apache.org/jira/browse/HARMONY-5295
HARMONY-5295 ]||intermittent hang, also sometimes failed on SUN and BEA; probably test issue||
- ||25||api.kernel.thread.Calculation.CalcTest|| [https://issues.apache.org/jira/browse/HARMONY-5334
HARMONY-5334 ]||increased memory leak||
+ ||24||api.kernel.thread.Calculation.CalcTest|| [https://issues.apache.org/jira/browse/HARMONY-5334
HARMONY-5334 ]increased memory leak|| ||
- ||26||api.kernel.thread.ThreadArrayTest.ThreadArrayTest|| [https://issues.apache.org/jira/browse/HARMONY-5334
HARMONY-5334 ]||increased memory leak||
+ ||25||api.kernel.thread.ThreadArrayTest.ThreadArrayTest|| [https://issues.apache.org/jira/browse/HARMONY-5334
HARMONY-5334 ]increased memory leak|| ||
- ||27||api.kernel.object.ObjectFinalizeTest|| [https://issues.apache.org/jira/browse/HARMONY-5334
HARMONY-5334 ]||increased memory leak||
+ ||26||api.kernel.object.ObjectFinalizeTest|| [https://issues.apache.org/jira/browse/HARMONY-5334
HARMONY-5334 ]increased memory leak|| ||
  
  
  '''Linux x86_64 reliability excluded test status'''
@@ -78, +77 @@

  ||18||api.kernel.thread.ThreadArrayTest.ThreadArrayTest || [https://issues.apache.org/jira/browse/HARMONY-5042
HARMONY-5042 ] 20071011 test run failure|| requires investigation||
  
  '''Latest Linux x86 failure (regressions)'''
- ||||'''Excluded test name'''||'''Reason'''||'''Validity'''||
+ ||||'''Excluded test name'''||'''Reason'''||
- ||1||api.kernel.management.SystemResourceOrientedTest|| ||requires investigation ||
- ||2||api.kernel.object.ObjectFinalizeTest||[https://issues.apache.org/jira/browse/HARMONY-5334
HARMONY-5334] || regression ||
- ||3||api.net.DatagramTest|| ||hang; requires investigation ||
- ||4||api.net.SingleConnectTest||[https://issues.apache.org/jira/browse/HARMONY-5266 HARMONY-5266
] ||problem similar to HttpConnectionTest||
+ ||1||api.net.SingleConnectTest||[https://issues.apache.org/jira/browse/HARMONY-5266 HARMONY-5266
] problem similar to HttpConnectionTest||
- ||5||api.serialization.SerializableClassesTest|| ||requires investigation ||
+ ||2||api.serialization.SerializableClassesTest|| requires investigation ||
- ||6||api.util.ConcurrentTest||[https://issues.apache.org/jira/browse/HARMONY-5403 HARMONY-5403
] || regression ||
+ ||3||api.util.ConcurrentTest||[https://issues.apache.org/jira/browse/HARMONY-5403 HARMONY-5403
] regression ||
- ||7||vm.gc.GCTest||[https://issues.apache.org/jira/browse/HARMONY-5403 HARMONY-5403 ] ||
regression ||
+ ||4||api.kernel.thread.ThreadSuspendResume.ThreadSuspendResume|| requires investigation||
+ ||5||api.zip.ZlibTest|| requires investigation||
  
  '''Latest Linux x86_64 failure (regressions)'''
- ||||'''Excluded test name'''||'''Reason'''||'''Validity'''||
+ ||||'''Excluded test name'''||'''Reason'''||
- ||1||vm.classloading.ClassCastTest|| [https://issues.apache.org/jira/browse/HARMONY-5395
HARMONY-5395 ] || regression ||
+ ||1||vm.classloading.ClassCastTest|| [https://issues.apache.org/jira/browse/HARMONY-5395
HARMONY-5395 ] regression ||
- ||1||api.util.ConcurrentTest|| [https://issues.apache.org/jira/browse/HARMONY-5403 HARMONY-5403
] || regression ||
+ ||2||api.util.ConcurrentTest|| [https://issues.apache.org/jira/browse/HARMONY-5403 HARMONY-5403
] regression ||
- ||1||vm.gc.GCTest|| [https://issues.apache.org/jira/browse/HARMONY-5403 HARMONY-5403 ] ||
regression ||
+ ||3||api.nio.channels.filechannel.FileChannelMapTest|| requires investigation||
  

Mime
View raw message