harmony-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Harmony Wiki] Update of "Reliability Tests on DRLVM" by AndreyYakushev
Date Fri, 18 Apr 2008 13:49:11 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Harmony Wiki" for change notification.

The following page has been changed by AndreyYakushev:
http://wiki.apache.org/harmony/Reliability_Tests_on_DRLVM

------------------------------------------------------------------------------
  
  __~+Pass rates+~ according to 
  [http://people.apache.org/~mloenko/snapshot_testing/script/r634719/index.html Automated
Testing results]:__
- ||<rowbgcolor="#a0f0a0">Platform||Valid||Failed||Excluded||Failed+excluded||Pass rate||Covered
by JIRA||
+ ||<rowbgcolor="#a0f0a0">Platform||Valid||Failed||Excluded||Failed+excluded||Pass rate||
- ||Windows x86                   ||87   || 2    ||13      ||             15||      83%||
            15||
+ ||Windows x86                   ||87   || 2    ||13      ||             15||      83%||
- ||Linux x86                     ||87   || 2    ||13      ||             15||      83%||
            15||
+ ||Linux x86                     ||87   || 2    ||13      ||             15||      83%||
- ||Linux x86_64                  ||87   || 4    ||17      ||             21||      76%||
            21||
+ ||Linux x86_64                  ||87   || 4    ||17      ||             21||      76%||
  
- __~+Regressions+~ since M4 release to be resolved ASAP: __
+ Excluded test list with references to corresponding JIRA could be found in files:
  
+ {{{
+ build/checkouts/reliability/run/exclude
+ build/checkouts/reliability/run/exclude.<platform>
+ }}}
- ||<rowbgcolor="#f0a0a0">'''Test name'''||'''JIRA'''||'''Summary'''||
- ||vm.classloading.ClassCastTest|| [https://issues.apache.org/jira/browse/HARMONY-5395 HARMONY-5395
]||[drlvm][Linux64 gcc bug] vm.classloading.ClassCastTest hangs||
- ||api.serialization.SerializableClassesTest||[https://issues.apache.org/jira/browse/HARMONY-5532
HARMONY-5532][https://issues.apache.org/jira/browse/HARMONY-5565 HARMONY-5565]||[classlib]
SerializableClassesTest failure from the reliability test suite||
- 
- 
- [[Anchor(Latest)]]
- === Latest failures under evaluation ===
- 
- {i} This section contains the failures happens during several recent runs. These failures
are being evaluated currently - based on results of evaluation each failure can be marked
as a regression and moved to the ~+Regressions+~ list above or it can be marked as non critical
and related test can be just excluded.
- 
- ||||<rowbgcolor="#c0c0c0">'''Latest Windows x86 failures'''||
- ||<rowbgcolor="#f0f0f0">'''''Test name'''''||'''''Comments'''''||
- ||||||
- ||||||
- ||||||
- ||api.net.DatagramTest||[https://issues.apache.org/jira/browse/HARMONY-5531 HARMONY-5531]
||
- ||api.text.getSentenceInstance||intermittent VM crash, requires investigation||
- ||api.kernel.threadgroup.EnumerateTest|| [http://people.apache.org/~smishura/r636031/Windows_x86/reliability/api/kernel/threadgroup/22_EnumerateTest.html
r636031 failure]||
- ||||||
- ||||||
- ||||<rowbgcolor="#c0c0c0">'''Latest Linux x86 failures'''||
- ||<rowbgcolor="#f0f0f0">'''''Test name'''''||'''''Comments'''''||
- ||||||
- ||||||
- ||api.net.SingleConnectTest||[https://issues.apache.org/jira/browse/HARMONY-5266 HARMONY-5266
] problem similar to HttpConnectionTest||
- ||api.zip.ZlibTest|| infrequent intermittent test hang ||
- ||api.kernel.management.SystemResourceOrientedTest|| [https://issues.apache.org/jira/browse/HARMONY-5533
HARMONY-5533] ||
- ||api.kernel.thread.RecursiveThreadTest.RecursiveTest|| [https://issues.apache.org/jira/browse/HARMONY-5534
HARMONY-5534] ||
- ||api.text.DecimalFormat_Locales|| random vm crash, requires investigation||
- ||||||
- ||||||
- ||||<rowbgcolor="#c0c0c0">'''Latest Linux x86_64 failures'''||
- ||<rowbgcolor="#f0f0f0">'''''Test name'''''||'''''Comments'''''||
- ||||||
- ||||||
- ||api.kernel.thread.ThreadLocalTest.ThreadLocalTest||r620734 - failure is not reproducible
locally during 10+ run of 20 minutes each||
- ||api.text.DecimalFormat_Locales||r613602 - failure is not reproducible locally during 10+
run of 20 minutes each; intermittent on CC; [http://people.apache.org/~smishura/r636792/Linux_x86_64/reliability/api/text/49_DecimalFormat_Locales.html
r636792], [http://people.apache.org/~smishura/r644719/Linux_x86_64/reliability/api/text/49_DecimalFormat_Locales.html
r644719] failures||
- ||api.nio.channels.filechannel.FileChannelMapTest|| intermittent failure; requires investigation||
- ||vm.finalization.FinalizeThrowRestoreTest|| [http://people.apache.org/~smishura/r636031/Linux_x86_64/reliability/vm/finalization/66_FinalizeThrowRestoreTest.html
r636031 failure] is not regression - appeared earlier||
- ||api.zip.ZlibTestStrategyLevel||[http://people.apache.org/~smishura/r636792/Linux_x86_64/reliability/api/zip/61_ZlibTestStrategyLevel.html
r636792 failure]; no fails on r637385 - intermittent||
- ||api.kernel.thread.VolatileVariableTest.PetersonTest||[http://people.apache.org/~smishura/r637385/Linux_x86_64/reliability/api/kernel/thread/VolatileVariableTest/20_PetersonTest.html
r637385 failure] is not regression - appeared earlier||
- ||api.zip.InflDeflGetResetTest||[http://people.apache.org/~smishura/r638915/Linux_x86_64/reliability/api/zip/55_InflDeflGetResetTest.html
r638915] failure - required investigation||
- 
- [[Anchor(Excluded)]]
- === List of excluded tests with status ===
- 
- {X} This section lists the tests that are currently excluded. The cause of each failure
is given for the moment the failure was evaluated, so this cause information may be a bit
out of date now. In general a new failure analysis is required for most of the failures below
to find the root cause of issue and you are welcome to do it to increase the overall reliability
of Harmony B)
- 
- ||||<rowbgcolor="#c0c0c0">'''Valid tests that failed'''||
- ||<rowbgcolor="#f0f0f0">'''''Excluded test name'''''||'''''Comments'''''||
- ||||||
- ||||||
- ||||||
- ||api.kernel.pckg.PackageGetTest|| [https://issues.apache.org/jira/browse/HARMONY-5512 HARMONY-5512]||
- ||api.kernel.thread.ExcptHandlerTest.ExcptHandlerTest|| [https://issues.apache.org/jira/browse/HARMONY-5402
HARMONY-5402 ], mostly reproduced on release build||
- ||api.kernel.thread.LifeSimulationTest.Life|| [https://issues.apache.org/jira/browse/HARMONY-5334
HARMONY-5334 ], memory leak||
- ||api.nio.channels.filechannel.ChannelWriteTest|| [https://issues.apache.org/jira/browse/HARMONY-4081
HARMONY-4081 ], failed 2 times from 5 runs||
- ||api.nio.channels.filechannel.FileChannelThrSafetyTest|| [https://issues.apache.org/jira/browse/HARMONY-4081
HARMONY-4081 ], failed 2 times from 5 runs||
- ||api.text.getAvailableLocals_RBC|| [https://issues.apache.org/jira/browse/HARMONY-2742
HARMONY-2742 ], HARMONY-3224, hang||
- ||vm.classloading.ClassAttributesTest|| [https://issues.apache.org/jira/browse/HARMONY-3680
HARMONY-3680 ], reproduced on release build only||
- ||vm.classloading.ClassReflectionTest|| [https://issues.apache.org/jira/browse/HARMONY-3680
HARMONY-3680 ], reproduced on release build only||
- ||api.kernel.hooks.AddRmPropertiesHooksTest|| [https://issues.apache.org/jira/browse/HARMONY-5172
HARMONY-5172 ], assert in debug mode||
- ||api.kernel.thread.Calculation.CalcTest|| [https://issues.apache.org/jira/browse/HARMONY-5334
HARMONY-5334 ]increased memory leak||
- ||api.kernel.thread.ThreadArrayTest.ThreadArrayTest|| [https://issues.apache.org/jira/browse/HARMONY-5334
HARMONY-5334 ]increased memory leak||
- ||api.kernel.object.ObjectFinalizeTest|| [https://issues.apache.org/jira/browse/HARMONY-5334
HARMONY-5334 ]increased memory leak||
- ||api.kernel.thread.StackTraceTest.StackTraceTest|| [https://issues.apache.org/jira/browse/HARMONY-5484
HARMONY-5484 ]handle leakage||
- ||||||
- ||||||
- ||||||
- ||||||
- ||||<rowbgcolor="#c0c0c0">'''Linux x86_64 excluded test status'''||
- ||<rowbgcolor="#f0f0f0">'''''Excluded test name'''''||'''''Comments'''''||
- ||||||
- ||||||
- ||api.kernel.thread.VolatileVariableTest.DekkerTest||[https://issues.apache.org/jira/browse/HARMONY-5295
HARMONY-5295]; intermittent hang||
- ||api.net.DatagramTest|| [https://issues.apache.org/jira/browse/HARMONY-5531 HARMONY-5531];
intermittent hang||
- ||api.nio.channels.filechannel.MappedByteBufferForceTest|| [https://issues.apache.org/jira/browse/HARMONY-5553
HARMONY-5553]||
- ||api.serialization.SerializableClassesTest|| [https://issues.apache.org/jira/browse/HARMONY-5532
HARMONY-5532]||
- ||vm.classloading.DelegationModelTest||[https://issues.apache.org/jira/browse/HARMONY-5567
HARMONY-5567]||
- ||||||
- ||||||
- ||||||
- ||||||
- ||||<rowbgcolor="#c0c0c0">'''Invalid tests''' ||
- ||<rowbgcolor="#f0f0f0">'''''Excluded test name'''''||'''''Comments'''''||
- ||||||
- ||||||
- ||api.kernel.thread.ThreadKill.ThreadKillTest|| [https://issues.apache.org/jira/browse/HARMONY-4220
HARMONY-4220 ], HARMONY-4232, the issue could be in the test||
- ||api.net.MultiConnectTest|| [https://issues.apache.org/jira/browse/HARMONY-4812 HARMONY-4812
], Test issue||
- ||api.nio.charset.CharsetSyncCacheTest|| [https://issues.apache.org/jira/browse/HARMONY-5400
HARMONY-5400 ], reproducible on release and debug; memory leak, may be ICU bug||
- ||api.nio.charset.DecodingModesTest|| [https://issues.apache.org/jira/browse/HARMONY-4758
HARMONY-4758 ], immediate hang - not a reliability issue; ICU bug||
- ||api.text.CollationElementIteratorTest|| [https://issues.apache.org/jira/browse/HARMONY-2752
HARMONY-2752 ], hang; ICU bug||
- ||api.text.CollationKeyTest|| [https://issues.apache.org/jira/browse/HARMONY-2752 HARMONY-2752
], hang; ICU bug||
- ||api.text.CollationKeyTest_ArrHash|| [https://issues.apache.org/jira/browse/HARMONY-2752
HARMONY-2752 ], hang; ICU bug||
- ||api.text.getSentenceInstance_check|| [https://issues.apache.org/jira/browse/HARMONY-62
HARMONY-62 ], ICU bug||
- ||vm.classloading.ClassUnloadingTest|| [https://issues.apache.org/jira/browse/HARMONY-2039
HARMONY-2039 ], no class unloading||
- ||vm.classloading.MultiThreadedLoading|| [https://issues.apache.org/jira/browse/HARMONY-2039
HARMONY-2039 ], no class unloading||
- ||vm.finalization.ArrayElemFinalizationTest|| [https://issues.apache.org/jira/browse/HARMONY-4413
HARMONY-4413 ], test issue||
- ||vm.stack.StackFramesRestoreTest|| [https://issues.apache.org/jira/browse/HARMONY-2039
HARMONY-2039 ], no class unloading, memory leak||
- ||api.kernel.thread.VolatileVariableTest.DekkerTest|| [https://issues.apache.org/jira/browse/HARMONY-5295
HARMONY-5295 ], intermittent hang, also sometimes failed on SUN and BEA; probably test issue||
  
  [#Summary Back to Summary]
  

Mime
View raw message