harmony-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Harmony Wiki] Update of "DRLVMInternalTests" by Vladimir Beliaev
Date Mon, 14 Apr 2008 12:52:13 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Harmony Wiki" for change notification.

The following page has been changed by Vladimir Beliaev:
http://wiki.apache.org/harmony/DRLVMInternalTests

------------------------------------------------------------------------------
  = DRLVM Internal Tests =
  [wiki:Self:DRLVMTestTracking Back to DRLVM Test Tracking]
  
- DRLVM's smoke, c-unit, kernel and jvmti tests, over time.
+ [[Anchor(Summary)]]
+ === Summary ===
+ 
+ [#Status Status]
+ 
+ [#Summary Back to Summary]
+ [[Anchor(Status)]]
+ === Status ===
+ 
+ ''DRLVM tests'' consist in ''Smoke'', ''C-unit'', ''Kernel'' and ''Unit'' tests. All ''DRLVM
tests'' are DRLVM acceptance tests so they must be run each time the contributor posts his/her
patch for DRLVM. '''It is strictly recommended''' to test your patch with ''DRLVM tests''
in both ''debug'' and ''release'' build of DRLVM on Windows/Linux/x86/x86_64 platforms.
+ 
+ ''Kernel'' tests are set of java-language programs with standard 'main' entance which test
DRLVM ''Kernel Classes'' such as `java.lang.Class`, `java.lang.Thread` or features such as
Java5.0 ''Generics''. 
  
  
- == Smoke Tests ==
+ ''DRLVM tests'' located in directories three started from `trunk/working_vm/tests`.
  
- 
- || Date        || OS/ARCH          || Number Passing || Number Excluded ||
- || 2006-11-21  || Linux x86 JIT    ||  65            || 5               ||
- || 2006-11-21  || Linux x86 INT    ||  64            || 6               ||
- || 2006-11-21  || Windows x86 JIT  ||  66            || 4               ||
- || 2006-11-21  || Windows x86 INT  ||  65            || 5               ||
- || 2006-11-21  || Linux x86_64 JIT ||  62            || 8              ||
- || 2006-11-21  || Linux x86_64 INT ||  64            || 6               ||
- 
- === Enabling Smoke Tests ===
- The excluded Smoke Tests could be divided into two categories: stably failing and intermittently
failing.
- 
- ==== Stable issues ====
- 
- || Test         || Issue        || Win JIT  || Win INT || lin x86 JIT  || lin x86 INT ||
lin x86_64 JIT || lin x86_64 INT || JIRA/Comment ||
- || gc.Mark || fails/slow ||          || slow    ||              || +           || +    
         || +              ||does not fail but too slow on INT. -Elena 2007-01-12 ||
- || stress.Stack   || fails      ||          ||         ||              ||             ||
+              || +              || [http://issues.apache.org/jira/browse/HARMONY-2972 HARMONY-2972]
||
- || io.Integers    || fails      || +        || +       ||              || +           ||
               || +              || [http://issues.apache.org/jira/browse/HARMONY-2977 HARMONY-2977]||
- || stress.Threads || fails      ||          ||         || ubuntu 6     || ubuntu 6    ||
               ||                || could anyone confirm and file JIRA?      ||
- || StackTest                     || failure ||         ||         ||             ||    
        || +                ||                  || [http://issues.apache.org/jira/browse/HARMONY-2972
HARMONY-2972]     ||
- || exception.FinalizeStackTest   || failure ||         ||         ||             ||    
        || +                ||                  || [http://issues.apache.org/jira/browse/HARMONY-2972
HARMONY-2972]     ||
- || shutdown.TestInterrupt        || hang    || +       || +       ||             ||    
        ||                   ||                  || Is not reproducible; removed from excluded
||
- 
- 
- ==== Intermittently failing tests ====
- 
- || Test                          || Issue   || Win JIT || Win INT || lin X86 JIT || lin
X86 INT || linux X86_64 JIT || linux x86_64 INT || JIRA/Comment || Patch ||
- || classloader.StressLoader      || failure || +       || +       || +           || +  
        || +                || +                || [http://issues.apache.org/jira/browse/HARMONY-2982
HARMONY-2982]     || fixed ||
- || gc.LOS                       || hang     ||         ||         || +           ||    
        || +                ||                  || [http://issues.apache.org/jira/browse/HARMONY-3044
HARMONY-3044]     || fixed ||
- || stress.Mix                    || failure ||         ||         ||             ||    
        || +                 || +                ||[http://issues.apache.org/jira/browse/HARMONY-2772
HARMONY-2772]      || ||
- || stress.Sync  || seg fault ||         ||         ||             ||             || OPT/server
||                 ||[http://issues.apache.org/jira/browse/HARMONY-3299 HARMONY-3299]    
 || ||
- || perf.MultiThreadsSimple gc.MultiThreads || seg fault ||         ||         ||       
     ||             || +                 || +                ||[http://issues.apache.org/jira/browse/HARMONY-3338
HARMONY-3338]      || ||
- 
- == Kernel Tests ==
- 
- || Date        || OS/ARCH      || J/O/I || Number Passing || Number Excluded ||
- || 2006-11-21  || Linux x86    ||  jet  ||    770         ||   44            ||
- || 2006-11-21  || Linux x86    ||  opt  ||    770         ||   44            ||
- || 2006-11-21  || Linux x86    ||  int  ||    769         ||   45            ||
- || 2006-11-21  || Linux x86_64 ||  jet  ||    767         ||   47            ||
- || 2006-11-21  || Linux x86_64 ||  opt  ||    776         ||   48            ||
- || 2006-11-21  || Linux x86_64 ||  int  ||    767         ||   47            ||
- || 2006-11-24  || Windows 2003 x86 ||  jet ||    770      ||   45            ||
- || 2006-11-24  || Windows 2003 x86 ||  opt ||    770      ||   45            ||
- || 2006-11-24  || Windows 2003 x86 ||  int ||    767      ||   46            ||
- || 2006-11-24  || Windows XP x86   ||  jet ||    770      ||   45            ||
- || 2006-11-24  || Windows XP x86   ||  opt ||    770      ||   45            ||
- || 2006-11-24  || Windows XP x86   ||  int ||    767      ||   46            ||
- [[BR]]
- 
- === Enabling Kernel Tests ===
- 
- ==== Failures ====
- 
- || Test                     || Issue || lin x86_64 JIT  || lin x86_64 OPT || lin x86_64
INT || win || win INT || JIRA/Comment || Patch ||
- || j.l.ClassAnnotationsTest j.l.FieldTest o.a.h.l.a.AllTypesTest || fails || +         
     ||                ||                ||     ||         ||[http://issues.apache.org/jira/browse/HARMONY-3110
HARMONY-3110] || fixed  ||
- || j.l.SystemTest           || fails ||                 ||                ||           
    || + ||         ||   [http://issues.apache.org/jira/browse/HARMONY-2453 HARMONY-2453]
|| available   ||
- || j.l.ThreadRTest          || fails ||                 ||                ||           
    ||     || +       ||  [http://issues.apache.org/jira/browse/HARMONY-3171 HARMONY-3171]
|| fixed ||
- || j.l.ClassLoaderTest      || fails ||                 || +              ||           
    ||     ||         ||  not reproducible || removed from excluded  ||
- || j.l.ClassGenericsTest    || fails ||                 ||                || +         
    ||     ||         ||  not reproducible || removed from excluded ||
- || j.l.ClassGenericsTest4   || fails ||                 ||                || +         
    ||     ||         ||  not reproducible || removed from excluded ||
- 
- All RuntimeAdditionalTest*.java tests are excluded because they are unstable and run too
long.
- There are 44 test cases in that classes and they run for about 12 minutes while currently
enabled tests contain about 800 test cases and run for about 9 minutes.
- 
- ==== Steps for tests enabling ====
- 
- 1. Run the tests iteratively and gather statistics on their stability.
- [[BR]]
-     The tests look rather stable but too slow.
- 2. Review the tests to see if they really increase code coverage of j.l.Runtime implementation.
- [[BR]]
-     The tests normally call j.l.Rintime.exec() with different parameters.
- 3. Think of moving some valuable tests to other test suites. 
- 
- https://issues.apache.org/jira/browse/HARMONY-3521 has been created to track this issue.
  
  [wiki:Self:DRLVMTestTracking Back to DRLVM Test Tracking]
  

Mime
View raw message