harmony-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Geir Magnusson Jr." <g...@pobox.com>
Subject Re: [drlvm][smoke tests] Enabling smoke tests
Date Wed, 06 Dec 2006 17:52:28 GMT
Yes!

Elena Semukhina wrote:
> On 12/5/06, Rana Dasgupta <rdasgupt@gmail.com> wrote:
>>
>> How much total additional time would be needed to run the tests that are
>> excluded for "slowness" only?
> 
> 
> There are 11 tests marked as slow. They run about 30 sec in JIT mode. Only
> one of them is rather slow: gc.Mark (~15 sec).
> 
> I compared the whole run duration on linux (JIT + interpreter). 
> Currently 26
> tests run for about 3 min 30 sec. Adding 42 tests from exclude list
> increases duration up to 11 minutes (1 min 40 sec for JIT).
> 
> Is this time acceptable?
> 
> Thanks,
> Elena
> 
> Thanks,
>> Rana
>>
>>
>> On 12/5/06, Elena Semukhina <elena.semukhina@gmail.com> wrote:
>> >
>> > We currently have more than 40 smoke tests in the exclude list.
>> > I tried to run all of them on linux/Windows and found out that most of
>> > them
>> > stably pass.
>> > Those of them which have been marked with the "slow" keyword don't
>> > actually
>> > run slow. They are not slower than an average smoke test. Only few of
>> them
>> > work about 10 seconds (comparing to 1-4 seconds duration of any other
>> > test).
>> >
>> > Only 3 tests stably fail and about 5 tests fail intermittently. I've
>> added
>> > the details to the
>> http://wiki.apache.org/harmony/DRLVMInternalTestspage.
>> > I plan to file JIRA issues about failing tests and to gather more
>> > statictics
>> > on intermittent failures.
>> >
>> > Does anybody object to removing most tests from exclude lists and bring
>> > them
>> > back to runs?
>> >
>> > --
>> > Thanks,
>> > Elena
>> >
>> >
>>
>>
> 
> 


Mime
View raw message