Mailing-List: contact dev-help@harmony.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@harmony.apache.org
Received-SPF: error (herse.apache.org: local policy)
Message-ID: <4575BE4F.3020006@pobox.com>
Date: Tue, 05 Dec 2006 13:45:35 -0500
From: "Geir Magnusson Jr." <geir@pobox.com>
Reply-To: geir@pobox.com
User-Agent: Thunderbird 1.5.0.8 (Macintosh/20061025)
MIME-Version: 1.0
To: dev@harmony.apache.org
Subject: Re: [drlvm][smoke tests] Enabling smoke tests
References: <e79e5b390612050539v3995b50cv9fcec00fff33206b@mail.gmail.com>
In-Reply-To: <e79e5b390612050539v3995b50cv9fcec00fff33206b@mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit


Elena Semukhina wrote:
> We currently have more than 40 smoke tests in the exclude list.
> I tried to run all of them on linux/Windows and found out that most of them
> stably pass.
> Those of them which have been marked with the "slow" keyword don't actually
> run slow. They are not slower than an average smoke test. Only few of them
> work about 10 seconds (comparing to 1-4 seconds duration of any other 
> test).
> 
> Only 3 tests stably fail and about 5 tests fail intermittently. I've added
> the details to the  http://wiki.apache.org/harmony/DRLVMInternalTests page.
> I plan to file JIRA issues about failing tests and to gather more 
> statictics
> on intermittent failures.
> 
> Does anybody object to removing most tests from exclude lists and bring 
> them
> back to runs?

Nope.  When I created the exclude lists, I simply did it based on what 
was already marked as excluded, with a note somewhere that we need go 
figure out truth and beauty :)

Thanks for doing it.

geir

>