Mailing-List: contact dev-help@harmony.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@harmony.apache.org
Received-SPF: pass (nike.apache.org: domain of nbeyer@gmail.com designates
 209.85.161.49 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:sender:date:x-google-sender-auth:message-id:subject
         :from:to:content-type;
        b=rOTW8jEsybZFXvJlBc8zfmdz1sCeZsLJDBjL9CC1+bSwtonL1jcsjvCgoAddqaHlwK
         QrPXBCgVRYfbypFfidCwlMH77W8vckzwx5g7SzpnLlcUkx2tZV4YZflf/myxCYBvsPy+
         A0IF5a4LLILmEE4UkdmIeSJ7pgNjLyqcLyMCw=
MIME-Version: 1.0
Sender: nbeyer@gmail.com
Date: Mon, 24 May 2010 19:17:14 -0500
Message-ID: <AANLkTikh3nV56QB8HXSXfzLnI9jrtU-C2cRF1shElZVt@mail.gmail.com>
Subject: [proposal] For future milestones, expect zero test failures
From: Nathan Beyer <ndbeyer@apache.org>
To: dev@harmony.apache.org
Content-Type: text/plain; charset=UTF-8

For future milestone votes, I'd like to propose that we set the
expectation of zero test failures. Every time we do a milestone and I
run the build and tests I find myself looking at the test failures
(there are ALWAYS failures) and ask 'are these expected'? If the
failures are expected, they should be excluded and the tests should
just pass.

If this proposal is workable, immediately after this upcoming release,
all 'expected' failures will be pulled into the exclusion lists.

-Nathan