Return-Path: Delivered-To: apmail-db-derby-dev-archive@www.apache.org Received: (qmail 17567 invoked from network); 15 Mar 2006 22:31:22 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (209.237.227.199) by minotaur.apache.org with SMTP; 15 Mar 2006 22:31:22 -0000 Received: (qmail 8849 invoked by uid 500); 15 Mar 2006 22:31:21 -0000 Delivered-To: apmail-db-derby-dev-archive@db.apache.org Received: (qmail 8802 invoked by uid 500); 15 Mar 2006 22:31:20 -0000 Mailing-List: contact derby-dev-help@db.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: Delivered-To: mailing list derby-dev@db.apache.org Received: (qmail 8792 invoked by uid 99); 15 Mar 2006 22:31:20 -0000 Received: from asf.osuosl.org (HELO asf.osuosl.org) (140.211.166.49) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Mar 2006 14:31:20 -0800 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests= X-Spam-Check-By: apache.org Received: from [192.87.106.226] (HELO ajax.apache.org) (192.87.106.226) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Mar 2006 14:31:19 -0800 Received: from ajax (localhost.localdomain [127.0.0.1]) by ajax.apache.org (Postfix) with ESMTP id D64A06ACA9 for ; Wed, 15 Mar 2006 22:30:58 +0000 (GMT) Message-ID: <1638311747.1142461858872.JavaMail.jira@ajax> Date: Wed, 15 Mar 2006 22:30:58 +0000 (GMT) From: "David Van Couvering (JIRA)" To: derby-dev@db.apache.org Subject: [jira] Commented: (DERBY-1116) Define a minimal acceptance test suite for checkins In-Reply-To: <1287073227.1142445538304.JavaMail.jira@ajax> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org X-Spam-Rating: minotaur.apache.org 1.6.2 0/1000/N [ http://issues.apache.org/jira/browse/DERBY-1116?page=comments#action_12370587 ] David Van Couvering commented on DERBY-1116: -------------------------------------------- Submitted client-side test, revision 386187. Derbyall passed except for wisconsin.sql, which looks completely unrelated > Define a minimal acceptance test suite for checkins > --------------------------------------------------- > > Key: DERBY-1116 > URL: http://issues.apache.org/jira/browse/DERBY-1116 > Project: Derby > Type: Improvement > Components: Test > Reporter: David Van Couvering > Priority: Minor > > Now that we have an excellent notification system for tinderbox/nightly regression failures, I would like to suggest that we reduce the size of the test suite being run prior to checkin. I am not sure what should be in such a minimal test, but in particular I would like to remove things such as the stress test and generally reduce the number of tests being run for each subsystem/area of code. > As an example of how derbyall currently affects my productivity, I was running derbyall on my machine starting at 2pm, and by evening it was still running. At 9pm my machine was accidentally powered down, and this morning I am restarting the test run. > I have been tempted (and acted on such temptation) in the past to run a smaller set of tests, only to find out that I have blocked others who are running derbyall prior to checkin. For this reason, we need to define a minimal acceptance test (MATS) that we all agree to run prior to checkin. > One could argue that you can run your tests on another machine and thus reduce productivity, but we can't assume everybody in the community has nice big test servers to run their tests on. > If there are no objections, I can take a first pass at defining what this test suite should look like, but I suspect many others in the community have strong opinions about this and may even wish to volunteer to do this definition themselves (for example, some of you who may be working in the QA division in some of our Big Companies :) ). -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira