Return-Path: X-Original-To: apmail-incubator-ooo-qa-archive@minotaur.apache.org Delivered-To: apmail-incubator-ooo-qa-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 427ACE0A for ; Sat, 25 Aug 2012 20:21:20 +0000 (UTC) Received: (qmail 72054 invoked by uid 500); 25 Aug 2012 20:21:20 -0000 Delivered-To: apmail-incubator-ooo-qa-archive@incubator.apache.org Received: (qmail 71966 invoked by uid 500); 25 Aug 2012 20:21:19 -0000 Mailing-List: contact ooo-qa-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: ooo-qa@incubator.apache.org Delivered-To: mailing list ooo-qa@incubator.apache.org Received: (qmail 71957 invoked by uid 99); 25 Aug 2012 20:21:19 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 25 Aug 2012 20:21:19 +0000 X-ASF-Spam-Status: No, hits=0.7 required=5.0 tests=RCVD_IN_DNSWL_NONE,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [204.13.248.71] (HELO mho-01-ewr.mailhop.org) (204.13.248.71) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 25 Aug 2012 20:21:11 +0000 Received: from cpe-24-166-216-127.woh.res.rr.com ([24.166.216.127] helo=[192.168.1.3]) by mho-01-ewr.mailhop.org with esmtpsa (TLSv1:CAMELLIA256-SHA:256) (Exim 4.72) (envelope-from ) id 1T5Mqh-000EUw-57 for ooo-qa@incubator.apache.org; Sat, 25 Aug 2012 20:20:51 +0000 X-Mail-Handler: Dyn Standard SMTP by Dyn X-Originating-IP: 24.166.216.127 X-Report-Abuse-To: abuse@dyndns.com (see http://www.dyndns.com/services/sendlabs/outbound_abuse.html for abuse reporting information) X-MHO-User: U2FsdGVkX19nW7w7rJNYsybZbLVWgcp0qpyWrPTbXE4= Message-ID: <503933F2.9080308@apache.org> Date: Sat, 25 Aug 2012 16:22:10 -0400 From: Carl Marcum User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:14.0) Gecko/20120717 Thunderbird/14.0 MIME-Version: 1.0 To: ooo-qa@incubator.apache.org Subject: unit testing philosophy Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org Hi all, I'm new to the qa list and joined because I would like to learn more about testing and as a java dev, I think this is an area I can contribute to the project. I've been working on updating the netbeans plugin and that's working, now I'm looking at the unit and qa-funtional tests. When I run the tests only about 60% pass. When I start looking at what is failing I'm seeing a lot of prototype tests that just setup and call fail. example: /** * Test of locateOffice method, of class IxLocator. */ public void testLocateOffice() { System.out.println("locateOffice"); IxLocator instance = null; instance.locateOffice(); // TODO review the generated test code and remove the default call to fail. fail("The test case is a prototype."); Is it better to have: 100% coverage and 50% fail because of prototypes or 50% coverage and 100% pass (no prototypes or just not call fail)? Thanks, Carl