Return-Path: X-Original-To: apmail-xmlgraphics-general-archive@www.apache.org Delivered-To: apmail-xmlgraphics-general-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 59A9F18FC0 for ; Fri, 11 Mar 2016 15:17:20 +0000 (UTC) Received: (qmail 31003 invoked by uid 500); 11 Mar 2016 15:17:19 -0000 Mailing-List: contact general-help@xmlgraphics.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: general@xmlgraphics.apache.org Delivered-To: mailing list general@xmlgraphics.apache.org Received: (qmail 30992 invoked by uid 99); 11 Mar 2016 15:17:19 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 11 Mar 2016 15:17:19 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 23C30180522 for ; Fri, 11 Mar 2016 15:17:19 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.702 X-Spam-Level: X-Spam-Status: No, score=-0.702 tagged_above=-999 required=6.31 tests=[RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id bSvHKYOn8lDD for ; Fri, 11 Mar 2016 15:17:16 +0000 (UTC) Received: from albert.telenet-ops.be (albert.telenet-ops.be [195.130.137.90]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 68B145FB0D for ; Fri, 11 Mar 2016 15:17:16 +0000 (UTC) Received: from ptr-2hj4tbifd8h3h8splbuecxt9x.ip6.access.telenet.be ([IPv6:2a02:1810:3919:fd00:f12c:d973:e14a:3675]) by albert.telenet-ops.be with bizsmtp id UfH91s00U3LQ2d306fH9K1; Fri, 11 Mar 2016 16:17:10 +0100 Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 9.2 \(3112\)) Subject: Re: Unit Tests for Bug Fixes, New/Changed Functionality From: Andreas Delmelle In-Reply-To: Date: Fri, 11 Mar 2016 16:18:39 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: References: To: general@xmlgraphics.apache.org X-Mailer: Apple Mail (2.3112) True enough, and I am definitely not against instating such a policy = (quite on the contrary). On the other hand, I do feel compelled to add a word of caution here.=20 Example: Some people could be familiar enough with certain parts of the codebase = to see what goes wrong and/or how a given issue can be fixed (or new = functionality can be added), but do not have the appropriate experience = with various testing frameworks in order to devise a test, nor do they = always have the time available to familiarise themselves with that. If I am working as an independent contractor for a client, and the = hours/days can be invoiced to said client, it may be well worth it to = spend double or triple the amount of time on coming up with test cases. = If I look at it from a hobbyist perspective, and it is my own dime, I = will probably be more inclined to leave writing the test cases to = someone else.=20 So, a new potential problem becomes that certain patches will just = remain uncommitted for a very, very long time, that is: as long as = nobody finds the time or has the inspiration to come up with a way to = formally and adequately test the fix or feature. Certain valuable fixes = or new features may take ages to get committed if that policy is too = strictly and blindly enforced (as in: no more commits without a test = case, period). All that said, summarised, some formal guidelines would definitely be a = helpful and valuable start. Just keep in mind that with such a policy = also comes a responsibility to either provide ideas and pointers to = would-be committers, or complete the patches yourself, to get those gaps = filled.=20 Cheers Andreas > On 09 Mar 2016, at 10:14, Chris Bowditch = wrote: >=20 > +1 >=20 > On 07/03/2016 19:52, Glenn Adams wrote: >> I haven't kept an eye on whether or not bug fixes or new/changed >> functionality is being committed with new junit tests; however, I = have a >> feeling this is not always done. >>=20 >> We need to improve our coverage testing on XML Graphics projects, >> especially w.r.t. to new code/fixes. >>=20 >> I realize we don't have a formal project policy on this matter, but = we need >> to do a better job I think. >>=20 >=20 >=20 > --------------------------------------------------------------------- > To unsubscribe, e-mail: general-unsubscribe@xmlgraphics.apache.org > For additional commands, e-mail: general-help@xmlgraphics.apache.org >=20 --------------------------------------------------------------------- To unsubscribe, e-mail: general-unsubscribe@xmlgraphics.apache.org For additional commands, e-mail: general-help@xmlgraphics.apache.org