Return-Path: Delivered-To: apmail-db-derby-dev-archive@www.apache.org Received: (qmail 38385 invoked from network); 18 Oct 2006 09:46:44 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (209.237.227.199) by minotaur.apache.org with SMTP; 18 Oct 2006 09:46:44 -0000 Received: (qmail 83303 invoked by uid 500); 18 Oct 2006 09:46:43 -0000 Delivered-To: apmail-db-derby-dev-archive@db.apache.org Received: (qmail 83266 invoked by uid 500); 18 Oct 2006 09:46:43 -0000 Mailing-List: contact derby-dev-help@db.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: Delivered-To: mailing list derby-dev@db.apache.org Received: (qmail 83256 invoked by uid 99); 18 Oct 2006 09:46:43 -0000 Received: from asf.osuosl.org (HELO asf.osuosl.org) (140.211.166.49) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 18 Oct 2006 02:46:43 -0700 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests=UNPARSEABLE_RELAY X-Spam-Check-By: apache.org Received-SPF: pass (asf.osuosl.org: local policy) Received: from [192.18.1.36] (HELO gmp-ea-fw-1.sun.com) (192.18.1.36) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 18 Oct 2006 02:46:41 -0700 Received: from d1-emea-09.sun.com ([192.18.2.119]) by gmp-ea-fw-1.sun.com (8.13.6+Sun/8.12.9) with ESMTP id k9I9kJA2018268 for ; Wed, 18 Oct 2006 10:46:20 +0100 (BST) Received: from conversion-daemon.d1-emea-09.sun.com by d1-emea-09.sun.com (Sun Java System Messaging Server 6.2-6.01 (built Apr 3 2006)) id <0J7B00A01SFLBW00@d1-emea-09.sun.com> (original mail from John.Embretsen@Sun.COM) for derby-dev@db.apache.org; Wed, 18 Oct 2006 10:46:19 +0100 (BST) Received: from [129.159.112.236] by d1-emea-09.sun.com (Sun Java System Messaging Server 6.2-6.01 (built Apr 3 2006)) with ESMTPSA id <0J7B00JOTSH6N647@d1-emea-09.sun.com> for derby-dev@db.apache.org; Wed, 18 Oct 2006 10:46:19 +0100 (BST) Date: Wed, 18 Oct 2006 11:42:50 +0200 From: John Embretsen Subject: Re: [testing]-run a test in different mode leads to different result In-reply-to: <94d710af0610172252u3a60b0t60c808a57e1a2a90@mail.gmail.com> Sender: John.Embretsen@Sun.COM To: derby-dev@db.apache.org Reply-to: derby-dev@db.apache.org Message-id: <4535F71A.1020007@Sun.COM> MIME-version: 1.0 Content-type: text/plain; format=flowed; charset=ISO-8859-1 Content-transfer-encoding: 7BIT References: <94d710af0610172252u3a60b0t60c808a57e1a2a90@mail.gmail.com> User-Agent: Thunderbird 1.5.0.5 (X11/20060730) X-Virus-Checked: Checked by ClamAV on apache.org X-Spam-Rating: minotaur.apache.org 1.6.2 0/1000/N Sean Qiu wrote: > After running the suite of derbyall, i want to recur each single test > from the derbyall_fail.txt > But when i run it in different test mode, like > spesifying the -Dframework=DerbynetClient, it will produce different > results. > It may fail in one mode while pass in another mode. > > So my question is how could i konw which mode is the request one? It is a bit tricky to figure out in which frameworks a particular test will or should run. There is a wiki page with some further details, please take a look: http://wiki.apache.org/db-derby/TestingFrameworks For example, if your derbyall_fail.txt contains something like derbyall/derbylang/derbylang.fail:lang/triggerGeneral.sql it means that the test was run as part of the derbylang suite. The derbylang suite is only run in the Embedded framework by default. We "know" this because 1) there is no derbylang.properties file in the functionTests/suites/ directory specifying a "framework" property 2) the derbylang suite is not part of a larger (super)suite that is run in a non-default framework (no .properties file includes derbylang in its list of suites while it also includes a non-default framework setting) 3) the default test framework is the Embedded framework Also, there is no "framework" property specified in the tests/lang/triggerGeneral_*.properties files. Thus we may conclude that the test is normally only run in the Embedded (default) framework. The JUnit tests work a bit differently, though... > Run this test in an embedded environment, it will pass: [snip output from test command] > Run this test in a server environment, it will fail: > <<<<<<<<<<<<<<<<< > java -Dverbose=true -Dframework=DerbyNetClient > org.apache.derbyTesting.functionTests.harness.RunTest > lang/triggerGeneral.sql [snip output from test command and diff] > BTW, i sitll confuse with the diff result. Could anyone do me a favor? I don't think this test is designed to run in client/server frameworks, which probably is the reason why it fails. -- John