From kmarsden@apache.org Tue Feb 8 20:27:10 2005 Return-Path: Mailing-List: contact derby-commits-help@db.apache.org; run by ezmlm Delivered-To: mailing list derby-commits@db.apache.org Received: (qmail 85585 invoked by uid 500); 8 Feb 2005 20:27:10 -0000 Delivered-To: apmail-incubator-derby-cvs@incubator.apache.org Received: (qmail 85582 invoked by uid 99); 8 Feb 2005 20:27:10 -0000 X-ASF-Spam-Status: No, hits=-9.8 required=10.0 tests=ALL_TRUSTED,NO_REAL_NAME X-Spam-Check-By: apache.org Received: from minotaur.apache.org (HELO minotaur.apache.org) (209.237.227.194) by apache.org (qpsmtpd/0.28) with SMTP; Tue, 08 Feb 2005 12:27:10 -0800 Received: (qmail 47460 invoked by uid 65534); 8 Feb 2005 20:27:09 -0000 Message-ID: <20050208202709.47458.qmail@minotaur.apache.org> Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable X-Mailer: svnmailer-1.0.0-dev Date: Tue, 08 Feb 2005 20:27:08 -0000 Subject: svn commit: r152933 - in incubator/derby/code/trunk/java/testing: ./ org/apache/derbyTesting/functionTests/harness/ org/apache/derbyTesting/functionTests/suites/ To: derby-cvs@incubator.apache.org From: kmarsden@apache.org X-Virus-Checked: Checked Author: kmarsden Date: Tue Feb 8 12:27:07 2005 New Revision: 152933 URL: http://svn.apache.org/viewcvs?view=3Drev&rev=3D152933 Log: checking in change to rename no.runall files to .excl= ude for myrna@golux.com Added: incubator/derby/code/trunk/java/testing/org/apache/derbyTesting/functio= nTests/suites/DerbyNet.exclude - copied unchanged from r151385, incubator/derby/code/trunk/java/test= ing/org/apache/derbyTesting/functionTests/suites/noDerbyNet.runall incubator/derby/code/trunk/java/testing/org/apache/derbyTesting/functio= nTests/suites/DerbyNetClient.exclude - copied unchanged from r151385, incubator/derby/code/trunk/java/test= ing/org/apache/derbyTesting/functionTests/suites/noDerbyNetClient.runall incubator/derby/code/trunk/java/testing/org/apache/derbyTesting/functio= nTests/suites/embedded.exclude - copied unchanged from r151385, incubator/derby/code/trunk/java/test= ing/org/apache/derbyTesting/functionTests/suites/noembedded.runall Removed: incubator/derby/code/trunk/java/testing/org/apache/derbyTesting/functio= nTests/suites/noDerbyNet.runall incubator/derby/code/trunk/java/testing/org/apache/derbyTesting/functio= nTests/suites/noDerbyNetClient.runall incubator/derby/code/trunk/java/testing/org/apache/derbyTesting/functio= nTests/suites/noembedded.runall Modified: incubator/derby/code/trunk/java/testing/README.htm incubator/derby/code/trunk/java/testing/org/apache/derbyTesting/functio= nTests/harness/RunTest.java incubator/derby/code/trunk/java/testing/org/apache/derbyTesting/functio= nTests/suites/build.xml Modified: incubator/derby/code/trunk/java/testing/README.htm URL: http://svn.apache.org/viewcvs/incubator/derby/code/trunk/java/testing/= README.htm?view=3Ddiff&r1=3D152932&r2=3D152933 =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D --- incubator/derby/code/trunk/java/testing/README.htm (original) +++ incubator/derby/code/trunk/java/testing/README.htm Tue Feb 8 12:27:07 = 2005 @@ -322,6 +322,35 @@
  • takes 2 to 5 minutes
    • +
  • demo, simpledemo
    +
    • +
      +
    • tests the SimpleApp example
      +
      • +
    • simpledemo runs SimpleApp itself - and thus has a different +default resource package name (namely, no package) than all the other +tests. Hence it needed its own suite.properties file.
      • +
    • takes 30 to 1 minute
      • +
    +
  • nist
    • +
      +
    • test obtained from the NIST SQL suite v 6.0
      • +
    • takes 5 to 10 minutes
      +
      • +
    +
  • encryption
    • +
      +
    • runs the storemats suite in encryption scheme DESede
      +
      • +
    • takes 25 to 40 minutes
      +
      • +
    +
  • multi
    • +
      +
    • runs a simple test case with 10 threads
      • +
    • runs for 10 minutes, then shuts down all threads
      +
      • +
  • derbytools
      • @@ -335,7 +364,7 @@
      -
    • tested on a variety of hardware takes from 2 - 4.30 hours
      • +
    • tested on a variety of hardware takes from 2.30 - 5.00 hours
  • See Note1
    • @@ -945,8 +974,10 @@

    4.10 Skipping a test

    -

    -Some tests are written to test specific functionality only available +

    There are 2 skipping mechanisms in place for different kinds of +skipping of a test.
    +

    +

    Some tests are written to test specific functionality only available with for instance certain jvms, or, with network server, certain versions of the IBM Universal Driver. To control this, properties can be set for each test, for instance, if a test should not be run when @@ -957,6 +988,19 @@ runs with jdk141 as well as jdk142.
    Other skip reasons are encryption protocols specific to a certain jvm.

    +

    Another skipping mechanism works on entire 'frameworks'. Currently +there are only 3 supported in the harness, embedded, NetworkServer with +the IBM Universal JDBC Driver ('DerbyNet') and NetworkServer with the +not yet available new driver ('DerbyNetClient'). In the suites +directory there are .exclude files for each of the frameworks - if for +some reason an exclude file were not there, you would see a warning +message show up for every test run. In this 'framework'.exclude file +tests can be placed that for some reason need to be excluded from +running with that framework. This mechanism enables adding of suites to +a framework run even if a few of the tests are not appropriate for that +particular framework.

    +

    Note that at this time, only skipped suites show up in the .skip +result file. This still needs to be corrected.


    4.11 Frameworks

    @@ -1033,8 +1077,13 @@ this suite requires providing the property  bootcp, which is  interpreted from the test harness class j9_13. See also section on adding a new jvm setup. -
    - +
    +Another suite is derbynetclientmats. This suite is for testing the +networkserver with a yet to be contributed open source client. IBM +staff is working on contributing this. In essence it is the same as the +derbynetmats suite.  At this time, it can only be run by the IBM +staff working on this driver.
    +
    Note2:
     Modified: incubator/derby/code/trunk/java/testing/org/apache/derbyTesting/f= unctionTests/harness/RunTest.java URL: http://svn.apache.org/viewcvs/incubator/derby/code/trunk/java/testing/= org/apache/derbyTesting/functionTests/harness/RunTest.java?view=3Ddiff&r1= =3D152932&r2=3D152933 =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D --- incubator/derby/code/trunk/java/testing/org/apache/derbyTesting/functio= nTests/harness/RunTest.java (original) +++ incubator/derby/code/trunk/java/testing/org/apache/derbyTesting/functio= nTests/harness/RunTest.java Tue Feb 8 12:27:07 2005 @@ -827,7 +827,7 @@ String skipFile; // Some tests will not work with some frameworks, // so check property files for tests to be skipped - skipFile =3D "no" + framework + ".runall"; + skipFile =3D framework + ".exclude"; =20 if (!framework.equals("")) { Modified: incubator/derby/code/trunk/java/testing/org/apache/derbyTesting/f= unctionTests/suites/build.xml URL: http://svn.apache.org/viewcvs/incubator/derby/code/trunk/java/testing/= org/apache/derbyTesting/functionTests/suites/build.xml?view=3Ddiff&r1=3D152= 932&r2=3D152933 =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D --- incubator/derby/code/trunk/java/testing/org/apache/derbyTesting/functio= nTests/suites/build.xml (original) +++ incubator/derby/code/trunk/java/testing/org/apache/derbyTesting/functio= nTests/suites/build.xml Tue Feb 8 12:27:07 2005 @@ -24,7 +24,7 @@ =20 - + =20