+ +

Running DOTS +(Database Open Source Test Suite) with Derby

+ +

Sunitha +Kambhampati ( skambha@Yngvi.Org)

+ +

Preface:

+ +

I ran DOTS (Database Open Source Test Suite) with Derby +as the underlying database. The setup was simple and it seems like this test +suite can be used for testing on Linux. +This document talks about how I went about trying to setup DOTS with Derby. I hope this will be of some help to the +community. Please feel free to add your suggestions/ modifications to this +document. Thanks.

+ +

1. +Introduction. 1

+ +

2. Environment 2

+ +

2.1 Software Requirements. 2

+ +

2.2 The test environment that was used in this study: 2

+ +

3. Overview of DOTS and test configurations with Derby. 3

+ +

4. Steps to setup and run Dots: 3

+ +

4.1. Installation of DOTS. 3

+ +

4.2. Database (Derby) related setup. 4

+ +

4.3. Start the database server 5

+ +

4.4. Configuring test run parameters for DOTS client 6

+ +

4.5. Running the benchmark. 7

+ +

4.6. Checking the output and investigating possible +problems. 8

+ +

4.7. Cleaning up. 8

+ +

5. Test Results with Derby. 9

+ +

6. Summary. 9

+ +

7. External Links. 10

+ +

APPENDIX A: Derbyscripts.tar.gz contents. 10

+ +

APPENDIX B: Sample result file with Derby. 11

+ +

APPENDIX C: +derby.ini 16

+ +

APPENDIX D: derbyNS.ini 18

+ +

1. Introduction

+ +

Database Opensource Test Suite (DOTS) is an open source test +suite that is used to stress test database systems and to measure database +reliability (http://ltp.sourceforge.net/dotshowto.php#SEC1 +. DOTS is licensed under GNU General Public License +(GPL). The test cases are in Java and +make JDBC calls to the database. They are aimed to test 100% JDBC API +coverage. There are two kinds of test +cases, basic and advanced. There are 8 basic tests prefixed with BTCJ and 2 +advanced tests prefixed by ATCJ. The +advanced test cases simulate real world workloads including user +authentication/registration scenario and an online auction scenario.

+ +

Derby is an +incubator project at Apache. Derby +is a standards based java relational database system.(http://incubator.apache.org/derby/). +Some main features of derby are it is embedded, has small footprint, is pure java, easy to use and secure.

+ +

The aim of this document is to help setup DOTS to run with Derby. The following link http://ltp.sourceforge.net/dotshowto.php#SEC1 +at the DOTS site provides a good overview of the architectural components of +the test suite as well as the schema details.

+ +

This +document basically does a walkthrough of a setup/ run of DOTS with Derby +as the database. There are some scripts +that are given with the hope that it will aid in reducing your setup time.

+ +

2. +Environment

+ +

This +section talks about the hardware and software needed to run DOTS. In +sub-section 2.1, the requirement as stated by DOTS is given. Sub-section 2.2 lists the actual test +environment used.

+ +

2.1 Software Requirements:

+ +

Database: +Derby (derby jars: derby.jar, +derbynet.jar and derbytools.jar and if using network server, also need the drda client db2jcc.jar and db2jcc_license_c.jar)

+ +

OS: +Linux 2.4.4

+ +

JVM: +J2SE1.3.1 or higher

+ +

Hardware +Requirements:

+ +

CPU: +700Mhz or higher

+ +

Memory: +512Mb or higher

+ +

Disk +Capacity: 2 GB or higher

+ +

2.2 +The test environment that was used in this study:

+ +

Test +machine:

+ +

+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +

+ OS Name +	+ Suse Linux +
+ Version +	+ 9.0 +
+ System Manufacturer +	+ IBM +
+ System Model +	+ 86473FX +
+ System Type +	+ X86-based PC +
+ Processor +	+ x86 Family 15 Model 2 Stepping 7 GenuineIntel ~2400 Mhz +
+ Processor +	+ x86 Family 15 Model 2 Stepping 7 GenuineIntel ~2400 Mhz +
+ Memory +	+ 4Gb +

+ +

Software +Used:

+ +

Derby jars

+ +

Instructions to +build derby jars and downloads are at

+ +

        http://incubator.apache.org/derby/derby_downloads.html

+ +

Java -

+ +

Java 1.4.2

+ +

3. +Overview of DOTS and test configurations with Derby

+ +

A high +level overview of the main components of DOTS is as follows

+ +

There is the database system + that DOTS is run against.

+ +

DOTS client that drives the + test run

+ +

There is a performance + monitor that runs on the same machine as the database and communicates with + the DOTS client via sockets passing information about the CPU usage and + other performance related attributes.

+ +

DOTS can be run in two modes:

+ +

DOTS client on one machine, + and the database server on another machine
DOTS client and database + server on the same machine.

+ +

Derby with DOTS +can run in two modes

+ +

Derby + in embedded mode runs as part of the DOTS client (ie + in the same JVM as the DOTS client). Hence the only possible configuration + would be DOTS client and embedded database as well as the performance + monitor program on one machine.
Derby + in client server mode (Network Server). + If you use Derby Network Server, then the possible configurations + are

Database server and + performance monitor on one machine and the DOTS client on another machine +
Database server, + performance monitor and DOTS client on one machine.

+ +

4. +Steps to setup and run Dots:

+ +

In +the example described here: the +database, DOTS client and the performance monitor are all on one machine. If you decide to have the DOTS client and +database server on different machines, the steps will be some what similar +except that you will have to ensure that the necessary jars are present on the +client and the database server machines.

+ +

The +sections 3.1 and 3.2 of the Database Opensource Test Suite Users Guide provide +excellent overview. Section 3.1 (http://ltp.sourceforge.net/dotshowto.php#SEC11) +and

+ +

Section +3.2 (http://ltp.sourceforge.net/dotshowto.php#SEC12)

+ +

4.1. +Installation of DOTS

+ +

1)            Download the DOTS 1.1.1 (Dots-1.1.1.gz) from here http://sourceforge.net/project/showfiles.php?group_id=3382

+ +

Unzip +the gz file

+ +

$ +tar zxvf Dots-1.1.1.gz

+ +

After +this, there will be a Dots directory with different sub directories with source +of the tests, scripts, make file etc.

+ +

In +this example, Dots has been installed at /home/perftest/Dots. Let $DOTS_ROOT +refer to your dots installation. Here it will be /home/perftest/Dots.

+ +

2)      Make sure that java is installed, else install it and set the path variable to include jvm.

+ +

3) Compiling the DOTS +source

+ +

Change +directory to your Dots installation

+ +

cd /home/perftest/Dots/

+ +

Before +running the make command, make sure that you have javac in your path.

+ +

make all

+ +

This +will compile all the source java files in the src +subdirectory of your DOTS installation. If this is successful, you will see no +errors during the make, and there will be two jars under $DOTS_ROOT: PerfMon.jar and the +Dots.jar

+ +

PerfMon.jar This jar file contains the classes necessary +to start the performance monitor client. This jar is required to run +performance monitor.

+ +

Dots.jar This jar file has all the test cases that are +needed to run tests. Also contains the +DOTS client component needed to drive the test runs.

+ +

4.2. +Database (Derby) +related setup

+ +

The +database related setup involves setting up the necessary database jar files, +creating the database and loading the schema. For both Derby +(embedded or client-server mode), the ij tool that is +in derbytools.jar is used for creation of database and loading of schema.

+ +

There +is a derbyscripts.tar.gz file along with this +document that has the scripts and sql files necessary for derby. For more +details on each of the scripts present in the derbyscripts.tar.gz file, please +see APPENDIX A. To help reduce the setup +time, these scripts can be easily modified according to your individual setup. +Unzip the derbyscripts.tar.gz into a directory called derby and execute the +scripts from the same directory. Modify the myenv.ksh to set the +DERBY_JARS_ROOT as well as the DOTS_JARS_ROOT environment variables +appropriately. DERBY_JARS_ROOT refers to the root directory where the derby +jars are located and DOTS_JARS_ROOT refers to the root directory where the DOTS +related jars are located. Below, for each step the corresponding script that +can be used is given enclosed in brackets. In case you are using the scripts, +make sure that you have first run myenv.ksh or set the DERBY_JARS_ROOT and +DOTS_JARS_ROOT variables in the shell window that you are executing from. +($. ./myenv.ksh)

+ +

§ Open a new shell +window and if you are using the scripts, set DERBY_JARS_ROOT and DOTS_JARS_ROOT +appropriately

+ +

($. ./myenv.ksh)

+ +

§ +Obtain derby jars derby.jar, derbytools.jar ( for embedded mode)

+ +

For +network server mode, also need derbynet.jar

+ +

Set +classpath to derby jars.

+ +

export DERBY_JARS="/home/perftest/derby"

+ +

export CLASSPATH="$DERBY_JARS/derby.jar:$DERBY_JARS/derbytools.jar"

+ +

($. ./cpderby.ksh +)

+ +

§ +Ensure JVM is in your path.

+ +

export +PATH="/home/perftest/jdk1.4.2_04/bin:${PATH}"

+ +

+ [... 3424 lines stripped ...]