- -

Running DOTS -(Database Open Source Test Suite) with Derby

- -

Sunitha -Kambhampati ( skambha@Yngvi.Org)

- -

Preface:

- -

I ran DOTS (Database Open Source Test Suite) with Derby -as the underlying database. The setup was simple and it seems like this test -suite can be used for testing on Linux. -This document talks about how I went about trying to setup DOTS with Derby. I hope this will be of some help to the -community. Please feel free to add your suggestions/ modifications to this -document. Thanks.

- -

1. -Introduction. 1

- -

2. Environment 2

- -

2.1 Software Requirements. 2

- -

2.2 The test environment that was used in this study: 2

- -

3. Overview of DOTS and test configurations with Derby. 3

- -

4. Steps to setup and run Dots: 3

- -

4.1. Installation of DOTS. 3

- -

4.2. Database (Derby) related setup. 4

- -

4.3. Start the database server 5

- -

4.4. Configuring test run parameters for DOTS client 6

- -

4.5. Running the benchmark. 7

- -

4.6. Checking the output and investigating possible -problems. 8

- -

4.7. Cleaning up. 8

- -

5. Test Results with Derby. 9

- -

6. Summary. 9

- -

7. External Links. 10

- -

APPENDIX A: Derbyscripts.tar.gz contents. 10

- -

APPENDIX B: Sample result file with Derby. 11

- -

APPENDIX C: -derby.ini 16

- -

APPENDIX D: derbyNS.ini 18

- -

1. Introduction

- -

Database Opensource Test Suite (DOTS) is an open source test -suite that is used to stress test database systems and to measure database -reliability (http://ltp.sourceforge.net/dotshowto.php#SEC1 -. DOTS is licensed under GNU General Public License -(GPL). The test cases are in Java and -make JDBC calls to the database. They are aimed to test 100% JDBC API -coverage. There are two kinds of test -cases, basic and advanced. There are 8 basic tests prefixed with BTCJ and 2 -advanced tests prefixed by ATCJ. The -advanced test cases simulate real world workloads including user -authentication/registration scenario and an online auction scenario.

- -

Derby is an -incubator project at Apache. Derby -is a standards based java relational database system.(http://incubator.apache.org/derby/). -Some main features of derby are it is embedded, has small footprint, is pure java, easy to use and secure.

- -

The aim of this document is to help setup DOTS to run with Derby. The following link http://ltp.sourceforge.net/dotshowto.php#SEC1 -at the DOTS site provides a good overview of the architectural components of -the test suite as well as the schema details.

- -

This -document basically does a walkthrough of a setup/ run of DOTS with Derby -as the database. There are some scripts -that are given with the hope that it will aid in reducing your setup time.

- -

2. -Environment

- -

This -section talks about the hardware and software needed to run DOTS. In -sub-section 2.1, the requirement as stated by DOTS is given. Sub-section 2.2 lists the actual test -environment used.

- -

2.1 Software Requirements:

- -

Database: -Derby (derby jars: derby.jar, -derbynet.jar and derbytools.jar and if using network server, also need the drda client db2jcc.jar and db2jcc_license_c.jar)

- -

OS: -Linux 2.4.4

- -

JVM: -J2SE1.3.1 or higher

- -

Hardware -Requirements:

- -

CPU: -700Mhz or higher

- -

Memory: -512Mb or higher

- -

Disk -Capacity: 2 GB or higher

- -

2.2 -The test environment that was used in this study:

- -

Test -machine:

- -

- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

- OS Name -	- Suse Linux -
- Version -	- 9.0 -
- System Manufacturer -	- IBM -
- System Model -	- 86473FX -
- System Type -	- X86-based PC -
- Processor -	- x86 Family 15 Model 2 Stepping 7 GenuineIntel ~2400 Mhz -
- Processor -	- x86 Family 15 Model 2 Stepping 7 GenuineIntel ~2400 Mhz -
- Memory -	- 4Gb -

- -

Software -Used:

- -

Derby jars

- -

Instructions to -build derby jars and downloads are at

- -

        http://incubator.apache.org/derby/derby_downloads.html

- -

Java -

- -

Java 1.4.2

- -

3. -Overview of DOTS and test configurations with Derby

- -

A high -level overview of the main components of DOTS is as follows

- -

There is the database system - that DOTS is run against.

- -

DOTS client that drives the - test run

- -

There is a performance - monitor that runs on the same machine as the database and communicates with - the DOTS client via sockets passing information about the CPU usage and - other performance related attributes.

- -

DOTS can be run in two modes:

- -

DOTS client on one machine, - and the database server on another machine
DOTS client and database - server on the same machine.

- -

Derby with DOTS -can run in two modes

- -

Derby - in embedded mode runs as part of the DOTS client (ie - in the same JVM as the DOTS client). Hence the only possible configuration - would be DOTS client and embedded database as well as the performance - monitor program on one machine.
Derby - in client server mode (Network Server). - If you use Derby Network Server, then the possible configurations - are

Database server and - performance monitor on one machine and the DOTS client on another machine -
Database server, - performance monitor and DOTS client on one machine.

- -

4. -Steps to setup and run Dots:

- -

In -the example described here: the -database, DOTS client and the performance monitor are all on one machine. If you decide to have the DOTS client and -database server on different machines, the steps will be some what similar -except that you will have to ensure that the necessary jars are present on the -client and the database server machines.

- -

The -sections 3.1 and 3.2 of the Database Opensource Test Suite Users Guide provide -excellent overview. Section 3.1 (http://ltp.sourceforge.net/dotshowto.php#SEC11) -and

- -

Section -3.2 (http://ltp.sourceforge.net/dotshowto.php#SEC12)

- -

4.1. -Installation of DOTS

- -

1)            Download the DOTS 1.1.1 (Dots-1.1.1.gz) from here http://sourceforge.net/project/showfiles.php?group_id=3382

- -

Unzip -the gz file

- -

$ -tar zxvf Dots-1.1.1.gz

- -

After -this, there will be a Dots directory with different sub directories with source -of the tests, scripts, make file etc.

- -

In -this example, Dots has been installed at /home/perftest/Dots. Let $DOTS_ROOT -refer to your dots installation. Here it will be /home/perftest/Dots.

- -

2)      Make sure that java is installed, else install it and set the path variable to include jvm.

- -

3) Compiling the DOTS -source

- -

Change -directory to your Dots installation

- -

cd /home/perftest/Dots/

- -

Before -running the make command, make sure that you have javac in your path.

- -

make all

- -

This -will compile all the source java files in the src -subdirectory of your DOTS installation. If this is successful, you will see no -errors during the make, and there will be two jars under $DOTS_ROOT: PerfMon.jar and the -Dots.jar

- -

PerfMon.jar This jar file contains the classes necessary -to start the performance monitor client. This jar is required to run -performance monitor.

- -

Dots.jar This jar file has all the test cases that are -needed to run tests. Also contains the -DOTS client component needed to drive the test runs.

- -

4.2. -Database (Derby) -related setup

- -

The -database related setup involves setting up the necessary database jar files, -creating the database and loading the schema. For both Derby -(embedded or client-server mode), the ij tool that is -in derbytools.jar is used for creation of database and loading of schema.

- -

There -is a derbyscripts.tar.gz file along with this -document that has the scripts and sql files necessary for derby. For more -details on each of the scripts present in the derbyscripts.tar.gz file, please -see APPENDIX A. To help reduce the setup -time, these scripts can be easily modified according to your individual setup. -Unzip the derbyscripts.tar.gz into a directory called derby and execute the -scripts from the same directory. Modify the myenv.ksh to set the -DERBY_JARS_ROOT as well as the DOTS_JARS_ROOT environment variables -appropriately. DERBY_JARS_ROOT refers to the root directory where the derby -jars are located and DOTS_JARS_ROOT refers to the root directory where the DOTS -related jars are located. Below, for each step the corresponding script that -can be used is given enclosed in brackets. In case you are using the scripts, -make sure that you have first run myenv.ksh or set the DERBY_JARS_ROOT and -DOTS_JARS_ROOT variables in the shell window that you are executing from. -($. ./myenv.ksh)

- -

§ Open a new shell -window and if you are using the scripts, set DERBY_JARS_ROOT and DOTS_JARS_ROOT -appropriately

- -

($. ./myenv.ksh)

- -

§ -Obtain derby jars derby.jar, derbytools.jar ( for embedded mode)

- -

For -network server mode, also need derbynet.jar

- -

Set -classpath to derby jars.

- -

export DERBY_JARS="/home/perftest/derby"

- -

export CLASSPATH="$DERBY_JARS/derby.jar:$DERBY_JARS/derbytools.jar"

- -

($. ./cpderby.ksh -)

- -

§ -Ensure JVM is in your path.

- -

export -PATH="/home/perftest/jdk1.4.2_04/bin:${PATH}"

- -

($. ./jvm.ksh)

- [... 8451 lines stripped ...]