Return-Path: 
 <torque-dev-return-9195-apmail-db-torque-dev-archive=db.apache.org@db.apache.org>
Delivered-To: apmail-db-torque-dev-archive@www.apache.org
Received: (qmail 41848 invoked from network); 23 Nov 2009 12:48:22 -0000
Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3)
  by minotaur.apache.org with SMTP; 23 Nov 2009 12:48:22 -0000
Received: (qmail 87598 invoked by uid 500); 23 Nov 2009 12:48:21 -0000
Delivered-To: apmail-db-torque-dev-archive@db.apache.org
Received: (qmail 87558 invoked by uid 500); 23 Nov 2009 12:48:21 -0000
Mailing-List: contact torque-dev-help@db.apache.org; run by ezmlm
Precedence: bulk
List-Unsubscribe: <mailto:torque-dev-unsubscribe@db.apache.org>
List-Help: <mailto:torque-dev-help@db.apache.org>
List-Post: <mailto:torque-dev@db.apache.org>
List-Id: "Apache Torque Developers List" <torque-dev.db.apache.org>
Reply-To: "Apache Torque Developers List" <torque-dev@db.apache.org>
Delivered-To: mailing list torque-dev@db.apache.org
Received: (qmail 87546 invoked by uid 99); 23 Nov 2009 12:48:21 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 23 Nov 2009 12:48:21 +0000
X-ASF-Spam-Status: No, hits=3.4 required=10.0
	tests=HTML_MESSAGE,SPF_NEUTRAL
X-Spam-Check-By: apache.org
Received-SPF: neutral (nike.apache.org: local policy)
Received: from [74.125.78.27] (HELO ey-out-2122.google.com) (74.125.78.27)
    by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 23 Nov 2009 12:48:11 +0000
Received: by ey-out-2122.google.com with SMTP id 4so216871eyf.57
        for <torque-dev@db.apache.org>; Mon, 23 Nov 2009 04:47:50 -0800 (PST)
Received: by 10.213.24.9 with SMTP id t9mr3519475ebb.92.1258980469924;
        Mon, 23 Nov 2009 04:47:49 -0800 (PST)
Received: from GreenStreet (h59ec0d32.stgertrud.dyn.perspektivbredband.net
 [89.236.13.50])
        by mx.google.com with ESMTPS id 15sm893800ewy.4.2009.11.23.04.47.48
        (version=SSLv3 cipher=RC4-MD5);
        Mon, 23 Nov 2009 04:47:49 -0800 (PST)
From: "Ludwig Magnusson" <ludwig@itcatapult.com>
To: "'Apache Torque Developers List'" <torque-dev@db.apache.org>
Subject: Extensive memory usage in torque-generator. Bug?
Date: Mon, 23 Nov 2009 13:47:38 +0100
Message-ID: <00c501ca6c3b$23a6ba80$6af42f80$@com>
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----=_NextPart_000_00C6_01CA6C43.856B2280"
X-Mailer: Microsoft Office Outlook 12.0
Thread-Index: AcpsOyIKDizgd9QDQ7mZeJAYxl9z5w==
Content-Language: sv
X-Virus-Checked: Checked by ClamAV on apache.org

------=_NextPart_000_00C6_01CA6C43.856B2280
Content-Type: text/plain;
	charset="us-ascii"
Content-Transfer-Encoding: 7bit

Hello!

A few days ago I posted in the users list that I got a
java.lang.OutOfMemoryError while trying to generate my data-sql.

I did some stress testing on the generator, here is how it went:

 

I used a simple table and tried to insert different number of rows, ranging
from 1 to 2000.

This is my data.xml for n number of roles:

<dataset name="all">

  <Role Id="0" Name="Role_0"/>

  <Role Id="1" Name="Role_1"/>

  .

  <Role Id="n" Name="Role_n"/>

</dataset>

 

At the end of each run maven prints the amount of memory used (final
memory), here are some values:

 

1 row - 11M/20M

100 rows - 15M/25M

1000 rows - 42M/63M

1500 rows - 58M/63M

2000 rows - fail 63M/63M

 

The limit seems to be around 1500 rows.

When that's the case, the input file is ca 60Kb and the output file is ca
100Kb, so how can the generator use 58Mb of memory?

Is this a bug? Known or unknown?

/Ludwig


------=_NextPart_000_00C6_01CA6C43.856B2280--