Mailing-List: contact derby-user-help@db.apache.org; run by ezmlm
Precedence: bulk
Reply-To: "Derby Discussion" <derby-user@db.apache.org>
Received-SPF: pass (athena.apache.org: domain of acidbriggs@gmail.com
 designates 209.85.198.189 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=message-id:date:from:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition;
        b=c5e6RqL4mw3391oCLh2NaLitqL7wduq0wm8JDkQTAqezPo+eq0MI6LNiwKyIl4QAZCDNU6Qp7h7pqA3rwJHnyUAwlkDcmI2iWrHJ//g332yM+1l+GxAJ4kLnOygNWWlH9Ue+yXpHzsuiofPoXrwNNx2ZStbiDFXAd8GJfDgPwkk=
Message-ID: <1c0e93080802080514i50df5cb0sea0e65f59ca39dd5@mail.gmail.com>
Date: Fri, 8 Feb 2008 08:14:45 -0500
From: Briggs <acidbriggs@gmail.com>
To: "Derby Discussion" <derby-user@db.apache.org>
Subject: Iterating through large result set in network mode causes
 OutOfMemoryException
MIME-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

So, I have a derby database that could potentially contain millions of
records, but at the moment it has 13K.

I am trying to iterate through that table after calling a basic
"Select * from myTable".  After about 5000 records, I get an out of
memory
exception/error on the server side.  This table has very a couple
small clobs in it (each field contains about only 100 chars at the
moment) and one large clob.  I have no transactions running, the
result set is read only.  I would think that I should be able to loop
through an infinite set of results.  If I do this in embedded mode
it's fine. I have read over 10 million records with no problem. But,
again, in network mode it fails early.

Anyone have any advice?  I would think that a non-scrollable result
set should not keep any of the results in memory (on the server) once
the cursor has passed it.


-- 
"Conscious decisions by conscious minds are what make reality real"