Return-Path: Delivered-To: apmail-db-derby-user-archive@www.apache.org Received: (qmail 20915 invoked from network); 2 Mar 2006 09:00:55 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (209.237.227.199) by minotaur.apache.org with SMTP; 2 Mar 2006 09:00:55 -0000 Received: (qmail 1559 invoked by uid 500); 2 Mar 2006 09:01:41 -0000 Delivered-To: apmail-db-derby-user-archive@db.apache.org Received: (qmail 1205 invoked by uid 500); 2 Mar 2006 09:01:39 -0000 Mailing-List: contact derby-user-help@db.apache.org; run by ezmlm Precedence: bulk list-help: list-unsubscribe: List-Post: List-Id: Reply-To: "Derby Discussion" Delivered-To: mailing list derby-user@db.apache.org Received: (qmail 1194 invoked by uid 99); 2 Mar 2006 09:01:39 -0000 Received: from asf.osuosl.org (HELO asf.osuosl.org) (140.211.166.49) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Mar 2006 01:01:39 -0800 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests=UNPARSEABLE_RELAY X-Spam-Check-By: apache.org Received-SPF: pass (asf.osuosl.org: local policy) Received: from [192.18.98.31] (HELO brmea-mail-1.sun.com) (192.18.98.31) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Mar 2006 01:01:37 -0800 Received: from phys-gadget-1 ([129.156.85.171]) by brmea-mail-1.sun.com (8.12.10/8.12.9) with ESMTP id k2290wSZ021318 for ; Thu, 2 Mar 2006 02:01:17 -0700 (MST) Received: from conversion-daemon.gadget-mail1.uk.sun.com by gadget-mail1.uk.sun.com (iPlanet Messaging Server 5.2 HotFix 1.24 (built Dec 19 2003)) id <0IVH00G01SXRZ3@gadget-mail1.uk.sun.com> (original mail from Kristian.Waagan@Sun.COM) for derby-user@db.apache.org; Thu, 02 Mar 2006 09:01:05 +0000 (GMT) Received: from [129.159.112.188] (khepri17.Norway.Sun.COM [129.159.112.188]) by gadget-mail1.uk.sun.com (iPlanet Messaging Server 5.2 HotFix 1.24 (built Dec 19 2003)) with ESMTPA id <0IVH00BQZT1Q88@gadget-mail1.uk.sun.com> for derby-user@db.apache.org; Thu, 02 Mar 2006 09:01:04 +0000 (GMT) Date: Thu, 02 Mar 2006 10:01:02 +0100 From: Kristian Waagan Subject: Re: order by In-reply-to: To: Derby Discussion Message-id: <4406B44E.4020908@Sun.com> Organization: Sun Microsystems Inc. MIME-version: 1.0 Content-type: text/plain; charset=ISO-8859-1; format=flowed Content-transfer-encoding: 7BIT User-Agent: Mozilla/5.0 (X11; U; SunOS i86pc; en-US; rv:1.8) Gecko/20060113 Thunderbird/1.5 Mnenhy/0.7.3.0 References: <20060301133725.ACD2A4A5F4@dbrack01.segel.com> X-Virus-Checked: Checked by ClamAV on apache.org X-Spam-Rating: minotaur.apache.org 1.6.2 0/1000/N Thomas Vatter wrote: > > I have analysed the situation by importing multiplications of the small > and working spreadsheet. The import again slowed down and then stops at > 1200 records (ui goes on with progress indicator, it does not catch the > problem). The same slowdown and stop at 1200 records happens when I show > the data in the Application. When this happens memory usage is always > between 912 and 960mb. The machine has 1gb. This prevented me from > understandig that it is a memory problem. Now I am 'sure' it is one. > I have several processes running at once, the derby networkserver, > my applications rmi server, my applications client and the ide. I > have to do the data testing with 40.000 records in the database not > only 1.200, so perhaps I should install the database server on a > remote machine to have a chance to succeed. > > Hello Thomas, I agree that it would be a good test to run the Derby network server on a different machine than your application code/processes. That way, you should be able to monitor the memory usage on the machines better. I do have a few questions. * What operating system are you running? * What parameters, if any, do you pass to the Java VM? I'm thinking of those that determine how much memory the VM is allowed to use. * You say "memory usage is always between 912 and 960mb". It is your Java process that uses this memory, or is this the total usage for the machine? * How big is a record? Since you are talking about a spreadsheet here, I imagine a record is a line in it, and thus not very big. * It would also be helpful if you are able to import the data somehow, and then try to do some queries against the database from ij. If you run into problems getting the network server running, don't hesitate asking for help. You also have a search box on the Derby website and the various manuals that you can use. Don't forget to specify the host argument when starting the network server (or else it will only accept connections from localhost): 'java -classpath derbynet.jar org.apache.derby.drda.NetworkServerControl -h my.hostname.or.ip start' (or use the scripts as described in the documentation) -- Kristian