Return-Path: Delivered-To: apmail-ibatis-user-java-archive@www.apache.org Received: (qmail 42495 invoked from network); 11 Apr 2008 19:41:55 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 11 Apr 2008 19:41:55 -0000 Received: (qmail 82371 invoked by uid 500); 11 Apr 2008 19:41:53 -0000 Delivered-To: apmail-ibatis-user-java-archive@ibatis.apache.org Received: (qmail 82357 invoked by uid 500); 11 Apr 2008 19:41:53 -0000 Mailing-List: contact user-java-help@ibatis.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user-java@ibatis.apache.org Delivered-To: mailing list user-java@ibatis.apache.org Received: (qmail 82346 invoked by uid 99); 11 Apr 2008 19:41:53 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 11 Apr 2008 12:41:53 -0700 X-ASF-Spam-Status: No, hits=2.4 required=10.0 tests=DNS_FROM_OPENWHOIS,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of clamey@localmatters.com designates 216.241.189.144 as permitted sender) Received: from [216.241.189.144] (HELO mailhost01.ad.corp.localmatters.com) (216.241.189.144) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 11 Apr 2008 19:41:02 +0000 Received: from 10.4.0.152 ([10.4.0.152]) by mailhost01.ad.corp.localmatters.com ([10.200.4.32]) with Microsoft Exchange Server HTTP-DAV ; Fri, 11 Apr 2008 19:41:19 +0000 User-Agent: Microsoft-Entourage/11.3.6.070618 Date: Fri, 11 Apr 2008 13:41:19 -0600 Subject: Re: groupby x out of memory From: Christopher Lamey To: Message-ID: Thread-Topic: groupby x out of memory Thread-Index: AcicDANcQa3RNQf/Ed29yAAbY5caEQ== In-Reply-To: <2f55db670804111232k25f22fe2h63e71202ae00333d@mail.gmail.com> Mime-version: 1.0 Content-type: text/plain; charset="US-ASCII" Content-transfer-encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org On 4/11/08 1:32 PM, "Nathan Maves" wrote: > We have seen a few posts about using RowHandlers in the past few > months. Though I have not tried it with the optional groupBy attribute I > can definitively say that I have processed millions of row through a row > handler and my application never user more the 10mg of memory. Same here - up to 30M rows using RowHandlers in several different applications (Swing, webapp, standalone data crunching), no memory issues in iBATIS. You have to be careful about what you keep around in your own code, but iBATIS has never been a problem for me. Cheers, topher