Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 44240 invoked from network); 5 Jun 2010 11:51:49 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 5 Jun 2010 11:51:49 -0000 Received: (qmail 29961 invoked by uid 500); 5 Jun 2010 11:51:47 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 29743 invoked by uid 500); 5 Jun 2010 11:51:44 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 29735 invoked by uid 99); 5 Jun 2010 11:51:44 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 05 Jun 2010 11:51:44 +0000 X-ASF-Spam-Status: No, hits=0.7 required=10.0 tests=RCVD_IN_DNSWL_NONE,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [74.125.83.48] (HELO mail-gw0-f48.google.com) (74.125.83.48) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 05 Jun 2010 11:51:37 +0000 Received: by gwb17 with SMTP id 17so2162947gwb.35 for ; Sat, 05 Jun 2010 04:51:16 -0700 (PDT) MIME-Version: 1.0 Received: by 10.150.99.13 with SMTP id w13mr11198288ybb.139.1275738676130; Sat, 05 Jun 2010 04:51:16 -0700 (PDT) Received: by 10.151.11.20 with HTTP; Sat, 5 Jun 2010 04:51:16 -0700 (PDT) In-Reply-To: References: Date: Sat, 5 Jun 2010 07:51:16 -0400 Message-ID: Subject: Re: Index Writer, RawPostingList and Memory Management From: Michael McCandless To: java-user@lucene.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org Previously, they were not freed, just reused. As of the tips of 29x, 30x, 3x, trunk, they are now fully freed. Mike On Sat, Jun 5, 2010 at 7:33 AM, Shay Banon wrote: > I will check, just wanted to verify though, do they get freed when callin= g > commit, or do they still hang around? Other pools are freed when calling > commit, right? > > -shay.banon > > On Sat, Jun 5, 2010 at 12:55 PM, Michael McCandless < > lucene@mikemccandless.com> wrote: > >> They are reclaimed, but, you may be hitting one of the memory leak >> bugs recently fixed but not yet (though soon to be) released. >> >> Can you try running with the tip of whichever release you are using? >> >> Mike >> >> On Fri, Jun 4, 2010 at 10:10 PM, Shay Banon wrote: >> > Hi, >> > >> > =A0I have a question on how IndexWriter manages its memory when it com= es to >> > RawPostingList. Its pretty late, so sorry if the question is obvious, = but >> > the question is when does the RawPostingList array gets reclaimed or >> > shrinked? I assume they get factored in the ram balancing process, but= , >> is >> > there a chance that they won't be reclaimed? Can I force them to be >> > reclaimed, I think that IndexWriter#commit does not affect that... . H= ere >> is >> > a link to a sample heap dump I took (I do call flush): >> > http://skitch.com/kimchy/dg3e4/eclipse-memory-analyzer. >> > >> > Thanks, >> > Shay >> > >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org >> For additional commands, e-mail: java-user-help@lucene.apache.org >> >> > --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org For additional commands, e-mail: java-user-help@lucene.apache.org