Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 61516 invoked from network); 19 Feb 2008 14:37:41 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 19 Feb 2008 14:37:41 -0000 Received: (qmail 17488 invoked by uid 500); 19 Feb 2008 14:37:29 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 17457 invoked by uid 500); 19 Feb 2008 14:37:29 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 17434 invoked by uid 99); 19 Feb 2008 14:37:29 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 19 Feb 2008 06:37:29 -0800 X-ASF-Spam-Status: No, hits=2.0 required=10.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of peterlkeegan@gmail.com designates 64.233.166.178 as permitted sender) Received: from [64.233.166.178] (HELO py-out-1112.google.com) (64.233.166.178) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 19 Feb 2008 14:36:57 +0000 Received: by py-out-1112.google.com with SMTP id a73so5314795pye.9 for ; Tue, 19 Feb 2008 06:37:05 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:in-reply-to:mime-version:content-type:references; bh=BPEelMhLbHHPjD78oxlscGGk2pnAHzXbA0JJn9CiYgM=; b=SOoV/2Vp6ezRANL5GO6fWLYvPXW6VVpIX+ToCr2Oj4venzfVKBFYxtY6ZjMuHSbaQHq81NZ3TahO6AC8WrvE39OHQsMPBAoP4gebXt9oexNzNLRmtSLcmCb1ojsz4ex/LR/sFaUFkJizLoNFp4riLoBnrmEdwnV/ZlqVJz/XUgg= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:in-reply-to:mime-version:content-type:references; b=XWNLeVbUghpFa8Aer1iQIiPNBqzx1loC5muA9CMjCU7b8UUAiEvzxCtTGFtN1vDuOaSMiFQ+wD30gzn1zEu/JCKoX1ur6VlFx5xhlZx8wGFr9tMLozP8fgsIuM4Mu0lHOx2tX3iL3oCg4v844Xs3C0wAPGWkhhX1XlG7gjodTBE= Received: by 10.35.39.11 with SMTP id r11mr8347419pyj.23.1203431825682; Tue, 19 Feb 2008 06:37:05 -0800 (PST) Received: by 10.35.29.1 with HTTP; Tue, 19 Feb 2008 06:37:05 -0800 (PST) Message-ID: Date: Tue, 19 Feb 2008 09:37:05 -0500 From: "Peter Keegan" To: java-user@lucene.apache.org Subject: Re: FieldSortedHitQueue rise in memory In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_11618_16560090.1203431825665" References: X-Virus-Checked: Checked by ClamAV on apache.org ------=_Part_11618_16560090.1203431825665 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline Hi Brian, I ran into something similar a long time ago. My custom sort objects were being cached by Lucene, but there were too many of them because each one had different 'reference values' for different queries. So, I changed the equals and hashcode methods to NOT use any instance data, thus avoiding the caching. Could this be what you're seeing? Peter On Feb 18, 2008 4:20 PM, Brian Doyle wrote: > We've implemented a custom sort class and use it to sort by distance. We > have implemented the equals and hashcode in the sort comparator. After > running for a few hours we're reaching peak memory usage and eventually > the > server runs out of memory. We did some profiling and noticed that a > large > chunk of memory is being used in the > lucence.search.FieldSortedHitQueueclass. Has anyone seen this > behavior before or know how we can stop this > class from growing in size? > ------=_Part_11618_16560090.1203431825665--