Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (asf.osuosl.org: domain of beadygeraghty@gmail.com
 designates 66.249.82.197 as permitted sender)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
        s=beta; d=gmail.com;
        h=received:message-id:date:from:to:subject:mime-version:content-type;
        b=n+akDa5t+/pj4k55ESs+CvHFCqpoXWplP/yf+poIj4fUGiM0nfeJj9Jok6L6uI6K+paGirsWJGr57ByH//xT9VQ4+AgCsCXmSfdsr3Cuz09byceNyLBiNPhMAw6txSIqz7eB8UPvgHVzkXgP+C99GZrGfEqKypkdyEQtqVT6AHI=
Message-ID: <b487c1370605140907n5679f828v998cd5bdb3e930ec@mail.gmail.com>
Date: Sun, 14 May 2006 12:07:43 -0400
From: "Beady Geraghty" <beadygeraghty@gmail.com>
To: java-user@lucene.apache.org
Subject: out-of-memory when searching, paging does not work.
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----=_Part_39229_26171347.1147622863324"

------=_Part_39229_26171347.1147622863324
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: quoted-printable
Content-Disposition: inline

I have an out-of-memroy error when returning  many hits.

I am still on Lucene 1.4.3

I have a simple term query.  It returned 899810 documents.
I try to retrieve the name of each document and nothing else
and I ran out of memory.

Instead of getting the names all at once, I tried to query again after
every 10,000 document.
I close the index reader, index searcher, and the fsDir and re-query
for every 10000 documents.  This still doesn't work.

>From another entry in the forum, it appears that the information about
the hits that I have skipped over are still kept even though I don't
access them.  Am I understanding it correctly that if I start accessing
from the 400000th documents onwards, some information about the 0-399999
documents are still cached even though I have skipped over those.
Is there a way to get the file name (and perhaps other information) of the
remaining
documents ?

(I tried a different term query that returned a hit size of 400000, and I
was able
to get the names of them all without re-quering)

I think that I see someone mentioned about  clearing the hit cache ,
though I don't how this is done.

Thank you in advance for any hints on dealing with this.

------=_Part_39229_26171347.1147622863324--