lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael McCandless <luc...@mikemccandless.com>
Subject Re: OutOfMemoryError with FSDirectory
Date Tue, 05 Apr 2011 17:03:54 GMT
Try 1) reducing the RAM buffer of your IndexWriter
(IndexWriter.setRAMBufferSizeMB), 2) using a term divisor when opening
your reader (pass 2 or 3 or 4 as termInfosIndexDivisor when opening
IndexReader), and 3) disabling norms or not indexing as many fields as
possible.

70Mb is not that much RAM to work with, but, for only 80K docs it
should be possible as long as the docs are not large.

Mike

http://blog.mikemccandless.com

On Mon, Apr 4, 2011 at 6:39 AM, Claudio R <usertec@yahoo.com.br> wrote:
> Hi,
>
> I am using Lucene 2.9.4 with FSDirectory.
> My index has 80 thousand documents (each document has 12 fields).
> My jvm has 70Mb of RAM memory (limited by my hosting).
> I am getting various OutOfMemoryError.
> I ran jmap and I got:
>
> num       #instances    #bytes    Class description
> --------------------------------------------------------------------------
> 1:        275926    32074080    char[]
> 2:        657724    31570752    org.apache.lucene.index.FreqProxTermsWriter$PostingList
> 3:        200    16094896    org.apache.lucene.index.RawPostingList[]
>
> The Lucene is
>  consuming 47Mb of RAM memory.
> Why there is this excessive memory consumption in FSDirectory?
> Is it correct?
> Thanks.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message