Try 1) reducing the RAM buffer of your IndexWriter
(IndexWriter.setRAMBufferSizeMB), 2) using a term divisor when opening
your reader (pass 2 or 3 or 4 as termInfosIndexDivisor when opening
IndexReader), and 3) disabling norms or not indexing as many fields as
possible.
70Mb is not that much RAM to work with, but, for only 80K docs it
should be possible as long as the docs are not large.
Mike
http://blog.mikemccandless.com
On Mon, Apr 4, 2011 at 6:39 AM, Claudio R <usertec@yahoo.com.br> wrote:
> Hi,
>
> I am using Lucene 2.9.4 with FSDirectory.
> My index has 80 thousand documents (each document has 12 fields).
> My jvm has 70Mb of RAM memory (limited by my hosting).
> I am getting various OutOfMemoryError.
> I ran jmap and I got:
>
> num #instances #bytes Class description
> --------------------------------------------------------------------------
> 1: 275926 32074080 char[]
> 2: 657724 31570752 org.apache.lucene.index.FreqProxTermsWriter$PostingList
> 3: 200 16094896 org.apache.lucene.index.RawPostingList[]
>
> The Lucene is
> consuming 47Mb of RAM memory.
> Why there is this excessive memory consumption in FSDirectory?
> Is it correct?
> Thanks.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
|