lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Claudio <t...@conectavoce.com>
Subject Re: OutOfMemoryError with FSDirectory
Date Tue, 05 Apr 2011 02:27:50 GMT

Ok Erick,

Thanks for your quick answer.

> FSDirectory will, indeed, store the index on disk. However,
> when *using* that index, lots of stuff happens. Specifically:
> When indexing, there is a buffer that accumulates documents
> until it's flushed to disk. Are you indexing?
>
> When searching (and this is the more important part), various
> caches are used to speed up searches. A substantial part of
> your index may be held in memory at various points.
>
> 70M just isn't very much memory, I think you'll have to get
> more if at all possible.
>
> Best
> Erick
>
> On Mon, Apr 4, 2011 at 7:13 AM, Claudio <temp@conectavoce.com> wrote:
>
>> Hi,
>>
>> I am using Lucene 2.9.4 with FSDirectory.
>> My index has 80 thousand documents (each document has 12 fields).
>> My jvm has 70Mb of RAM memory (limited by my hosting).
>> I am getting various OutOfMemoryError.
>> I ran jmap and I got:
>>
>> num       #instances    #bytes    Class description
>> --------------------------------------------------------------------------
>> 1:        275926    32074080    char[]
>> 2:        657724    31570752
>>  org.apache.lucene.index.FreqProxTermsWriter$PostingList
>> 3:        200    16094896    org.apache.lucene.index.RawPostingList[]
>>
>> The Lucene is consuming 47Mb of RAM memory.
>> Why there is this excessive memory consumption in FSDirectory?
>> Is it correct? I'm using FSDirectory because I havenĀ“t a big amount of RAM
>> memory.
>>
>> Thanks.
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>
>>
>




---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message