lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael McCandless <luc...@mikemccandless.com>
Subject Re: Is there a way to limit the size of an index?
Date Wed, 13 Jan 2010 11:21:11 GMT
On Sun, Jan 10, 2010 at 7:33 AM, Dvora <barak.yaish@gmail.com> wrote:
>
> I'm storing and reading the documents using Compass, not Lucene directly. I
> didn't touch those parameters, so I guess the default values are being used
> (I do see cfs files in the index).

OK.  If your index directory has *.cfs files, then you are using the
default compound file format (I'm not sure whether Compass changes
that default either).

> How the ramBufferSizeMB parameter affect the files size? What value should I
> use in order to have 6MB files?

ramBufferSizeMB controls how big the initially created segments are.
Just how big a segment you get for a given ramBufferMB is very app
dependent, because the RAM efficiency of IndexWriter depends on things
like whether you have many unique terms (= worse RAM efficiency).
Generally larger RAM buffers have better efficiency.

Merging can only create bigger segments from those flushed segments.

So, you have to ensure ramBufferSizeMB is set such that in your use
case it never up and flushes a segment bigger than your 10 MB size
limit.

Mike

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message