lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Leo Galambos <galam...@com-os2.ms.mff.cuni.cz>
Subject Re: Lucene Benchmarks and Information
Date Sat, 21 Dec 2002 15:36:28 GMT
On Fri, 20 Dec 2002, Doug Cutting wrote:

> The max a reader will keep open is:
> 
>    mergeFactor * log_base_mergeFactor(N) * files_per_segment
> 
> A writer will open:
> 
>    (1 + mergeFactor) * files_per_segment

I am not sure if you must open all files (i.e. writer would need just
2*f_p_s if you keep A-Z order in DocUIDs??). IMHO it is a bug and the
point why Lucene does not scale well on huge collections of documents. I
am talking about my previous tests when I used live index and concurrent
query+insert+delete (I wanted to simulate real application).

BTW, your mail is also an answer to previous topic "how often could one
call optimize()". The method would be called before the index goes to
production state. And it also means that tests are irrelevant until they
are made with lower mergeFactor.

...but it is possible that I missed something (I do not know Lucene as 
good as you).

-g-


--
To unsubscribe, e-mail:   <mailto:lucene-user-unsubscribe@jakarta.apache.org>
For additional commands, e-mail: <mailto:lucene-user-help@jakarta.apache.org>


Mime
View raw message