lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Benjamin Stein" <...@shadowtv.com>
Subject Re: IndexWriter.addIndexes & optimization
Date Wed, 07 Jun 2006 19:23:26 GMT
On 6/7/06, Benjamin Stein <ben@shadowtv.com> wrote:
>
> During indexing, I have been using a RAMDirectory to store many thousands
> of documents in memory before flushing the buffer to disk using
> IndexWriter.addIndexes.
> For the most part this works very well, except that performance degrades
> tremendously over time due to the implicit call (or two!)
> to optimize() inside the addIndexes function.
>


I could probably store the little RAMDirectories to disk as many
FSDirectories, and then addIndexes() of *all* the FSDirectories at the end
instead of every time.  That would probably be smart.

Glad I asked myself!

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message