lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lucene User" <luceneus...@gmail.com>
Subject Re: Optimizing index takes too long
Date Mon, 12 Nov 2007 22:49:16 GMT
what type of documents are indexing

regards

gaurav


On 11/11/07, Barry Forrest <bforrest10@gmail.com> wrote:
>
> Hi,
>
> Optimizing my index of 1.5 million documents takes days and days.
>
> I have a collection of 10 million documents that I am trying to index
> with Lucene.  I've divided the collection into chunks of about 1.5 - 2
> million documents each.  Indexing 1.5 documents is fast enough (about
> 12 hours), but this results in an index directory containing about
> 35000 files.  Optimizing this index takes several days, which is a bit
> too long for my purposes.  Each sub-index is about 150G.
>
> What can I do to make this process faster?
>
> Thanks for your help,
> Barry
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message