lucene-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Otis Gospodnetic <otis_gospodne...@yahoo.com>
Subject Re: Multi-Processor Indexing
Date Wed, 21 May 2008 04:06:09 GMT
Try using 8-9 indexing threads, all of which share the same IndexWriter instance.  It would
be great if you could report some observations or numbers.  A better place to ask questions
like this is on java-user@lucene (more people).

Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch


----- Original Message ----
> From: DanaWhite <philrymek@comcast.net>
> To: general@lucene.apache.org
> Sent: Tuesday, May 20, 2008 4:26:54 PM
> Subject: Multi-Processor Indexing
> 
> 
> I am going to be indexing a large volume of documents (1TB worth) on a server
> with 8 processors.  By default Lucene only seems to use one processor but I
> would like to utilize all 8 so it does not take an entire week to index the
> files.  
> 
> I am not really sure what is the best way of doing this but ANY insight
> would be appreciated.
> 
> Thanks!
> -- 
> View this message in context: 
> http://www.nabble.com/Multi-Processor-Indexing-tp17350069p17350069.html
> Sent from the Lucene - General mailing list archive at Nabble.com.


Mime
View raw message