lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Doug Cutting <cutt...@lucene.com>
Subject Re: Stress/scalability testing Lucene
Date Wed, 20 Nov 2002 22:03:44 GMT
Justin Greene wrote:
> We created a thread pool to read and parse the email
> messages.  10 threads seems to be the magic number here for us.  We then
> created a queue of messages to be indexed onto which we push the parsed
> messages and have a single thread adding messages to the index.

IndexWriter.addDocument(Document) is thread safe, so you don't need a 
separate indexing thread.  So long as your analyzer is thread safe, you 
can index each messages in the thread that parses it, for even greater 
parallelism.

Doug


--
To unsubscribe, e-mail:   <mailto:lucene-user-unsubscribe@jakarta.apache.org>
For additional commands, e-mail: <mailto:lucene-user-help@jakarta.apache.org>


Mime
View raw message