lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Doug Cutting <cutt...@apache.org>
Subject Re: ParallelMultiSearcher reimplementation
Date Fri, 03 Nov 2006 18:39:47 GMT
Gus Holcomb wrote:
>   We are currently using Lucene 1.9.1 at work. Using a profiler, I
> discovered that searching with a HitCollector in a ParallelMultiSearcher
> is single threaded. By extending ParallelMultiSearcher I was able to
> parallelize it without a problem (and without requiring a new lucene jar
> for deployment). In addition, I re-implemented all of the existing
> multithreading using a user configurable thread pool, queue and executor
> service, etc. The current implementation of spawning one thread per
> searchable is not only slower, but dangerous.

Please consider breaking these into separate patches, one to permit 
ParallelMultiSearcher w/ HitCollector to not be single-threaded, and 
another to re-implement things with a thread pool.  The latter is more 
controversial, and it would be a shame to have the former wait on it.

Doug

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Mime
View raw message