lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Adrien Grand (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SOLR-2548) Multithreaded faceting
Date Fri, 27 May 2011 08:23:47 GMT

    [ https://issues.apache.org/jira/browse/SOLR-2548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13040124#comment-13040124
] 

Adrien Grand commented on SOLR-2548:
------------------------------------

Hello Janne,

Is there any reason why you didn't make facet queries and facet ranges multi-threaded ?

You create a thread pool with ${nProcessors} worker threads locally, meaning that a server
with 8 processors serving 10 concurrent requests would have to start and then run 80 threads
simultaneously before stopping each of them. At this level, multi-threaded facet computation
may be slower than single-threaded facet computation. I suggest instead to share a single
thread pool for every facet computation with coreSize=0, a SynchronousQueue, and ThreadPoolExecutor.CallerRunsPolicy
as a RejectExecutionHandler. This way you would avoid the overhead of starting and then stopping
threads and have a better control over the total number of threads computing facets.


> Multithreaded faceting
> ----------------------
>
>                 Key: SOLR-2548
>                 URL: https://issues.apache.org/jira/browse/SOLR-2548
>             Project: Solr
>          Issue Type: Improvement
>          Components: search
>    Affects Versions: 3.1
>            Reporter: Janne Majaranta
>            Priority: Minor
>              Labels: facet
>         Attachments: SOLR-2548.patch, SOLR-2548_for_31x.patch
>
>
> Add multithreading support for faceting.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message