lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chris Hostetter <hossman_luc...@fucit.org>
Subject Re: Parallelizing warmup queries
Date Mon, 18 Nov 2013 18:02:06 GMT

: It looks like warmup queries execute sequentially.
: 
: Considering servers have N CPU cores these days, would it make sense
: to make them (optionally) run in parallel?  This should help with
: cases where warmup queries are CPU bound by letting Solr use more than
: 1 thread and thus more than 1 CPU core.  Should I add to JIRA?

It's something we've talked about before, so there may already be one.

One reason it's never been super high on my priority list: in the 
newSearcher case, where you are actively serving "live" searches against 
the old searcher, you probably don't want to risk CPU contention by 
spinning up a bunch of new threads to hammer the newSearcher with warming 
queries.

the main place parallelized warming queries would be handy is on 
firstSearcher -- but since server startup / core reload should be a 
fairly low occurance situation in a production deployment , there 
were always bigger fish to fry in terms of improving solr.


-Hoss

Mime
View raw message