lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shawn Heisey <s...@elyograg.org>
Subject Re: Is Overlapping onDeckSearchers=2 really a problem?
Date Thu, 27 Jun 2013 15:03:29 GMT
On 6/27/2013 5:59 AM, Robert Kr├╝ger wrote:
> sometime forcing oneself to describe a problem is the first step to a
> solution. I just realized that I also had an autocommit statement in
> my config with the exact same amount of time the seemed to be between
> the warnings.
> 
> I removed that, because I don't think I really need it, and now the
> warnings are gone. So it seems it happened whenever my manual commits
> overlapped with an autocommit, which, of course, was more likely when
> many commits were issued in sequence.

If all you are doing is soft commits, your transaction logs are going to
grow out of control.

http://wiki.apache.org/solr/SolrPerformanceProblems#Slow_startup

My recommendation:

1) Remove all commits from your indexing application.
2) Configure autoCommit with values similar to that wiki page.
3) Configure autoSoftCommit to happen often.

The autoCommit must have openSearcher set to false.  For autoSoftCommit,
include a maxTime between 1000 and 5000 (milliseconds) and leave maxDocs
out.

Thanks,
Shawn


Mime
View raw message