Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: solr-user@lucene.apache.org
Received-SPF: pass (nike.apache.org: domain of solr@elyograg.org designates
 166.70.79.219 as permitted sender)
Message-ID: <51CC5441.9060403@elyograg.org>
Date: Thu, 27 Jun 2013 09:03:29 -0600
From: Shawn Heisey <solr@elyograg.org>
User-Agent: Mozilla/5.0 (Windows NT 6.2; WOW64;
 rv:17.0) Gecko/20130509 Thunderbird/17.0.6
MIME-Version: 1.0
To: solr-user@lucene.apache.org
Subject: Re: Is Overlapping onDeckSearchers=2 really a problem?
References: 
 <CAEnqZEXut3dL-GOu5Lp_KkjhigqX7JyyfJ3HjfWLtzEuZra78g@mail.gmail.com>
 <CAEnqZEUuLKLhJbu2Sbk6ibYJ_rXGs8fmgNrAAAd4-ankRBZPYg@mail.gmail.com>
In-Reply-To: 
 <CAEnqZEUuLKLhJbu2Sbk6ibYJ_rXGs8fmgNrAAAd4-ankRBZPYg@mail.gmail.com>
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit

On 6/27/2013 5:59 AM, Robert Krüger wrote:
> sometime forcing oneself to describe a problem is the first step to a
> solution. I just realized that I also had an autocommit statement in
> my config with the exact same amount of time the seemed to be between
> the warnings.
> 
> I removed that, because I don't think I really need it, and now the
> warnings are gone. So it seems it happened whenever my manual commits
> overlapped with an autocommit, which, of course, was more likely when
> many commits were issued in sequence.

If all you are doing is soft commits, your transaction logs are going to
grow out of control.

http://wiki.apache.org/solr/SolrPerformanceProblems#Slow_startup

My recommendation:

1) Remove all commits from your indexing application.
2) Configure autoCommit with values similar to that wiki page.
3) Configure autoSoftCommit to happen often.

The autoCommit must have openSearcher set to false.  For autoSoftCommit,
include a maxTime between 1000 and 5000 (milliseconds) and leave maxDocs
out.

Thanks,
Shawn