lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Steven White <swhite4...@gmail.com>
Subject Re: Timeout error during commit
Date Thu, 10 Mar 2016 23:06:37 GMT
Got it.

Last question on this topic (maybe), wouldn't a commit at the very end take
too long on a 1 billion items?  Wouldn't a commit every, lets say 10,000
items be more efficient?

Steve

On Thu, Mar 10, 2016 at 5:44 PM, Shawn Heisey <apache@elyograg.org> wrote:

> On 3/10/2016 3:29 PM, Steven White wrote:
> > Thanks you for your insight Shawn, they are always valuable.
> >
> > Question, if I wait to the very end to issue a commit, wouldn't that
> mean I
> > could lose everything if there was an OOM or some other server issue?  I
> > don't have any commit setting set in my solrconfig.xml.
>
> This should not be a worry.  The transaction log should keep everything
> safe.
>
> As I said before, no matter what your intentions with commits are, you
> do want to have autoCommit with openSearcher set to false and a
> reasonably long maxTime.  I recommend one minute or five minutes, but
> you will see 15 seconds commonly recommended.  I use the longer time
> because I don't want Solr to be spending a lot of time doing commits.  A
> commit that doesn't open a new searcher is pretty quick, but it still
> requires CPU/memory/IO resources.
>
> Thanks,
> Shawn
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message