lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Erick Erickson <erickerick...@gmail.com>
Subject Re: Solr server partial update is very slow
Date Fri, 10 Nov 2017 06:28:10 GMT
bq: We are getting below log without invoking commit operation after
every partial update call

Not sure what you mean here. If you're issuing a commit from the
client every time you update a doc (or even a batch) that's an
anti-pattern and you're opening searchers all the time. Don't do that
;).

I'd set my autoCommit time to something reasonable like 60 seconds (or
even 15) with openSearcher=false in solrconfig.xml. Set your soft
commit to however long you can stand, I try for at least 10 seconds,
but 60 or even 300 if possible, it all depends on how long after you
index a document it has to be available for search.

The settings you have are dangerous. See:

https://lucidworks.com/2013/08/23/understanding-transaction-logs-softcommit-and-commit-in-sorlcloud/

Best,
Erick

On Thu, Nov 9, 2017 at 9:25 PM, Sujay Bawaskar <sujaybawaskar@gmail.com> wrote:
> Hi,
>
> We are getting below log without invoking commit operation after every
> partial update call. We have configured soft commit and commit time as
> below. With below configuration we are able to perform 800 partial updates
> per minutes which I think is very slow. Our Index size is 10GB for this
> particular core.
> Is there any configuration we are missing here?
>
> Log:
> 2017-11-10 05:13:33.730 INFO  (qtp225493257-38746) [   x:collection]
> o.a.s.s.SolrIndexSearcher Opening  [Searcher@7010b1c6[collection] realtime]
>
> Commit configuration:
> solr.autoCommit.maxTime:1800000
> solr.autoSoftCommit.maxTime:900000
>
>
>
> --
> Thanks,
> Sujay P Bawaskar
> M:+91-77091 53669

Mime
View raw message