lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Damien Kamerman (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SOLR-7280) Load cores in sorted order and tweak coreLoadThread counts to improve cluster stability on restarts
Date Tue, 29 Nov 2016 05:57:58 GMT

    [ https://issues.apache.org/jira/browse/SOLR-7280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15704322#comment-15704322
] 

Damien Kamerman commented on SOLR-7280:
---------------------------------------

I've just been testing this and found a couple of issues:

All the core registrations are done in background threads. This can flood the overseer queue.
See CoreContainer.load() calls zkSys.registerInZk(core, true, false);

I've increased leaderConflictResolveWait to 30min but every 15s I can see:
org.apache.solr.handler.admin.PrepRecoveryOp; After 15 seconds, core ip_1224_shard1_replica1
(shard1 of ip_1224) still does not have state: recovering; forcing ClusterState update from
ZooKeeper
Again, I think this can flood the overseer queue.

> Load cores in sorted order and tweak coreLoadThread counts to improve cluster stability
on restarts
> ---------------------------------------------------------------------------------------------------
>
>                 Key: SOLR-7280
>                 URL: https://issues.apache.org/jira/browse/SOLR-7280
>             Project: Solr
>          Issue Type: Bug
>          Components: SolrCloud
>            Reporter: Shalin Shekhar Mangar
>            Assignee: Noble Paul
>             Fix For: 5.5.3, 6.2
>
>         Attachments: SOLR-7280-5x.patch, SOLR-7280-5x.patch, SOLR-7280-5x.patch, SOLR-7280-test.patch,
SOLR-7280.patch, SOLR-7280.patch
>
>
> In SOLR-7191, Damien mentioned that by loading solr cores in a sorted order and tweaking
some of the coreLoadThread counts, he was able to improve the stability of a cluster with
thousands of collections. We should explore some of these changes and fold them into Solr.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message