lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Erick Erickson <erickerick...@gmail.com>
Subject Re: SolrCloud indexing
Date Wed, 06 May 2015 01:07:59 GMT
bq: Does it mean that all the indexing is done by the leaders in one node?

no. The raw document is forwarded from the leader to the replica and
it's indexed on all the nodes. The leader has a little bit of extra
work to do routing the docs, but that's it. Shouldn't be a problem
with 3 shards.

bq: If so, how do I distribute the indexing (the shard leaders) across nodes?

You don't really need to bother I don't think, especially if you don't
see significantly higher CPU utilization on the leader. If you
absolutely MUST distribute leadership, see the Collections API and the
REBALANCELEADERS and BALANCESHARDUNIQUE (Solr 5.1 only) but frankly I
wouldn't worry about it unless and until you had demonstrated need.

Best,
Erick

On Tue, May 5, 2015 at 6:28 AM, Vincenzo D'Amore <v.damore@gmail.com> wrote:
> Hi all,
>
> I have 3 nodes and there are 3 shards but looking at solrcloud admin I see
> that all the leaders are on the same node.
>
> If I understood well looking at  solr documentation
> <https://cwiki.apache.org/confluence/display/solr/Shards+and+Indexing+Data+in+SolrCloud>
> :
>
>> When a document is sent to a machine for indexing, the system first
>> determines if the machine is a replica or a leader.
>> If the machine is a replica, the document is forwarded to the leader for
>> processing.
>> If the machine is a leader, SolrCloud determines which shard the document
>> should go to, forwards the document the leader for that shard, indexes the
>> document for this shard, and forwards the index notation to itself and any
>> replicas.
>
>
> So I have 3 nodes, with 3 shards and 2 replicas of each shard.
>
> http://picpaste.com/pics/Screen_Shot_2015-05-05_at_15.19.54-Xp8uztpt.1430832218.png
>
> Does it mean that all the indexing is done by the leaders in one node? If
> so, how do I distribute the indexing (the shard leaders) across nodes?
>
>
> --
> Vincenzo D'Amore
> email: v.damore@gmail.com
> skype: free.dev
> mobile: +39 349 8513251

Mime
View raw message