lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yonik Seeley (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SOLR-3088) create shard placeholders
Date Wed, 08 Feb 2012 14:31:59 GMT

    [ https://issues.apache.org/jira/browse/SOLR-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203641#comment-13203641
] 

Yonik Seeley commented on SOLR-3088:
------------------------------------

I think the only change I'm suggesting is that when a new collection is created via bootstrapping
and the -DnumShards=3 parameter is passed,
that empty placeholders for shard2 and shard3 be created:

{code}
{"collection1":{"shard1":{
      "Rogue:8983_solr_":{
        "shard_id":"shard1",
        "leader":"true",
        "state":"active",
        "core":"",
        "collection":"collection1",
        "node_name":"Rogue:8983_solr",
        "base_url":"http://Rogue:8983/solr"}},
  "shard2":{}
  "shard3":{}
}
{code}

This allows for appropriate errors to be thrown when shards that would normally be needed
are not "up".

All new nodes being brought up can now omit the -DnumShards parameter... and the overseer
assigns as it normally would.
We should shoot for being able to have pretty dumb nodes on startup that are only told to
join a cluster and nothing else... the cluster controls everything.

bq.  Do you mean that the new node would automatically discover from the placeholders how
many cores it needs to start?

No... by default it would still only be one core. Although we could have a parameter that
would start more than one core.

bq. What did you have in mind that should be stored under /collections?

There could be a placeholder for shard2, but if the only thing that uses it is leader election,
and it's always created on demand, then it shouldn't be necessary.

bq. In earlier versions I had overseer read the target number of slices from the collection
node (/collections/collection1 for example) but that was later removed in favor of the system
property.

Right - that still sounds correct as it will fit better with custom sharding and with shard
splitting (however that will work).

bq. What should be in charge of creating a new collection? Now you can do it for example through
CoreAdminHandler by simply adding a core into a collection that does not yet exist

We should eventually have some API to create a new collection without necessitating the creation
of new nodes.  Perhaps it's part of the core admin handler?  Perhaps Mark has thoughts on
this.
                
> create shard placeholders
> -------------------------
>
>                 Key: SOLR-3088
>                 URL: https://issues.apache.org/jira/browse/SOLR-3088
>             Project: Solr
>          Issue Type: New Feature
>          Components: SolrCloud
>            Reporter: Yonik Seeley
>             Fix For: 4.0
>
>
> When creating a new collection, a placeholder for each shard should be created.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message