lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mark Miller (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SOLR-2358) Distributing Indexing
Date Fri, 07 Oct 2011 16:49:30 GMT

    [ https://issues.apache.org/jira/browse/SOLR-2358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13122953#comment-13122953
] 

Mark Miller commented on SOLR-2358:
-----------------------------------

Okay, I'm going to commit some really early stuff to the branch here...ugly code and lots
of system.out's still there...but we can start tying in versioning and what not...

Commit adds the distrib update processor and makes it cloud aware.

If you add a doc to a replica, it forwards it to the leader. If a doc comes to the leader,
it versions it (super mock/fake at the moment - param is set to docversion=yes) and forwards
it to each replica in the shard (including itself).

Also a couple basic tests added around this, and other little fixes that where found/needed
along the way...

The current main test for this fires up a control and 3 shards, each with 1 replia (6 cores
total). Indexing is then round robin'd to each shard (randomly adding either to the leader
or the replica). Then the standard distrib search tests are run (with load balancing across
replicas) and results compared with control.

Early, early, stuff - but it's a start. None of the hashing stuff we will be doing involved
yet.
                
> Distributing Indexing
> ---------------------
>
>                 Key: SOLR-2358
>                 URL: https://issues.apache.org/jira/browse/SOLR-2358
>             Project: Solr
>          Issue Type: New Feature
>          Components: SolrCloud, update
>            Reporter: William Mayor
>            Priority: Minor
>             Fix For: 4.0
>
>         Attachments: SOLR-2358.patch
>
>
> The first steps towards creating distributed indexing functionality in Solr

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message