Mailing-List: contact solr-dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: solr-dev@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of noble.paul@gmail.com
 designates 209.85.216.193 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:sender:reply-to:in-reply-to:references:from:date
         :x-google-sender-auth:message-id:subject:to:content-type
         :content-transfer-encoding;
        b=c8H0lzra9/HDOqq6jJKzCHc6G7kEEnKW9F6xEzA/mOlZjxHThbuo6i1k55t5vSwtGK
         RdI+FAsy3+tH6iboUF1H/03e/c8g+UckTp/GEW00Hu5Gwjrri/qUr7UEoymxdge2wZye
         WmG4DTColkyIBYIqC/ixIe1J9UZ/XD8sMgEcc=
MIME-Version: 1.0
Sender: noble.paul@gmail.com
Reply-To: noble.paul@gmail.com
In-Reply-To: <85d3c3b60907221428s4cb62d5i31c5e7ede186ab8a@mail.gmail.com>
References: <85d3c3b60907221428s4cb62d5i31c5e7ede186ab8a@mail.gmail.com>
From: 
 =?UTF-8?B?Tm9ibGUgUGF1bCDgtKjgtYvgtKzgtL/gtLPgtY3igI0gIOCkqOCli+CkrOCljeCks+CljQ==?=
 <noble.paul@corp.aol.com>
Date: Thu, 23 Jul 2009 10:48:24 +0530
Message-ID: <5e76b0ad0907222218q5cfb5997lc7c05d9da4002f4@mail.gmail.com>
Subject: Re: Add replication push support?
To: solr-dev@lucene.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit

There is an issue already created for realtime replication
https://issues.apache.org/jira/browse/SOLR-982

In general push based replication is more error prone because the
master has to be aware of the state of each slave . it is difficault
because a slave may go down at any time and may come up later or new
slaves get added randomly. In a pull based replication the master is
agnostic of the slaves and a slave can easily know his current state
and take appropriate action.

We can take a middle path. The slaves can register with the master for
notifications for availability of new snapshots. This can be as good
as a push based replication without the complexities associated with
it.
I have raised as issue already https://issues.apache.org/jira/browse/SOLR-1305

On Thu, Jul 23, 2009 at 2:58 AM, Jason
Rutherglen<jason.rutherglen@gmail.com> wrote:
> It would be useful to push snapshots as they are created from
> the master to the slaves. I prefer this approach to constant
> polling by slaves. Partially because the timing could be off on
> the slave servers, the data is replicated, and the user sees
> different snapshots?
>
> Something like a virtual 2 phase commit, where phase 1 is
> replicate the new snapshots and load the searcher, phase two is
> all slaves synchronously expose the new searcher. I'm also
> wondering how we'll handle synchronous slaves with near realtime
> search.
>


-- 
-----------------------------------------------------
Noble Paul | Principal Engineer| AOL | http://aol.com