Mailing-List: contact user-help@zookeeper.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@zookeeper.apache.org
MIME-Version: 1.0
In-Reply-To: <BANLkTinF6VGDx3z5NytfG25a8E9V9feqyA@mail.gmail.com>
References: <BANLkTi=-a-msvh_DDpT_ouVnvNXsmkZw8A@mail.gmail.com>
	<BANLkTi=Oi5O5oFoi8mV93CRD1RvaLTO+DQ@mail.gmail.com>
	<BANLkTi=msn1gwXOnaGA_b_YCRjLdJfvU7w@mail.gmail.com>
	<BANLkTikc6kut9VpHrWXgV-HT=4-aupCpAw@mail.gmail.com>
	<BANLkTinF6VGDx3z5NytfG25a8E9V9feqyA@mail.gmail.com>
Date: Wed, 4 May 2011 09:26:00 -0700
Message-ID: <BANLkTikR7E7JkB5xEPjfU6jm_m7Gji80Ww@mail.gmail.com>
Subject: Re: observers in occasionally disconnected data centers
From: Patrick Hunt <phunt@apache.org>
To: user@zookeeper.apache.org, ketan@indeed.com
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Hi Ketan, the patch is failing to apply
https://builds.apache.org/hudson/job/PreCommit-ZOOKEEPER-Build/246//console

Looks like you used git, I usually do something like:
git diff rev1..rev2 --no-prefix > ZOOKEEPER-784.patch
can you give it another try?

Patrick

On Tue, May 3, 2011 at 6:42 PM, Ketan Gangatirkar <ketan@indeed.com> wrote:
> I have updated Sergey's patch to:
>
> * apply to current trunk
> * incorporate one trivial output change he made to StatCommand in
> NettyServerCnxn.java
> * change log4j references to slf4j
>
> I have successfully run ant releaseaudit on the result. =A0The updated
> patch is now attached to the issue:
>
> https://issues.apache.org/jira/browse/ZOOKEEPER-784
>
> I do *not* make any claim to have understood the contents of this
> patch; all I did was synch everything and fix the obvious log4j/slf4j
> change. =A0Now what?
>
>
> On Tue, May 3, 2011 at 5:46 PM, Patrick Hunt <phunt@apache.org> wrote:
>> The core tests failed on last hudson, I just kicked off a patch build,
>> seems recent changes (logging?) have caused the patch to stop
>> applying:
>> https://hudson.apache.org/hudson/view/S-Z/view/ZooKeeper/job/PreCommit-Z=
OOKEEPER-Build/238/console
>>
>> Ketan would you like to try updating the patch and resubmit?
>>
>> Patrick
>>
>> On Tue, May 3, 2011 at 3:31 PM, Ketan Gangatirkar <ketan@indeed.com> wro=
te:
>>> Thanks, Mahadev. =A0I had seen ZOOKEEPER-892 but not ZOOKEEPER-784. =A0=
The
>>> latter may be what we need.
>>>
>>> I read the comments attached to that issue. =A0The most recent comment
>>> was a Hudson CI message indicating that the tests against the patch
>>> failed. =A0I was not able to find out more as it appears that the
>>> configuration of the Apache Hudson has changed. =A0It appears that the
>>> patch was approved but not merged into trunk, and it's now in limbo.
>>> What is necessary to get that feature into the next release? =A0I may b=
e
>>> able to assist, depending on what's involved. =A0Thank you.
>>>
>>>
>>> On Tue, May 3, 2011 at 4:17 PM, Mahadev Konar <mahadev@apache.org> wrot=
e:
>>>> Hi Ketan,
>>>> =A0You are correct that observers need connection to quorum as well.
>>>> There have been quite a few discussions on multi colo replication and
>>>> read only mode of ZooKeeper.
>>>>
>>>> Here are the jiras for those:
>>>>
>>>> https://issues.apache.org/jira/browse/ZOOKEEPER-784
>>>> and
>>>> https://issues.apache.org/jira/browse/ZOOKEEPER-892
>>>>
>>>> These have been mostly targeted at exactly a use case like yours.
>>>> Please take a look and them and feel free to contribute/comment on the
>>>> jiras.
>>>>
>>>> --
>>>> thanks
>>>> mahadev
>>>> @mahadevkonar
>>>>
>>>>
>>>>
>>>> On Tue, May 3, 2011 at 2:07 PM, Ketan Gangatirkar <ketan@indeed.com> w=
rote:
>>>>> Hi. =A0We're considering ZooKeeper for coordinating operations across
>>>>> multiple data centers. =A0These data centers will occasionally be
>>>>> disconnected. =A0We were planning on using observers in remote data
>>>>> centers. =A0Our applications can survive being unable to *write* to
>>>>> ZooKeeper, but they do need to be able to read from it, even if the
>>>>> data were stale.
>>>>>
>>>>> On further examination, it looks like observers must always be
>>>>> connected to the quorum to function at all. =A0Is this correct? =A0Do=
es
>>>>> anyone have suggestions for how to work around this problem? =A0The
>>>>> first thing that comes to mind is duplicating the required data in
>>>>> some other local data store and falling back on that when the DC
>>>>> becomes disconnected. =A0I imagine the disadvantages of that are obvi=
ous
>>>>> to everyone. =A0I hope someone can share some great idea that allows =
me
>>>>> to avoid that miserable fate. =A0Thanks.
>>>>>
>>>>> --
>>>>> Ketan Gangatirkar
>>>>> ketan@indeed.com
>>>>>
>>>>
>>>
>>>
>>>
>>> --
>>> Ketan Gangatirkar
>>> ketan@indeed.com
>>> Perishable Developer
>>>
>>
>
>
>
> --
> Ketan Gangatirkar
> ketan@indeed.com
> Perishable Developer
>