Mailing-List: contact user-help@zookeeper.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@zookeeper.apache.org
Received-SPF: neutral (athena.apache.org: local policy)
Date: Tue, 24 Jul 2012 06:08:48 -0700 (PDT)
From: Jack Luo <jluo@rim.com>
To: zookeeper-user@hadoop.apache.org
Message-ID: <1343135328614-7577729.post@n2.nabble.com>
Subject: Data change notification is lost during failover
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Hi All,

I am using Zookeeper3.3.5 for a distributed project. During the test, a
watch related issue is found. Our monitor program places 100 watches on 100
different paths (e.g. /goo1 =E2=80=A6. /goo100) for monitoring the data cha=
nge, and
another writer program updates one of paths at a specified interval. We
found sometimes some data change notification messages are lost when the
monitor program is switched to a new server due to the failure of current
server.=20

I check the =E2=80=9Cwatch management=E2=80=9D section in current release n=
otes
http://zookeeper.apache.org/doc/trunk/releasenotes.html and find a statemen=
t
=E2=80=9CIn this release the client library tracks watches that a client ha=
s
registered and reregisters the watches when a connection is made to a new
server.=E2=80=9D So based on the information, look like during server failo=
ver it is
expected behavior to lose data change notifications before watches are
successfully re-registered in a new server.

The solution that I figure out to this issue is to query all 100 paths to
check if there is any data change after the monitor program is connected to
a new server.

However if we need to monitor 1000 or 10K paths, this solution may not be
good. Can anyone suggest a better solution to this issue?

Furthermore, can ZK service is enhanced to replicate the watches on each ZK
server to solve this issue forever?

Thanks for your time and help!

Jack


--
View this message in context: http://zookeeper-user.578899.n2.nabble.com/Da=
ta-change-notification-is-lost-during-failover-tp7577729.html
Sent from the zookeeper-user mailing list archive at Nabble.com.