Mailing-List: contact user-help@zookeeper.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@zookeeper.apache.org
MIME-Version: 1.0
From: Anand Parthasarathy <anpartha@avinetworks.com>
Date: Wed, 4 Oct 2017 11:17:37 -0700
Message-ID: <CAM+wfv60bq7VLktoPt2LcqXJp0fek0oHEXq7kYvYe=irEzLcnw@mail.gmail.com>
Subject: Zookeeper quorum goes down for no apparent reason in 3.4.5
To: UserZooKeeper <user@zookeeper.apache.org>
Content-Type: multipart/mixed; boundary="089e0826d8f0661307055abc9fd3"
archived-at: Wed, 04 Oct 2017 18:17:52 -0000

--089e0826d8f0661307055abc9fd3
Content-Type: multipart/alternative; boundary="089e0826d8f0661304055abc9fd1"

--089e0826d8f0661304055abc9fd1
Content-Type: text/plain; charset="UTF-8"

Hi,

We have an issue with a 3-node zookeeper ensemble where the quorum goes
down due to no apparent reason every once in a while. Here is what I see in
the ZK leader:

2017-09-21 03:00:03,648 [myid:3] - INFO  [QuorumPeer[myid=3]/127.0.0.1:5002
:Leader@493] - Shutting down
2017-09-21 03:00:03,648 [myid:3] - INFO  [QuorumPeer[myid=3]/127.0.0.1:5002
:Leader@499] - Shutdown called
java.lang.Exception: shutdown Leader! reason: Not sufficient followers
synced, only synced with sids: [ 3 ]
    at org.apache.zookeeper.server.quorum.Leader.shutdown(Leader.java:499)
    at org.apache.zookeeper.server.quorum.Leader.lead(Leader.java:474)
    at
org.apache.zookeeper.server.quorum.QuorumPeer.run(QuorumPeer.java:799)

I have attached the logs from the 3 nodes around this time. Could you pls.
help understand what the issue could be here. The only thing I see a little
bit ahead of this timestamp is that all of them did a PurgeTask pretty much
at the same time.

Thanks,
Anand.

--089e0826d8f0661304055abc9fd1
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi,<div><br></div><div>We have an issue with a 3-node zook=
eeper ensemble where the quorum goes down due to no apparent reason every o=
nce in a while. Here is what I see in the ZK leader:</div><div><br></div><d=
iv><div>2017-09-21 03:00:03,648 [myid:3] - INFO=C2=A0 [QuorumPeer[myid=3D3]=
/127.0.0.1:5002:Leader@493] - Shutting down</div><div>2017-09-21 03:00:03,6=
48 [myid:3] - INFO=C2=A0 [QuorumPeer[myid=3D3]/127.0.0.1:5002:Leader@499] -=
 Shutdown called</div><div>java.lang.Exception: shutdown Leader! reason: No=
t sufficient followers synced, only synced with sids: [ 3 ]</div><div>=C2=
=A0 =C2=A0 at org.apache.zookeeper.server.quorum.Leader.shutdown(Leader.jav=
a:499)</div><div>=C2=A0 =C2=A0 at org.apache.zookeeper.server.quorum.Leader=
.lead(Leader.java:474)</div><div>=C2=A0 =C2=A0 at org.apache.zookeeper.serv=
er.quorum.QuorumPeer.run(QuorumPeer.java:799)</div></div><div><br></div><di=
v>I have attached the logs from the 3 nodes around this time. Could you pls=
. help understand what the issue could be here. The only thing I see a litt=
le bit ahead of this timestamp is that all of them did a PurgeTask pretty m=
uch at the same time.=C2=A0</div><div><br></div><div>Thanks,</div><div>Anan=
d.</div></div>

--089e0826d8f0661304055abc9fd1--

--089e0826d8f0661307055abc9fd3--