From user-return-11597-archive-asf-public=cust-asf.ponee.io@zookeeper.apache.org Wed Aug 1 21:07:35 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id BD1EC180634 for ; Wed, 1 Aug 2018 21:07:34 +0200 (CEST) Received: (qmail 66502 invoked by uid 500); 1 Aug 2018 19:07:33 -0000 Mailing-List: contact user-help@zookeeper.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@zookeeper.apache.org Delivered-To: mailing list user@zookeeper.apache.org Received: (qmail 66491 invoked by uid 99); 1 Aug 2018 19:07:33 -0000 Received: from mail-relay.apache.org (HELO mailrelay1-lw-us.apache.org) (207.244.88.152) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Aug 2018 19:07:33 +0000 Received: from mail-wm0-f45.google.com (mail-wm0-f45.google.com [74.125.82.45]) by mailrelay1-lw-us.apache.org (ASF Mail Server at mailrelay1-lw-us.apache.org) with ESMTPSA id 673EA13E1 for ; Wed, 1 Aug 2018 19:07:32 +0000 (UTC) Received: by mail-wm0-f45.google.com with SMTP id l2-v6so344485wme.1 for ; Wed, 01 Aug 2018 12:07:32 -0700 (PDT) X-Gm-Message-State: AOUpUlGR5DmXrzO//skfVBD0PzuQJED8ZMQ6H25WkGMPub3HHSeLTr+D Sbiv9pUvvCja28Io0dBghVhAIU3aHVzRw2ilDVI= X-Google-Smtp-Source: AAOMgpfZ8+UuT03RsppkKnx0fUFHgwhadUURyTjILrtPqqR7aGCjEBGUkuv5xhvTuyRhsnh/Hj0WTIWzZpKMkrCI9rk= X-Received: by 2002:a1c:c95:: with SMTP id 143-v6mr101763wmm.50.1533150451321; Wed, 01 Aug 2018 12:07:31 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Patrick Hunt Date: Wed, 1 Aug 2018 12:06:55 -0700 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Verify zookeeper cluster consistency To: UserZooKeeper Content-Type: multipart/alternative; boundary="00000000000009d32d0572646821" --00000000000009d32d0572646821 Content-Type: text/plain; charset="UTF-8" iirc Ben (or was it someone else from Facebook) mentioned at a meetup about doing some work in this area. I believe they were hashing the tree but I may be mis-remembering.... Perhaps one of those folks can shed light. Patrick On Fri, Jul 27, 2018 at 2:04 AM Andor Molnar wrote: > Hi Klearchos, > > Some tool which is constantly querying the znode tree on each of every > participant and tolerates some latency between the inconsistencies, but > reports everything above the threshold could do the trick. > > Personally I'm not aware of anything existing, but feel free to dig github > or create your own one. > > Regards, > Andor > > > > > On Fri, Jul 27, 2018 at 9:16 AM, Chaloulos, Klearchos (Nokia - GR/Athens) < > klearchos.chaloulos@nokia.com> wrote: > > > Hello, > > > > I recently ran into a case where my zookeeper servers had inconsistent > > data, that is nodes that existed in one server did not exist in the other > > two. I used 3 servers, with version 3.4.9. Unfortunately I cannot > reproduce > > the issue, as it occurred a long time ago in an environment outside my > > control. > > > > However my question is: Is there a way to detect zookeeper cluster > > inconsistencies? I am not talking about transient inconsistencies that > > exist for, say, a few seconds, but for permanent inconsistencies. In my > > case the inconsistencies persisted for a month! > > > > Best regards, > > > > Klearchos > > > > > --00000000000009d32d0572646821--