From user-return-12033-archive-asf-public=cust-asf.ponee.io@zookeeper.apache.org Fri Aug 2 16:40:57 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id 2FFC9180647 for ; Fri, 2 Aug 2019 18:40:57 +0200 (CEST) Received: (qmail 80494 invoked by uid 500); 2 Aug 2019 16:40:54 -0000 Mailing-List: contact user-help@zookeeper.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@zookeeper.apache.org Delivered-To: mailing list user@zookeeper.apache.org Received: (qmail 80483 invoked by uid 99); 2 Aug 2019 16:40:54 -0000 Received: from Unknown (HELO mailrelay1-lw-us.apache.org) (10.10.3.159) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 02 Aug 2019 16:40:54 +0000 Received: from mail-wr1-f41.google.com (mail-wr1-f41.google.com [209.85.221.41]) by mailrelay1-lw-us.apache.org (ASF Mail Server at mailrelay1-lw-us.apache.org) with ESMTPSA id 7704883DD for ; Fri, 2 Aug 2019 16:40:54 +0000 (UTC) Received: by mail-wr1-f41.google.com with SMTP id c2so74609364wrm.8 for ; Fri, 02 Aug 2019 09:40:54 -0700 (PDT) X-Gm-Message-State: APjAAAXCnt9vyg10pO0BEl+XrrT3Qk8hV7WfQWWI3UtT22J2web050oo SrTa9eQEtq9XiyCeYsf7+rpXqdBrxFiV2455ATw= X-Google-Smtp-Source: APXvYqys56A1DrbfbeZmd8nMlPbXQ9dq78aB20fFdP3C4ygSrTtKFerVuxTyogM14p4yW7zoH14SXp9vjhLq8jE3NAo= X-Received: by 2002:adf:f6d2:: with SMTP id y18mr71433178wrp.102.1564764053502; Fri, 02 Aug 2019 09:40:53 -0700 (PDT) MIME-Version: 1.0 References: <54f60c56-62ad-a6b0-1e56-17b07d5ee315@gmail.com> In-Reply-To: <54f60c56-62ad-a6b0-1e56-17b07d5ee315@gmail.com> From: Patrick Hunt Date: Fri, 2 Aug 2019 09:40:17 -0700 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Ephemeral nodes not removed To: UserZooKeeper , john.lindwall@gmail.com Content-Type: multipart/alternative; boundary="000000000000911ec9058f250548" --000000000000911ec9058f250548 Content-Type: text/plain; charset="UTF-8" The jira you ref'd is the only one that comes to mind. In terms of troubleshooting - try connecting a client to each of the servers in tern and see if it's a situation where they have a different view of the world wrt those znodes. You might also have the client create separate znodes on each server and ensure that they are consistent. The logs are also typically a good source of information - check against the session id. Patrick On Wed, Jul 31, 2019 at 11:29 PM John Lindwall wrote: > ZooKeeper 3.4.6-1569965 > > In our environment we seem to have a situation where ephemeral znodes > are not getting removed after the zookeeper session has been > terminated. We can see examples of znodes that were created 3-4 days > past that still exist, though the zk sessions bound to those znodes > should no longer exist. > > Note that we've had this cluster running to about 4 years and have not > seen this problem until recently. > > 1. I am wondering if there are any known issues that would affect our > zookeeper version that may cause this behavior? > 2. Is it possible our servers are simply in a "bad state" and a simple > reboot might clean things up? > 3. Any tips on diagnosing this? > > We noticed this issue from 2011 but that seems to have been fixed in our > branch. > > > https://issues.apache.org/jira/browse/ZOOKEEPER-1208 > > I also see this issue which it seems was never resolved? > > https://issues.apache.org/jira/browse/ZOOKEEPER-3018 > > Thanks, > John Lindwall > > --000000000000911ec9058f250548--