From user-return-12912-archive-asf-public=cust-asf.ponee.io@zookeeper.apache.org Mon Jul 20 12:29:37 2020 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mailroute1-lw-us.apache.org (mailroute1-lw-us.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with ESMTPS id 74DF9180647 for ; Mon, 20 Jul 2020 14:29:37 +0200 (CEST) Received: from mail.apache.org (localhost [127.0.0.1]) by mailroute1-lw-us.apache.org (ASF Mail Server at mailroute1-lw-us.apache.org) with SMTP id BEB39125275 for ; Mon, 20 Jul 2020 12:29:13 +0000 (UTC) Received: (qmail 2563 invoked by uid 500); 20 Jul 2020 12:29:09 -0000 Mailing-List: contact user-help@zookeeper.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@zookeeper.apache.org Delivered-To: mailing list user@zookeeper.apache.org Received: (qmail 2539 invoked by uid 99); 20 Jul 2020 12:29:08 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Jul 2020 12:29:08 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 5CD4B1A318C for ; Mon, 20 Jul 2020 12:29:07 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.003 X-Spam-Level: X-Spam-Status: No, score=0.003 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.2, NUMERIC_HTTP_ADDR=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, WEIRD_PORT=0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-he-de.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id xy8NW3UyjHpE for ; Mon, 20 Jul 2020 12:29:05 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=2a00:1450:4864:20::642; helo=mail-ej1-x642.google.com; envelope-from=szalay.beko.mate@gmail.com; receiver= Received: from mail-ej1-x642.google.com (mail-ej1-x642.google.com [IPv6:2a00:1450:4864:20::642]) by mx1-he-de.apache.org (ASF Mail Server at mx1-he-de.apache.org) with ESMTPS id 427BE7F56A for ; Mon, 20 Jul 2020 12:29:05 +0000 (UTC) Received: by mail-ej1-x642.google.com with SMTP id w9so3694279ejc.8 for ; Mon, 20 Jul 2020 05:29:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=+furnm+3O/AbPxmMhw2fGekgp5ipojZuuf5MKuyfxYU=; b=UWxBmTIhEvWrKHDDHigAYcGrb2AmLUW6gREsi1eEsx982cin82evfIaJSdHYygWiSB MOWHbxgeMVR/oINeY+dmnDZY+xMlM1sVHK00No7yZsTW0C1f+eWRfrDonrdiQlKhxTqf EE7EKMhWXD6hSC9tupAn970JETQ88N7qQxbDS1dmzPHarXBPfTUU6yMB+kaCniFIrzrC C7VEorVzyceRMrbbW+uTKvY4hQHHRnLWVZnftTgBzxywSV5Ov0dlDnhm+R1GVXySUJKw truLFBIxnoXQYwQM+p2aMhRL4uegJiC/E4OVpCgwDwfSArRcfQ/6HYazxPz2GDWMxCKo 2+AQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=+furnm+3O/AbPxmMhw2fGekgp5ipojZuuf5MKuyfxYU=; b=MDkJJcvEkcCDRN2r/O+QNBdgUHVirQjhW1NoCXBleWM+kVkIMIGPf5BPGcG3jt965Y h7iLZDAnSgEQ9XjbID6GcmoCqPvmVRr+qzFf97LJo17nsYsb5sepIFNdMD4zZP7FktCh 2nGqJGdp+kBN13QSGGB78u9nNMpw5xl1bBf55xKsUagLjAdYgk0YvPA7GKggz4h9l/wA sRL85egFziA7oCbUe4/pOkEgXoYKPSkzmed9CeYyNHhGH/+S3n6jz9e12Dp+fkwoWZ0Y wdKkDWkBh6Admuj8h/zOiuWYOUh4kodN9A60FEJnm3TrpPbAoSNdpQvHHojfMXweOEz6 GHzQ== X-Gm-Message-State: AOAM533LV4PfWksFnjRczQMah9d/qU8M05bBhvWoWCYkakeU8PHFTZbj ndRT4rl7xzEsCrS7dkprhYcw0oIq/70Jhv/FJKaLWCGXsw== X-Google-Smtp-Source: ABdhPJwQch5rQ/jIRtM3JvJ40thDIo1IyKtinRAn5j//sk5GQccWDCl936rvNMZyz5hEu9TNo1qRx9kJU2WQEP68PZk= X-Received: by 2002:a17:906:a892:: with SMTP id ha18mr21016571ejb.462.1595248144421; Mon, 20 Jul 2020 05:29:04 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: =?UTF-8?B?U3phbGF5LUJla8WRIE3DoXTDqQ==?= Date: Mon, 20 Jul 2020 14:28:53 +0200 Message-ID: Subject: Re: Strange zoo.cfg.dynamic.next generated via zookeeper Docker image To: UserZooKeeper Content-Type: multipart/alternative; boundary="000000000000fa166605aadea637" --000000000000fa166605aadea637 Content-Type: text/plain; charset="UTF-8" Hello, Can you try to change your configs by not using 0.0.0.0 in the ZOO_SERVERS? Using 0.0.0.0 is not a recommended config since 3.5. If the java process can not bind (due to some virtual network issue) to the host provided in it's config, then you can use the quorumListenOnAllIPs parameter. So you should have the very same configuration for all nodes in your cluster, like: ZOO_CFG_EXTRA="quorumListenOnAllIPs=true" ZOO_SERVERS=server.1=x.x.x.1:2888:3888:participant;2181 \ server.2=x.x.x.2:2888:3888:participant;2181 \ server.3=x.x.x.3:2888:3888:participant;2181 This should have the effect that every server is binding on 0.0.0.0 locally, yet still having a consistent view of the server hostnames. BTW, unfortunately there is no such thing as "official zookeeper Docker image", at least it is not maintained by the Apache ZooKeeper community. (I don't know who is maintaining the image on dockerHub https://hub.docker.com/_/zookeeper - it would be nice to ask them to update their examples / documentation) Kind regards, Mate On Thu, Jul 16, 2020 at 9:27 AM Thilo-Alexander Ginkel wrote: > Hello again, > > just figured out that my rolling restart problems may be caused by > ZOOKEEPER-3829 (c.f. https://github.com/apache/zookeeper/pull/1356), > so I tried to set reconfigEnabled=true as a workaround, but that fails > as Zookeeper attempts to bind to x.x.x.1 instead of 0.0.0.0 (config > still lists 0.0.0.0 for the local node, respectively) during startup > in that case, so that's apparently not feasible in a Docker > environment: > > 2020-07-16 07:22:20,141 [myid:1] - ERROR > > [ListenerHandler-/x.x.x.1:3888:QuorumCnxManager$Listener$ListenerHandler@1093 > ] > - Exception while listening > java.net.BindException: Cannot assign requested address (Bind failed) > at java.base/java.net.PlainSocketImpl.socketBind(Native Method) > at java.base/java.net.AbstractPlainSocketImpl.bind(Unknown Source) > at java.base/java.net.ServerSocket.bind(Unknown Source) > at java.base/java.net.ServerSocket.bind(Unknown Source) > at > org.apache.zookeeper.server.quorum.QuorumCnxManager$Listener$ListenerHandler.createNewServerSocket(QuorumCnxManager.java:1134) > at > org.apache.zookeeper.server.quorum.QuorumCnxManager$Listener$ListenerHandler.acceptConnections(QuorumCnxManager.java:1064) > at > org.apache.zookeeper.server.quorum.QuorumCnxManager$Listener$ListenerHandler.run(QuorumCnxManager.java:1033) > at > java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown > Source) > at java.base/java.util.concurrent.FutureTask.run(Unknown Source) > at > java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown > Source) > at > java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown > Source) > at java.base/java.lang.Thread.run(Unknown Source) > 2020-07-16 07:22:21,143 [myid:1] - ERROR > > [ListenerHandler-/x.x.x.1:3888:QuorumCnxManager$Listener$ListenerHandler@1112 > ] > - Leaving listener thread for address 10.147.254.1:3888 after 3 > errors. Use zookeeper.electionPortBindRetry property to increase retry > count. > > Are there any plans to release 3.6.2 including the above fix? > > Regards, > Thilo > --000000000000fa166605aadea637--