Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 80C96200D4C for ; Thu, 30 Nov 2017 10:28:05 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 7F207160BF4; Thu, 30 Nov 2017 09:28:05 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id C535B160BEA for ; Thu, 30 Nov 2017 10:28:04 +0100 (CET) Received: (qmail 8808 invoked by uid 500); 30 Nov 2017 09:28:03 -0000 Mailing-List: contact dev-help@zookeeper.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@zookeeper.apache.org Delivered-To: mailing list dev@zookeeper.apache.org Received: (qmail 8797 invoked by uid 99); 30 Nov 2017 09:28:03 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 30 Nov 2017 09:28:03 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 0EB3118089A for ; Thu, 30 Nov 2017 09:28:03 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -99.202 X-Spam-Level: X-Spam-Status: No, score=-99.202 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id pO3he22qbeds for ; Thu, 30 Nov 2017 09:28:01 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 3C2665F589 for ; Thu, 30 Nov 2017 09:28:01 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 6BB79E0E0B for ; Thu, 30 Nov 2017 09:28:00 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 1E04B2105A for ; Thu, 30 Nov 2017 09:28:00 +0000 (UTC) Date: Thu, 30 Nov 2017 09:28:00 +0000 (UTC) From: "Christopher Johnson (JIRA)" To: dev@zookeeper.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (ZOOKEEPER-2343) Zookeeper 3.5.1 failed to deploy into the kubernetes MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Thu, 30 Nov 2017 09:28:05 -0000 [ https://issues.apache.org/jira/browse/ZOOKEEPER-2343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16272428#comment-16272428 ] Christopher Johnson commented on ZOOKEEPER-2343: ------------------------------------------------ I have just tested this with 3.6.0-SNAPSHOT and I can confirm that it works. However, with 3 replicas, (on deployment in gcloud Kubernetes Engine), the first server pod to start will report "This ZooKeeper instance is not currently serving requests", but the second and third instance are able to create the quorum. When the first instance is deleted, on recreation it can join the quorum and subsequently serve requests. > Zookeeper 3.5.1 failed to deploy into the kubernetes > ---------------------------------------------------- > > Key: ZOOKEEPER-2343 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2343 > Project: ZooKeeper > Issue Type: Bug > Components: quorum > Affects Versions: 3.5.1 > Environment: CentOS Linux release 7.1.1503 (Core) > openjdk version "1.8.0_65" > OpenJDK Runtime Environment (build 1.8.0_65-b17) > OpenJDK 64-Bit Server VM (build 25.65-b01, mixed mode) > zookeeper: 3.5.1-alpha-1693007 > Reporter: cheyang > Fix For: 3.5.1 > > > I'd like to setup 3-nodes zookeeper cluster with version 3.5.1. Because the network model of kubernetes is that pod and service has different ip address. In order to deploy it into kubernetes, I have to make zookeeper pods itself to be 0.0.0.0, so it can be started correctly. the configuration as below: > zk1: zoo.cfg > standaloneEnabled=false > dynamicConfigFile=/opt/zookeeper/conf/zoo.cfg.dynamic > zoo.cfg.dynamic > server.1=0.0.0.0:2888:3888:participant;2181 > server.2=10.62.56.192:2888:3888:participant;2181 > server.3=10.62.56.193:2888:3888:participant;2181 > zk2: zoo.cfg > standaloneEnabled=false > dynamicConfigFile=/opt/zookeeper/conf/zoo.cfg.dynamic > zoo.cfg.dynamic > server.1=10.62.56.191:2888:3888:participant;2181 > server.2=0.0.0.0:2888:3888:participant;2181 > server.3=10.62.56.193:2888:3888:participant;2181 > zk3: zoo.cfg > standaloneEnabled=false > dynamicConfigFile=/opt/zookeeper/conf/zoo.cfg.dynamic > zoo.cfg.dynamic > server.1=10.62.56.191:2888:3888:participant;2181 > server.2=10.62.56.192:2888:3888:participant;2181 > server.3=0.0.0.0:2888:3888:participant;218 > The result is that: > 1. Looks like the election is successful. a new dynamic file is generated in every node:/opt/zookeeper/conf/zoo.cfg.dynamic.100000000 > like below > server.1=10.62.56.191:2888:3888:participant;0.0.0.0:2181 > server.2=0.0.0.0:2888:3888:participant;0.0.0.0:2181 > server.3=10.62.56.193:2888:3888:participant;0.0.0.0:2181 > 2. But the cluster doesn't really work, I saw the errors: > 0:0:2181)(secure=disabled):Learner@273] - Unexpected exception, tries=3, remaining init limit=16997, connecting to /0.0.0.0:2888 > java.net.ConnectException: Connection refused > at java.net.PlainSocketImpl.socketConnect(Native Method) > at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) > at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:204) > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) > at java.net.Socket.connect(Socket.java:589) > at org.apache.zookeeper.server.quorum.Learner.sockConnect(Learner.java:227) > at org.apache.zookeeper.server.quorum.Learner.connectToLeader(Learner.java:256) > at org.apache.zookeeper.server.quorum.Follower.followLeader(Follower.java:74) > at org.apache.zookeeper.server.quorum.QuorumPeer.run(QuorumPeer.java:1064) > 2015-12-15 04:35:00,403 [myid:1] - INFO > 2015-12-15 04:35:00,585 [myid:1] - INFO [QuorumPeer[myid=1](plain=/0:0:0:0:0:0:0:0:2181)(secure=disabled):Follower@198] - shutdown called > java.lang.Exception: shutdown Follower > at org.apache.zookeeper.server.quorum.Follower.shutdown(Follower.java:198) > at org.apache.zookeeper.server.quorum.QuorumPeer.run(QuorumPeer.java:1068) -- This message was sent by Atlassian JIRA (v6.4.14#64029)