Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 97E69200BD4 for ; Thu, 1 Dec 2016 17:22:47 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 9670F160B0B; Thu, 1 Dec 2016 16:22:47 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 6F346160B05 for ; Thu, 1 Dec 2016 17:22:46 +0100 (CET) Received: (qmail 30540 invoked by uid 500); 1 Dec 2016 16:22:45 -0000 Mailing-List: contact user-help@zookeeper.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@zookeeper.apache.org Delivered-To: mailing list user@zookeeper.apache.org Delivered-To: moderator for user@zookeeper.apache.org Received: (qmail 77561 invoked by uid 99); 1 Dec 2016 16:03:47 -0000 X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.008 X-Spam-Level: ** X-Spam-Status: No, score=2.008 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, T_REMOTE_IMAGE=0.01, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=welltokinc.onmicrosoft.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=welltokinc.onmicrosoft.com; s=selector1-welltok-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=TL3zLIj7WLG7DRf+HBhJZgFzPhvE0C4NMbFkROTP8Rg=; b=U1TcN2IJAATxATQsmacDvPyMXMUXjWvH2wOmVTp8KYu1bhzBLFBaPThLJMl4OLAT8mJ8JG3a76nEwf/2ZCg7sNZqfGjJzbF+bfMBlnRTVHO51NWt4zM7G6ewpkRF9xEvojnY4z36rqWTJRODESWKDhZ1dt9uxV8CZnVbcRH9ieA= From: Zac Harvey To: Martin Gainty , "user@zookeeper.apache.org" Subject: Re: Messages intermittently get lost Thread-Topic: Messages intermittently get lost Thread-Index: AQHSRXEmY6tbdKTtLU+LnDnCOq/3oKDoCySigAAaPEqAAWnBmoAAfCi0gARrJJSAAa3/m4AABuyugAGFhG+AADIStoAAWLUAgAAUq/KAAP1How== Date: Thu, 1 Dec 2016 16:03:13 +0000 Message-ID: References: ,<8B72C63F-CF46-40DF-BCA8-77038A200122@apache.org>, In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=zac.harvey@welltok.com; x-originating-ip: [132.245.39.245] x-microsoft-exchange-diagnostics: 1;SN1PR12MB0656;7:7a9aDZ9gxiaaHlh7d7Dl6UwV6pKqdZtVDwJIjK2dxdcW55H5+/dSAsL1WrVtIId8tetgIbLNLKtCqPKkEtpj3k2kQx+hH2IK+SBkzPPVSHubbNzcPj1FvD3O1PaH1KdgRke8d/z/9xgX56I2yqQCKqO2GzmRp3O0bY1gX0rIQSLPtmFswr8qSC5byyDtXYfOr/5NnzvdsGrkmkWVyyUXC79w3Ml1XjjQF62AA06FF0biG2JYsX2nu3vLu6qzo/bD2i2xlyD60WGaAU6eswUS7eiG4cr04ySs0Sz0wj25dbuA1tpizR2LmyItcWe1IU72LIbAAIBrJGPLHi42cXs2ru/X4y/8NNBYqKMAla0Mv2Y= x-ms-office365-filtering-correlation-id: 08d43356-4e25-48e4-9203-08d41a038ddc x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:(22001);SRVR:SN1PR12MB0656; x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(158342451672863)(55632472524450)(200054503718035)(5943731945212)(194151415913766)(155736691171859)(104084551191319)(21532816269658); x-exchange-antispam-report-cfa-test: BCL:0;PCL:0;RULEID:(6040375)(601004)(2401047)(5005006)(8121501046)(10201501046)(3002001)(2003001)(6041248)(20161123562025)(20161123558021)(2016111802025)(20161123555025)(20161123560025)(20161123564025)(6072148)(6043046);SRVR:SN1PR12MB0656;BCL:0;PCL:0;RULEID:;SRVR:SN1PR12MB0656; x-forefront-prvs: 014304E855 x-forefront-antispam-report: SFV:NSPM;SFS:(10019020)(7916002)(24454002)(199003)(377454003)(189002)(74316002)(8676002)(101416001)(54356999)(6116002)(3280700002)(3846002)(7696004)(2906002)(7846002)(1680700002)(2950100002)(7906003)(3660700001)(10710500007)(76576001)(33656002)(122556002)(16601075003)(15650500001)(50986999)(7736002)(92566002)(19627405001)(5660300001)(2420400007)(38730400001)(99286002)(3900700001)(105586002)(106356001)(2900100001)(229853002)(2501003)(76176999)(106116001)(102836003)(9686002)(8936002)(97736004)(68736007)(77096006)(12250200002)(93886004)(6506003)(86362001)(66066001)(606004)(19618635001)(39450400002)(39410400001)(3480700004)(15974865002)(7110500001)(107886002)(16297215004)(5001770100001)(39060400001)(189998001)(81166006)(81156014)(7099028)(50919006);DIR:OUT;SFP:1102;SCL:1;SRVR:SN1PR12MB0656;H:SN1PR12MB0654.namprd12.prod.outlook.com;FPR:;SPF:None;PTR:InfoNoRecords;A:1;MX:1;LANG:en; received-spf: None (protection.outlook.com: welltok.com does not designate permitted sender hosts) spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: multipart/alternative; boundary="_000_SN1PR12MB0654FDB7A7D5DF2997C61238908F0SN1PR12MB0654namp_" MIME-Version: 1.0 X-OriginatorOrg: welltok.com X-MS-Exchange-CrossTenant-originalarrivaltime: 01 Dec 2016 16:03:13.1067 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 578121a6-b279-46b4-8061-0647d7dd9ba0 X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN1PR12MB0656 archived-at: Thu, 01 Dec 2016 16:22:47 -0000 --_000_SN1PR12MB0654FDB7A7D5DF2997C61238908F0SN1PR12MB0654namp_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Thanks everyone The script can be found like so: wget http://apache.spinellicreations.com/zookeeper/zookeeper-3.4.6/zookeepe= r-3.4.6.tar.gz tar xfz zookeeper-3.4.6.tar.gz cd zookeeper-3.4.6/bin zkServer.sh Let me know if you have any other questions/concerns! Best, Zac ________________________________ From: Martin Gainty Sent: Wednesday, November 30, 2016 7:57:37 PM To: user@zookeeper.apache.org; Zac Harvey Subject: Re: Messages intermittently get lost absolutely..lets get this resolved asap Zac...can you send me the abending script? Molte Grazie Flavio! Martini ______________________________________________ ________________________________ From: Flavio Junqueira Sent: Wednesday, November 30, 2016 6:41 PM To: user@zookeeper.apache.org Cc: users@kafka.apache.org Subject: Re: Messages intermittently get lost Hey Martin, Do you want to create a jira for this and report the issue? -Flavio > On 30 Nov 2016, at 18:33, Martin Gainty wrote: > > a shock when a zk script goes fubar > > > zookeeper devs can we get some help for sh zkServer.sh status? > > > Thanks! > > Martin > ______________________________________________ > > > > ________________________________ > From: Zac Harvey > Sent: Wednesday, November 30, 2016 10:25 AM > To: users@kafka.apache.org > Subject: Re: Messages intermittently get lost > > Hi Martin, makes sense. > > > When I SSH into all 3 of my ZK nodes and run: > > > sh zkServer.sh status > > > All three of them give me the following output: > > > JMX enabled by default > > zkServer.sh: 81: /opt/zookeeper/bin/zkEnv.sh: Syntax error: "(" unexpecte= d (expecting "fi") > > > Looks like a bug in the ZK shell script? > > > Best, > > Zac > > ________________________________ > From: Martin Gainty > Sent: Tuesday, November 29, 2016 11:18:21 AM > To: users@kafka.apache.org > Subject: Re: Messages intermittently get lost > > Hi Zach > > > we dont know whats causing this intermittent problem..so lets Divide and = Conquer each part of this problem individually starting at the source of th= e data feeds > > > Let us eliminate any potential problem with feeds from external sources > > > Once you verify the zookeeper feeds are 100% reliable lets move onto Kafk= a > > > Pingback when you have verifiable results from zookeeper feeds > > > Thanks > > Martin > ______________________________________________ > > > > ________________________________ > From: Zac Harvey > Sent: Tuesday, November 29, 2016 10:46 AM > To: users@kafka.apache.org > Subject: Re: Messages intermittently get lost > > Does anybody have any idea why ZK might be to blame if messages sent by a= Kafka producer fail to be received by a Kafka consumer? > > ________________________________ > From: Zac Harvey > Sent: Monday, November 28, 2016 9:07:41 AM > To: users@kafka.apache.org > Subject: Re: Messages intermittently get lost > > Thanks Martin, I will look at those links. > > > But you seem to be 100% confident that the problem is with ZooKeeper...ca= n I ask why? What is it about my problem description that makes you think t= his is an issue with ZooKeeper? > > ________________________________ > From: Martin Gainty > Sent: Friday, November 25, 2016 1:46:28 PM > To: users@kafka.apache.org > Subject: Re: Messages intermittently get lost > > > > ________________________________ > From: Zac Harvey > Sent: Friday, November 25, 2016 6:17 AM > To: users@kafka.apache.org > Subject: Re: Messages intermittently get lost > > Hi Martin, > > > My server.properties looks like this: > > > listeners=3DPLAINTEXT://0.0.0.0:9092 > > advertised.host.name=3D > > broker.id=3D2 > > port=3D9092 > > num.partitions=3D4 > > zookeeper.connect=3DzkA:2181,zkB:2181,zkC:2181 > > MG>can you check status for each ZK Node in the quorum? > > sh>$ZOOKEEPER_HOME/bin/zkServer.sh status > > http://www.ibm.com/support/knowledgecenter/SSCRJU_4.0.0/com.ibm.streams.p= d.doc/doc/containerstreamszookeeper.html ZooKeeper problems and solutions - IBM www.ibm.com Use these solutions to resolve the problems that you might encounter with A= pache ZooKeeper. > ZooKeeper problems and solutions - IBM ZooKeeper problems and solutions - IBM www.ibm.com Use these solutions to resolve the problems that you might encounter with A= pache ZooKeeper. > www.ibm.com [http://upload.wikimedia.org/wikipedia/commons/thumb/5/51/IBM_logo.svg/200p= x-IBM_logo.svg.png] IBM - United States www.ibm.com For more than a century IBM has been dedicated to every client's success an= d to creating innovations that matter for the world > Use these solutions to resolve the problems that you might encounter with= Apache ZooKeeper. > > > > ZooKeeper problems and solutions - IBM ZooKeeper problems and solutions - IBM www.ibm.com Use these solutions to resolve the problems that you might encounter with A= pache ZooKeeper. > ZooKeeper problems and solutions - IBM ZooKeeper problems and solutions - IBM www.ibm.com Use these solutions to resolve the problems that you might encounter with A= pache ZooKeeper. > www.ibm.com [http://upload.wikimedia.org/wikipedia/commons/thumb/5/51/IBM_logo.svg/200p= x-IBM_logo.svg.png] IBM - United States www.ibm.com For more than a century IBM has been dedicated to every client's success an= d to creating innovations that matter for the world > Use these solutions to resolve the problems that you might encounter with= Apache ZooKeeper. > > > > www.ibm.com [http://upload.wikimedia.org/wikipedia/commons/thumb/5/51/IBM_logo.svg/200p= x-IBM_logo.svg.png] IBM - United States www.ibm.com For more than a century IBM has been dedicated to every client's success an= d to creating innovations that matter for the world > [http://upload.wikimedia.org/wikipedia/commons/thumb/5/51/IBM_logo.svg/20= 0px-IBM_logo.svg.png] > > IBM - United States > www.ibm.com > For more than a century IBM has been dedicated to every client's success = and to creating innovations that matter for the world > > > > Use these solutions to resolve the problems that you might encounter with= Apache ZooKeeper. > > > > > ZooKeeper problems and solutions - IBM > ZooKeeper problems and solutions - IBM > www.ibm.com > Use these solutions to resolve the problems that you might encounter with= Apache ZooKeeper. > > > > ZooKeeper problems and solutions - IBM > ZooKeeper problems and solutions - IBM > www.ibm.com > Use these solutions to resolve the problems that you might encounter with= Apache ZooKeeper. > > > > www.ibm.com > [http://upload.wikimedia.org/wikipedia/commons/thumb/5/51/IBM_logo.svg/20= 0px-IBM_logo.svg.png] > > IBM - United States > www.ibm.com > For more than a century IBM has been dedicated to every client's success = and to creating innovations that matter for the world > > > > Use these solutions to resolve the problems that you might encounter with= Apache ZooKeeper. > > > > www.ibm.com > [http://upload.wikimedia.org/wikipedia/commons/thumb/5/51/IBM_logo.svg/20= 0px-IBM_logo.svg.png] > > IBM - United States > www.ibm.com > For more than a century IBM has been dedicated to every client's success = and to creating innovations that matter for the world > > > > [http://upload.wikimedia.org/wikipedia/commons/thumb/5/51/IBM_logo.svg/20= 0px-IBM_logo.svg.png] > > IBM - United States > [http://upload.wikimedia.org/wikipedia/commons/thumb/5/51/IBM_logo.svg/20= 0px-IBM_logo.svg.png] > > IBM - United States > www.ibm.com > For more than a century IBM has been dedicated to every client's success = and to creating innovations that matter for the world > > > > www.ibm.com > [http://upload.wikimedia.org/wikipedia/commons/thumb/5/51/IBM_logo.svg/20= 0px-IBM_logo.svg.png] > > IBM - United States > www.ibm.com > For more than a century IBM has been dedicated to every client's success = and to creating innovations that matter for the world > > > > For more than a century IBM has been dedicated to every client's success = and to creating innovations that matter for the world > > > > Use these solutions to resolve the problems that you might encounter with= Apache ZooKeeper. > > > > MG>*greetings from Plimoth Mass* > > MG>M > > > num.network.threads=3D3 > > num.io.threads=3D8 > > socket.send.buffer.bytes=3D102400 > > socket.receive.buffer.bytes=3D102400 > > log.dirs=3D/tmp/kafka-logs > > num.recovery.threads.per.data.dir=3D1 > > log.retention.hours=3D168 > > log.segment.bytes=3D1073741824 > > log.retention.check.interval.ms=3D300000 > > zookeeper.connection.timeout.ms=3D6000 > > delete.topic.enable=3Dtrue > > auto.leader.rebalance.enable=3Dtrue > > > Above, 'zkA', 'zkB' and 'zkC' are defined in /etc/hosts and are valid ZK = servers, and is the public DNS of the EC2 (AWS) node th= at this Kafka is running on. > > > Anything look incorrect to you? > > > And yes, yesterday was a holiday, but there is only work! I'll celebrate = one big, long holiday when I'm dead! > > > Thanks for any-and-all input here! > > > Best, > > Zac > > > ________________________________ > From: Martin Gainty > Sent: Thursday, November 24, 2016 9:03:33 AM > To: users@kafka.apache.org > Subject: Re: Messages intermittently get lost > > Hi Zach > > > there is a rumour that today thursday is a holiday? > > in server.properties how are you configuring your server? > > > specifically what are these attributes? > > > num.network.threads=3D > > > num.io.threads=3D > > > socket.send.buffer.bytes=3D > > > socket.receive.buffer.bytes=3D > > > socket.request.max.bytes=3D > > > num.partitions=3D > > > num.recovery.threads.per.data.dir=3D > > > ? > > Martin > ______________________________________________ > > > > ________________________________ > From: Zac Harvey > Sent: Thursday, November 24, 2016 7:05 AM > To: users@kafka.apache.org > Subject: Re: Messages intermittently get lost > > Anybody?!? This is very disconcerting! > > ________________________________ > From: Zac Harvey > Sent: Wednesday, November 23, 2016 5:07:45 AM > To: users@kafka.apache.org > Subject: Messages intermittently get lost > > I am playing around with Kafka and have a simple setup: > > > * 1-node Kafka (Ubuntu) server > > * 3-node ZK cluster (each on their own Ubuntu server) > > > I have a consumer written in Scala and am using the kafka-console-produce= r (v0.10) that ships with the distribution. > > > I'd say about 20% of the messages I send via the producer never get consu= med by the Scala process (which is running continuously). No errors on eith= er side (producer or consumer): the producer sends, and, nothing... > > > Any ideas as to what might be going on here, or how I could start trouble= shooting? > > > Thanks! --_000_SN1PR12MB0654FDB7A7D5DF2997C61238908F0SN1PR12MB0654namp_--