From user-return-4964-apmail-zookeeper-user-archive=zookeeper.apache.org@zookeeper.apache.org Thu May 10 14:49:30 2012 Return-Path: X-Original-To: apmail-zookeeper-user-archive@www.apache.org Delivered-To: apmail-zookeeper-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 73EC79F33 for ; Thu, 10 May 2012 14:49:30 +0000 (UTC) Received: (qmail 68585 invoked by uid 500); 10 May 2012 14:49:29 -0000 Delivered-To: apmail-zookeeper-user-archive@zookeeper.apache.org Received: (qmail 68559 invoked by uid 500); 10 May 2012 14:49:29 -0000 Mailing-List: contact user-help@zookeeper.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@zookeeper.apache.org Delivered-To: mailing list user@zookeeper.apache.org Received: (qmail 68547 invoked by uid 99); 10 May 2012 14:49:29 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 10 May 2012 14:49:29 +0000 X-ASF-Spam-Status: No, hits=-5.0 required=5.0 tests=RCVD_IN_DNSWL_HI,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of Alexandar.Gvozdenovic@ubs.com designates 139.149.1.205 as permitted sender) Received: from [139.149.1.205] (HELO dmz-vsgate2.ldn.ibb.ubs.com) (139.149.1.205) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 10 May 2012 14:49:20 +0000 Received: from localhost (localhost [127.0.0.1]) by postfix.amavisd (Postfix) with ESMTP id 736BD8C47E for ; Thu, 10 May 2012 15:48:44 +0100 (BST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=ubs.com; h= x-virus-scanned:from:references:in-reply-to:message-id:date :subject:content-transfer-encoding:content-type:mime-version :content-class:received:received:received:received:received; s= srsa; t=1336661324; bh=3PkmesiArIv9F2YAZ9N3TeOTJgMmBw0BBpOc8fwct 0A=; b=F2zuJZzR2/BlM0GkV441pw437jLjgvO/1mHZgefaj1vG03sQFXMBrHkl3 W8z14cyl0tRUvNpEWg6vXM/JFHcKuotdwWclFdkgMmFMonDOPdACISxdSiQ7lbm2 6Gv3rORAPrDzI2jU+AYC2Tk0eueINI7w9ciQrObIbA0vSMBFb4= Received: from dmz-vsgate2.ldn.ibb.ubs.com ([127.0.0.1]) by localhost (sldn0848xmh.ldn.swissbank.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ndv511um1kZV for ; Thu, 10 May 2012 15:48:44 +0100 (BST) Received: by dmz-vsgate2.ldn.ibb.ubs.com (Postfix, from userid 103) id 3089A8C68F; Thu, 10 May 2012 15:48:44 +0100 (BST) Received: from sldn3028pmh.ldn.swissbank.com (unknown [139.149.96.13]) by dmz-vsgate2.ldn.ibb.ubs.com (Postfix) with ESMTP id D4E208C642 for ; Thu, 10 May 2012 15:48:43 +0100 (BST) Received: from nldn2382pap.ubsw.net (nldn2382pap.ldn.swissbank.com [139.149.219.135]) by sldn3028pmh.ldn.swissbank.com (Postfix) with ESMTP id C65694FB for ; Thu, 10 May 2012 15:48:43 +0100 (BST) Received: from NLDNC108PEX1.ubsw.net ([139.149.84.162]) by nldn2382pap.ubsw.net with Microsoft SMTPSVC(6.0.3790.4675); Thu, 10 May 2012 15:48:43 +0100 X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Subject: RE: Possible issue with cluster availability following new Leader Election - ZK 3.4 Date: Thu, 10 May 2012 15:48:39 +0100 Message-ID: <26D6F1977403764E8B5C4B26F9430E0A0FA2E73D@NLDNC108PEX1.ubsw.net> In-Reply-To: X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: Possible issue with cluster availability following new Leader Election - ZK 3.4 Thread-Index: Ac0utOutphdXA1s5TBK8hSBaHzeXEQABvBXg References: <26D6F1977403764E8B5C4B26F9430E0A0FA2E277@NLDNC108PEX1.ubsw.net><26D6F1977403764E8B5C4B26F9430E0A0FA2E5EE@NLDNC108PEX1.ubsw.net> From: To: X-OriginalArrivalTime: 10 May 2012 14:48:43.0833 (UTC) FILETIME=[FF2A3290:01CD2EBB] X-Virus-Scanned: clamav-milter 0.97.3 at sldn3028pmh.ldn.swissbank.com X-Virus-Status: Clean X-UBS-Disclaimer: Version $Revision: 1.33 (postfix edition)$ Cheers - Raised https://issues.apache.org/jira/browse/ZOOKEEPER-1465 =20 -----Original Message----- From: Camille Fournier [mailto:camille@apache.org]=20 Sent: 10 May 2012 14:58 To: user@zookeeper.apache.org Subject: Re: Possible issue with cluster availability following new = Leader Election - ZK 3.4 I will take a look at this soon, have you created a Jira for it? If not = please do so. Thanks, C On Thu, May 10, 2012 at 7:20 AM, wrote: > I think there may be a problem here with the 3.4 branch. I dropped the = > cluster back to 3.3.5 and the behaviour was much better. > > To summarize: > > 650mb of data > 20k nodes of varied size > 3 node cluster > > On 3.4.x (using latest branch build) > --------- > Takes 3-4 minutes to bring up a cluster from cold Takes 40-50 secs to=20 > recover from a leader failure Takes 10 secs for a new follower to join = > the cluster > > On 3.3.5 > -------- > Takes 10-20 secs to bring up a cluster from cold Takes 10 secs to=20 > recover from a leader failure Takes 10 secs for a new follower to join = > the cluster > > Any views on this from the ZK devs? The differences in behaviour only=20 > start becoming apparent as the dataset gets bigger. > I was hoping to use 3.4 for the transactional features it offered via=20 > the 'multi-update' operations, but this issue seems pretty serious... > > > > Visit our website at http://www.ubs.com > > This message contains confidential information and is intended only=20 > for the individual named. If you are not the named addressee you=20 > should not disseminate, distribute or copy this e-mail. Please notify=20 > the sender immediately by e-mail if you have received this e-mail by=20 > mistake and delete this e-mail from your system. > > E-mails are not encrypted and cannot be guaranteed to be secure or=20 > error-free as information could be intercepted, corrupted, lost,=20 > destroyed, arrive late or incomplete, or contain viruses. The sender=20 > therefore does not accept liability for any errors or omissions in the = > contents of this message which arise as a result of e-mail = transmission. > If verification is required please request a hard-copy version. This=20 > message is provided for informational purposes and should not be=20 > construed as a solicitation or offer to buy or sell any securities or=20 > related financial instruments. > > UBS Limited is a company limited by shares incorporated in the United=20 > Kingdom registered in England and Wales with number 2035362. > Registered office: 1 Finsbury Avenue, London EC2M 2PP. =A0UBS Limited = is=20 > authorised and regulated by the Financial Services Authority. > > UBS AG is a public company incorporated with limited liability in=20 > Switzerland domiciled in the Canton of Basel-City and the Canton of=20 > Zurich respectively registered at the Commercial Registry offices in=20 > those Cantons with Identification No: CH-270.3.004.646-4 and having=20 > respective head offices at Aeschenvorstadt 1, 4051 Basel and=20 > Bahnhofstrasse 45, 8001 Zurich, Switzerland. =A0Registered in the = United=20 > Kingdom as a foreign company with No: FC021146 and having a UK=20 > Establishment registered at Companies House, Cardiff, with No: > BR 004507. =A0The principal office of UK Establishment: 1 Finsbury=20 > Avenue, London EC2M 2PP. =A0In the United Kingdom, UBS AG is = authorised=20 > and regulated by the Financial Services Authority. > > UBS reserves the right to retain all messages. Messages are protected=20 > and accessed only in legally justified cases. Visit our website at http://www.ubs.com This message contains confidential information and is intended only for the individual named. If you are not the named addressee you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system. E-mails are not encrypted and cannot be guaranteed to be secure or error-free as information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore does not accept liability for any errors or omissions in the contents of this message which arise as a result of e-mail transmission. If verification is required please request a hard-copy version. This message is provided for informational purposes and should not be construed as a solicitation or offer to buy or sell any securities or related financial instruments. UBS Limited is a company limited by shares incorporated in the United Kingdom registered in England and Wales with number 2035362. Registered office: 1 Finsbury Avenue, London EC2M 2PP. UBS Limited is authorised and regulated by the Financial Services Authority. UBS AG is a public company incorporated with limited liability in Switzerland domiciled in the Canton of Basel-City and the Canton of Zurich respectively registered at the Commercial Registry offices in those Cantons with Identification No: CH-270.3.004.646-4 and having respective head offices at Aeschenvorstadt 1, 4051 Basel and Bahnhofstrasse 45, 8001 Zurich, Switzerland. Registered in the United Kingdom as a foreign company with No: FC021146 and having a UK Establishment registered at Companies House, Cardiff, with No: BR 004507. The principal office of UK Establishment: 1 Finsbury Avenue, London EC2M 2PP. In the United Kingdom, UBS AG is authorised and regulated by the Financial Services Authority. UBS reserves the right to retain all messages. Messages are protected and accessed only in legally justified cases.