Return-Path: X-Original-To: apmail-zookeeper-user-archive@www.apache.org Delivered-To: apmail-zookeeper-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id DBCE511A81 for ; Fri, 6 Jun 2014 21:19:35 +0000 (UTC) Received: (qmail 31595 invoked by uid 500); 6 Jun 2014 21:19:35 -0000 Delivered-To: apmail-zookeeper-user-archive@zookeeper.apache.org Received: (qmail 31542 invoked by uid 500); 6 Jun 2014 21:19:35 -0000 Mailing-List: contact user-help@zookeeper.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@zookeeper.apache.org Delivered-To: mailing list user@zookeeper.apache.org Received: (qmail 31529 invoked by uid 99); 6 Jun 2014 21:19:35 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 06 Jun 2014 21:19:35 +0000 X-ASF-Spam-Status: No, hits=1.0 required=5.0 tests=FORGED_YAHOO_RCVD,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of fpjunqueira@yahoo.com designates 212.82.96.69 as permitted sender) Received: from [212.82.96.69] (HELO nm7.bullet.mail.ir2.yahoo.com) (212.82.96.69) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 06 Jun 2014 21:19:30 +0000 Received: from [212.82.98.52] by nm7.bullet.mail.ir2.yahoo.com with NNFMP; 06 Jun 2014 21:19:08 -0000 Received: from [46.228.39.108] by tm5.bullet.mail.ir2.yahoo.com with NNFMP; 06 Jun 2014 21:19:08 -0000 Received: from [127.0.0.1] by smtp145.mail.ir2.yahoo.com with NNFMP; 06 Jun 2014 21:19:08 -0000 X-Yahoo-Newman-Id: 583361.20973.bm@smtp145.mail.ir2.yahoo.com X-Yahoo-Newman-Property: ymail-3 X-YMail-OSG: SZDpjN0VM1nAeoMiYoO4PkCJIKGFgTE.rhRlJCPp6pjd3CH 6lKdKVypYlWw2VRB1VD4ICRyeiB5aXTF5Qa6.ZWtXcSsnQQ1tnWA7SBbelXg mPV.xJqqtMPaV0Z7k_HipWNAwye2c3xxKm6Vjxg1MUb.QE2hiII1v9XF_Ptu bSojsm5XdNU_l3ft7vw0monaX7GaPpSWdRplCLha9iocyCfALeXT7IRIdsVz OS5UAlGwEjn0_YVQRTqMPegmpNqVJ0ohq8AEOp1vSfpM5AO6.SAK60rjpgzT 0aYjuE_j62dM7EDTNA3WGw7WHbAFdDadYyOUutMAKi2EN4OHsDO_P6L1DHE8 L4ewMPEHzXbfKq24IYV.ozgpL7yxHdionafuBPV.7OLIfl2s8AfnxrxQaJ0N 6yEBEzbQEdlWqegkGSCA2lhoD9WU.19a2kY4WaXpnBQI9KtJ6PzTOa2VVb6g 600rzcAJUPBZhmzGk6F0YjKQwUP81CCbUXDSJLI.DkYActrsL9MZ7EeRdocy oo3Y2BGK5jOPUzWYHnsSz9beHsbU4BwXB6WY0q7QLeo8.hTeX_HIHQoYGUOu oTn7w_AYLob64mUscINvmvQIq2eMbr4ASNiLLoiIMqRephNRD66Osd7iRkx_ pIaUjcfXaMj_2ZaBbALB3vhI.fJKI.YYAt69lFQm7NoGkjotcP0ZFC4KTIDx oVx8huRUoNw-- X-Yahoo-SMTP: HT5UJDeswBACWJPOeualxAa.da..S.fl X-Rocket-Received: from mac-air.home (fpjunqueira@217.44.151.49 with plain [188.125.69.59]) by smtp145.mail.ir2.yahoo.com with SMTP; 06 Jun 2014 21:19:08 +0000 UTC Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.2\)) Subject: Re: Asynchronous API's and monotonicity From: Flavio Junqueira In-Reply-To: Date: Fri, 6 Jun 2014 22:19:07 +0100 Cc: "James A. Robinson" Content-Transfer-Encoding: quoted-printable Message-Id: References: <5309FE79-A579-4604-A82C-EF993AFD8459@gmail.com> <8BA266F0-4A62-4550-B5A5-BB791198BE72@gmail.com> <08584CB7-2C7A-43CF-BC5A-7DD62978C5CF@yahoo.com> To: user@zookeeper.apache.org X-Mailer: Apple Mail (2.1878.2) X-Virus-Checked: Checked by ClamAV on apache.org There are ways around this. You can create a hierarchy to get around the = problems you're talking about, like we did with the hierarchical ledger = manager in bookkeeper. But granted, if all you want to do is a queue, = perhaps there are better options out there. -Flavio On 06 Jun 2014, at 22:11, Diego Oliveira wrote: > Flavio, >=20 > Queues usually may have a lot of messages and you may use a znode to > keep those messages. When the client want to list the messages in a = anode > the Zookeeper server must pass the child names, but there is a data > transportation limit between the server and the client and if the = child > names is larger then this limit the queue crashes. I got this problem = in a > production system. Take a look for more details the curator wiki ( > https://github.com/Netflix/curator/wiki/Tech-Note-4). >=20 >=20 >=20 >=20 > On Fri, Jun 6, 2014 at 6:04 PM, Flavio Junqueira < > fpjunqueira@yahoo.com.invalid> wrote: >=20 >> I don't quite understand the correlation among amount of data per = znode, >> queues, and being a well known problem. You might as well be right, = though. >>=20 >> -Flavio >>=20 >> On 06 Jun 2014, at 21:25, Diego Oliveira wrote: >>=20 >>> Mudit, >>>=20 >>> Just to let you know, Zookeeper isn't the best choice for queue, = it >> has >>> problems in the amount of data that a anode can handle. It is a very = well >>> know problem. >>>=20 >>> Att, >>> Diego >>>=20 >>>=20 >>> On Fri, Jun 6, 2014 at 5:12 AM, Mudit Verma = >>> wrote: >>>=20 >>>> Thanks James and Rakesh. It helps :) >>>>=20 >>>> On 05 Jun 2014, at 21:07, James A. Robinson = wrote: >>>>=20 >>>>> On Thu, Jun 5, 2014 at 9:45 AM, Rakesh Radhakrishnan < >>>> rakeshr.apache@gmail.com> wrote: >>>>> But this behaviour may not be same if we perform operations = through >>>>> different clients. Here network delays or other factors may cause >>>> different >>>>> clients to see a change. >>>>>=20 >>>>> I'm assuming the other important factor is to ensure that he's >>>>> either got a single control loop dispatching the async calls to >>>>> his zookeeper connection or that he's coordinating the threads >>>>> himself to impose ordering. >>>>>=20 >>>>> Otherwise, if one has threads x1 and x2 running in parallel, >>>>> he'd have no guarantee which thread dispatched its async >>>>> call to zookeeper first. >>>>>=20 >>>>> Jim >>>>>=20 >>>>=20 >>>>=20 >>>=20 >>>=20 >>> -- >>> Att. >>> Diego de Oliveira >>> System Architect >>> diego@diegooliveira.com >>> www.diegooliveira.com >>> Never argue with a fool -- people might not be able to tell the >> difference >>=20 >>=20 >=20 >=20 > --=20 > Att. > Diego de Oliveira > System Architect > diego@diegooliveira.com > www.diegooliveira.com > Never argue with a fool -- people might not be able to tell the = difference