Return-Path: X-Original-To: apmail-zookeeper-user-archive@www.apache.org Delivered-To: apmail-zookeeper-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6D44311D20 for ; Mon, 7 Apr 2014 05:58:43 +0000 (UTC) Received: (qmail 1371 invoked by uid 500); 7 Apr 2014 05:58:42 -0000 Delivered-To: apmail-zookeeper-user-archive@zookeeper.apache.org Received: (qmail 685 invoked by uid 500); 7 Apr 2014 05:58:40 -0000 Mailing-List: contact user-help@zookeeper.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@zookeeper.apache.org Delivered-To: mailing list user@zookeeper.apache.org Received: (qmail 671 invoked by uid 99); 7 Apr 2014 05:58:38 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 07 Apr 2014 05:58:38 +0000 X-ASF-Spam-Status: No, hits=1.7 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of pavan0591@gmail.com designates 209.85.219.54 as permitted sender) Received: from [209.85.219.54] (HELO mail-oa0-f54.google.com) (209.85.219.54) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 07 Apr 2014 05:58:34 +0000 Received: by mail-oa0-f54.google.com with SMTP id n16so6216769oag.27 for ; Sun, 06 Apr 2014 22:58:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=gpCM+e/ELSx4jpAZeedIL+Qc7jGvJMckrroiwd59k6M=; b=Z07OMJR/5z0N4vKca/1lP57WHeGzPv05DGrMyZ/uThCHVcKkP0KFJMkpzigGDy3iiD b5S8g74Ap6gy3i53Mtdt9L6ROhPDMYll74OjeMTo8+JUn5sfbyYqZLfu4k/vVIM+niTa N0U5naibaKyZLoyVb4wu7zE3cgTPLL+/UvgaVCH+hCs7fdmszrFKEBJqBsx4B4PmLftx f5RduASZuGpKCmn0j7m4lBQ+GL8cGDPA3ytChLGcMdFvdl+bZ2SHRg+8FzKfpQ+HSMc3 iedNMhbvsrbcz+77ZUtE5FqeeDyK9kn7GHs1V/S5KlyN5mvrflwHjxfeogiTdIHrGWNZ mrMg== X-Received: by 10.60.155.35 with SMTP id vt3mr33452196oeb.32.1396850291528; Sun, 06 Apr 2014 22:58:11 -0700 (PDT) MIME-Version: 1.0 Received: by 10.182.125.167 with HTTP; Sun, 6 Apr 2014 22:57:51 -0700 (PDT) In-Reply-To: References: From: Pavan Sudheendra Date: Mon, 7 Apr 2014 11:27:51 +0530 Message-ID: Subject: Re: Load on Zookeeper cluster? To: user@zookeeper.apache.org Content-Type: multipart/alternative; boundary=047d7bd6b61a6e595c04f66d8d5e X-Virus-Checked: Checked by ClamAV on apache.org --047d7bd6b61a6e595c04f66d8d5e Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hi Check, Where are you getting stuck? On Mon, Apr 7, 2014 at 11:13 AM, Check Peck wrote= : > Thanks. I tried going through that github link but wasn't able to > understand what I am supposed to do clearly. May be I am not that much > familiar with Python so that's why I am having hard time figuring that ou= t? > > > On Sun, Apr 6, 2014 at 10:06 PM, Michi Mutsuzaki >wrote: > > > You need to install zkpython. The steps are described in the README > > file. Let us know if you have trouble installing zkpython. > > > > > https://github.com/apache/zookeeper/blob/trunk/src/contrib/zkpython/READM= E > > > > On Sun, Apr 6, 2014 at 9:21 PM, Check Peck > > wrote: > > > I tried following the steps mentioned on this github link - > > > https://github.com/phunt/zk-smoketest for zk-latencies.py. > > > > > > I have 3 node ZK cluster- machineA, machineB, machineC > > > > > > Now I copied the Python program zk-latencies.py and zkclient.py in > > another > > > machineD in which no zookeeper is running. It's a plain ubuntu box. > > > > > > Now when I ran the program like this - > > > > > > david@machineD:~/zooksmoketest$ ./zk-latencies.py --servers > > > "machineA:2181,machineB::2181,machineC:2181" --znode_count=3D100 > > > --znode_size=3D100 --synchronous > > > Traceback (most recent call last): > > > File "./zk-latencies.py", line 22, in > > > import zkclient > > > File "/home/david/zooksmoketest/zkclient.py", line 17, in > > > import zookeeper, time, threading > > > > > > *ImportError: No module named zookeeper* > > > > > > I got an error as shown above. Any thoughts what wrong I am doing > here? I > > > don't have that much experience with Python. Any suggestions will be = of > > > great help. > > > > > > @Raul: Any thoughts? > > > > > > > > > > > > On Sun, Apr 6, 2014 at 6:46 PM, Check Peck > > wrote: > > > > > >> Thanks guys.. I am going to do load test in couple of days using the > > >> exiting Python framework. And I will share the results once I am don= e. > > >> > > >> > > >> On Tue, Mar 25, 2014 at 11:19 PM, Rakesh R > wrote: > > >> > > >>> > > >>> If I understood the case correctly, > > >>> Test :- 3 node ZK cluster, 600 sessions each will do one read > > >>> operation(getChildren call) every one minute. > > >>> > > >>> I'm assuming the calls are equally distributed in time frame and it > > would > > >>> be like : 600ops/60secs, average 10 ops/sec will go to 3 node clust= er > > >>> I also feel it should be, also it would be great if you publish the > > >>> results after your tests. > > >>> > > >>> > > >>> -Rakesh > > >>> > > >>> -----Original Message----- > > >>> From: Check Peck [mailto:comptechgeeky@gmail.com] > > >>> Sent: 26 March 2014 11:19 > > >>> To: user > > >>> Subject: Re: Load on Zookeeper cluster? > > >>> > > >>> Thanks that is also quite useful. > > >>> > > >>> For my above use case, I just need to get the children of a > particular > > >>> znode.. And that's what will be happening from all the 600 > application > > >>> machines.. > > >>> > > >>> From the wiki you provided, it looks it should be fine right? > > >>> > > >>> > > >>> On Tue, Mar 25, 2014 at 10:13 PM, Rakesh R > wrote: > > >>> > > >>> > > > >>> > Please go through the below one, hope it will be helpful to you. > > Also, > > >>> > I would recommend to have a look at the basic zk configurations > too. > > >>> > All the > > >>> > best:) > > >>> > > > >>> > > > >>> > > > https://cwiki.apache.org/confluence/display/ZOOKEEPER/ServiceLatencyOv > > >>> > erview > > >>> > > > >>> > > > >>> > What client operations(for ex: simply creating many znodes, > deleting, > > >>> > setwatches et.) you are planning to perform. > > >>> > Actually I'd like to know what each zkclient will be doing. > > >>> > > > >>> > -Rakesh > > >>> > > > >>> > -----Original Message----- > > >>> > From: Check Peck [mailto:comptechgeeky@gmail.com] > > >>> > Sent: 26 March 2014 09:40 > > >>> > To: user > > >>> > Subject: Re: Load on Zookeeper cluster? > > >>> > > > >>> > On Tue, Mar 25, 2014 at 9:00 PM, Ra=FAl Guti=E9rrez Segal=E9s < > > >>> > rgs@itevenworks.net > > >>> > > wrote: > > >>> > > > >>> > > 1 ZK se > > >>> > > > >>> > > > >>> > > > >>> > Yes one ZK session per application. Zookeeper version I am runnin= g > > >>> > currently is 3.4.5 in production. > > >>> > > > >>> > > >> > > >> > > > --=20 Regards- Pavan --047d7bd6b61a6e595c04f66d8d5e--