zookeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Check Peck <comptechge...@gmail.com>
Subject Re: Load on Zookeeper cluster?
Date Mon, 07 Apr 2014 06:11:54 GMT
I am not sure from where to start to install zkpython.. I tried following
that github link but was not able to understand. If you can guide me what I
am supposed to do step by step, then it will be of great help to me. Thanks.


On Sun, Apr 6, 2014 at 10:57 PM, Pavan Sudheendra <pavan0591@gmail.com>wrote:

> Hi Check,
>
> Where are you getting stuck?
>
>
> On Mon, Apr 7, 2014 at 11:13 AM, Check Peck <comptechgeeky@gmail.com>
> wrote:
>
> > Thanks. I tried going through that github link but wasn't able to
> > understand what I am supposed to do clearly. May be I am not that much
> > familiar with Python so that's why I am having hard time figuring that
> out?
> >
> >
> > On Sun, Apr 6, 2014 at 10:06 PM, Michi Mutsuzaki <michi@cs.stanford.edu
> > >wrote:
> >
> > > You need to install zkpython. The steps are described in the README
> > > file. Let us know if you have trouble installing zkpython.
> > >
> > >
> >
> https://github.com/apache/zookeeper/blob/trunk/src/contrib/zkpython/README
> > >
> > > On Sun, Apr 6, 2014 at 9:21 PM, Check Peck <comptechgeeky@gmail.com>
> > > wrote:
> > > > I tried following the steps mentioned on this github link -
> > > > https://github.com/phunt/zk-smoketest for zk-latencies.py.
> > > >
> > > > I have 3 node ZK cluster-  machineA, machineB, machineC
> > > >
> > > > Now I copied the Python program zk-latencies.py and zkclient.py in
> > > another
> > > > machineD in which no zookeeper is running. It's a plain ubuntu box.
> > > >
> > > > Now when I ran the program like this -
> > > >
> > > > david@machineD:~/zooksmoketest$ ./zk-latencies.py --servers
> > > > "machineA:2181,machineB::2181,machineC:2181" --znode_count=100
> > > > --znode_size=100 --synchronous
> > > > Traceback (most recent call last):
> > > >   File "./zk-latencies.py", line 22, in <module>
> > > >     import zkclient
> > > >   File "/home/david/zooksmoketest/zkclient.py", line 17, in <module>
> > > >     import zookeeper, time, threading
> > > >
> > > > *ImportError: No module named zookeeper*
> > > >
> > > > I got an error as shown above. Any thoughts what wrong I am doing
> > here? I
> > > > don't have that much experience with Python. Any suggestions will be
> of
> > > > great help.
> > > >
> > > > @Raul: Any thoughts?
> > > >
> > > >
> > > >
> > > > On Sun, Apr 6, 2014 at 6:46 PM, Check Peck <comptechgeeky@gmail.com>
> > > wrote:
> > > >
> > > >> Thanks guys.. I am going to do load test in couple of days using the
> > > >> exiting Python framework. And I will share the results once I am
> done.
> > > >>
> > > >>
> > > >> On Tue, Mar 25, 2014 at 11:19 PM, Rakesh R <rakeshr@huawei.com>
> > wrote:
> > > >>
> > > >>>
> > > >>> If I understood the case correctly,
> > > >>> Test :- 3 node ZK cluster, 600 sessions each will do one read
> > > >>> operation(getChildren call) every one minute.
> > > >>>
> > > >>> I'm assuming the calls are equally distributed in time frame and
it
> > > would
> > > >>> be like : 600ops/60secs, average 10 ops/sec will go to 3 node
> cluster
> > > >>> I also feel it should be, also it would be great if you publish
the
> > > >>> results after your tests.
> > > >>>
> > > >>>
> > > >>> -Rakesh
> > > >>>
> > > >>> -----Original Message-----
> > > >>> From: Check Peck [mailto:comptechgeeky@gmail.com]
> > > >>> Sent: 26 March 2014 11:19
> > > >>> To: user
> > > >>> Subject: Re: Load on Zookeeper cluster?
> > > >>>
> > > >>> Thanks that is also quite useful.
> > > >>>
> > > >>> For my above use case, I just need to get the children of a
> > particular
> > > >>> znode.. And that's what will be happening from all the 600
> > application
> > > >>> machines..
> > > >>>
> > > >>> From the wiki you provided, it looks it should be fine right?
> > > >>>
> > > >>>
> > > >>> On Tue, Mar 25, 2014 at 10:13 PM, Rakesh R <rakeshr@huawei.com>
> > wrote:
> > > >>>
> > > >>> >
> > > >>> > Please go through the below one, hope it will be helpful
to you.
> > > Also,
> > > >>> > I would recommend to have a look at the basic zk configurations
> > too.
> > > >>> > All the
> > > >>> > best:)
> > > >>> >
> > > >>> >
> > > >>> >
> > > https://cwiki.apache.org/confluence/display/ZOOKEEPER/ServiceLatencyOv
> > > >>> > erview
> > > >>> >
> > > >>> >
> > > >>> > What client operations(for ex: simply creating many znodes,
> > deleting,
> > > >>> > setwatches et.) you are planning to perform.
> > > >>> > Actually I'd like to know what each zkclient will be doing.
> > > >>> >
> > > >>> > -Rakesh
> > > >>> >
> > > >>> > -----Original Message-----
> > > >>> > From: Check Peck [mailto:comptechgeeky@gmail.com]
> > > >>> > Sent: 26 March 2014 09:40
> > > >>> > To: user
> > > >>> > Subject: Re: Load on Zookeeper cluster?
> > > >>> >
> > > >>> > On Tue, Mar 25, 2014 at 9:00 PM, Raúl Gutiérrez Segalés
<
> > > >>> > rgs@itevenworks.net
> > > >>> > > wrote:
> > > >>> >
> > > >>> > > 1 ZK se
> > > >>> >
> > > >>> >
> > > >>> >
> > > >>> > Yes one ZK session per application. Zookeeper version I am
> running
> > > >>> > currently is 3.4.5 in production.
> > > >>> >
> > > >>>
> > > >>
> > > >>
> > >
> >
>
>
>
> --
> Regards-
> Pavan
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message