zookeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michi Mutsuzaki <mi...@cs.stanford.edu>
Subject Re: Load on Zookeeper cluster?
Date Mon, 07 Apr 2014 22:08:22 GMT
Hi Check,

Something like this should work on ubuntu.

https://paste.apache.org/6kao?action=download


On Sun, Apr 6, 2014 at 11:11 PM, Check Peck <comptechgeeky@gmail.com> wrote:
> I am not sure from where to start to install zkpython.. I tried following
> that github link but was not able to understand. If you can guide me what I
> am supposed to do step by step, then it will be of great help to me. Thanks.
>
>
> On Sun, Apr 6, 2014 at 10:57 PM, Pavan Sudheendra <pavan0591@gmail.com>wrote:
>
>> Hi Check,
>>
>> Where are you getting stuck?
>>
>>
>> On Mon, Apr 7, 2014 at 11:13 AM, Check Peck <comptechgeeky@gmail.com>
>> wrote:
>>
>> > Thanks. I tried going through that github link but wasn't able to
>> > understand what I am supposed to do clearly. May be I am not that much
>> > familiar with Python so that's why I am having hard time figuring that
>> out?
>> >
>> >
>> > On Sun, Apr 6, 2014 at 10:06 PM, Michi Mutsuzaki <michi@cs.stanford.edu
>> > >wrote:
>> >
>> > > You need to install zkpython. The steps are described in the README
>> > > file. Let us know if you have trouble installing zkpython.
>> > >
>> > >
>> >
>> https://github.com/apache/zookeeper/blob/trunk/src/contrib/zkpython/README
>> > >
>> > > On Sun, Apr 6, 2014 at 9:21 PM, Check Peck <comptechgeeky@gmail.com>
>> > > wrote:
>> > > > I tried following the steps mentioned on this github link -
>> > > > https://github.com/phunt/zk-smoketest for zk-latencies.py.
>> > > >
>> > > > I have 3 node ZK cluster-  machineA, machineB, machineC
>> > > >
>> > > > Now I copied the Python program zk-latencies.py and zkclient.py in
>> > > another
>> > > > machineD in which no zookeeper is running. It's a plain ubuntu box.
>> > > >
>> > > > Now when I ran the program like this -
>> > > >
>> > > > david@machineD:~/zooksmoketest$ ./zk-latencies.py --servers
>> > > > "machineA:2181,machineB::2181,machineC:2181" --znode_count=100
>> > > > --znode_size=100 --synchronous
>> > > > Traceback (most recent call last):
>> > > >   File "./zk-latencies.py", line 22, in <module>
>> > > >     import zkclient
>> > > >   File "/home/david/zooksmoketest/zkclient.py", line 17, in <module>
>> > > >     import zookeeper, time, threading
>> > > >
>> > > > *ImportError: No module named zookeeper*
>> > > >
>> > > > I got an error as shown above. Any thoughts what wrong I am doing
>> > here? I
>> > > > don't have that much experience with Python. Any suggestions will
be
>> of
>> > > > great help.
>> > > >
>> > > > @Raul: Any thoughts?
>> > > >
>> > > >
>> > > >
>> > > > On Sun, Apr 6, 2014 at 6:46 PM, Check Peck <comptechgeeky@gmail.com>
>> > > wrote:
>> > > >
>> > > >> Thanks guys.. I am going to do load test in couple of days using
the
>> > > >> exiting Python framework. And I will share the results once I
am
>> done.
>> > > >>
>> > > >>
>> > > >> On Tue, Mar 25, 2014 at 11:19 PM, Rakesh R <rakeshr@huawei.com>
>> > wrote:
>> > > >>
>> > > >>>
>> > > >>> If I understood the case correctly,
>> > > >>> Test :- 3 node ZK cluster, 600 sessions each will do one read
>> > > >>> operation(getChildren call) every one minute.
>> > > >>>
>> > > >>> I'm assuming the calls are equally distributed in time frame
and it
>> > > would
>> > > >>> be like : 600ops/60secs, average 10 ops/sec will go to 3 node
>> cluster
>> > > >>> I also feel it should be, also it would be great if you publish
the
>> > > >>> results after your tests.
>> > > >>>
>> > > >>>
>> > > >>> -Rakesh
>> > > >>>
>> > > >>> -----Original Message-----
>> > > >>> From: Check Peck [mailto:comptechgeeky@gmail.com]
>> > > >>> Sent: 26 March 2014 11:19
>> > > >>> To: user
>> > > >>> Subject: Re: Load on Zookeeper cluster?
>> > > >>>
>> > > >>> Thanks that is also quite useful.
>> > > >>>
>> > > >>> For my above use case, I just need to get the children of
a
>> > particular
>> > > >>> znode.. And that's what will be happening from all the 600
>> > application
>> > > >>> machines..
>> > > >>>
>> > > >>> From the wiki you provided, it looks it should be fine right?
>> > > >>>
>> > > >>>
>> > > >>> On Tue, Mar 25, 2014 at 10:13 PM, Rakesh R <rakeshr@huawei.com>
>> > wrote:
>> > > >>>
>> > > >>> >
>> > > >>> > Please go through the below one, hope it will be helpful
to you.
>> > > Also,
>> > > >>> > I would recommend to have a look at the basic zk configurations
>> > too.
>> > > >>> > All the
>> > > >>> > best:)
>> > > >>> >
>> > > >>> >
>> > > >>> >
>> > > https://cwiki.apache.org/confluence/display/ZOOKEEPER/ServiceLatencyOv
>> > > >>> > erview
>> > > >>> >
>> > > >>> >
>> > > >>> > What client operations(for ex: simply creating many znodes,
>> > deleting,
>> > > >>> > setwatches et.) you are planning to perform.
>> > > >>> > Actually I'd like to know what each zkclient will be
doing.
>> > > >>> >
>> > > >>> > -Rakesh
>> > > >>> >
>> > > >>> > -----Original Message-----
>> > > >>> > From: Check Peck [mailto:comptechgeeky@gmail.com]
>> > > >>> > Sent: 26 March 2014 09:40
>> > > >>> > To: user
>> > > >>> > Subject: Re: Load on Zookeeper cluster?
>> > > >>> >
>> > > >>> > On Tue, Mar 25, 2014 at 9:00 PM, Raúl Gutiérrez Segalés
<
>> > > >>> > rgs@itevenworks.net
>> > > >>> > > wrote:
>> > > >>> >
>> > > >>> > > 1 ZK se
>> > > >>> >
>> > > >>> >
>> > > >>> >
>> > > >>> > Yes one ZK session per application. Zookeeper version
I am
>> running
>> > > >>> > currently is 3.4.5 in production.
>> > > >>> >
>> > > >>>
>> > > >>
>> > > >>
>> > >
>> >
>>
>>
>>
>> --
>> Regards-
>> Pavan
>>

Mime
View raw message