zookeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michi Mutsuzaki <mi...@cs.stanford.edu>
Subject Re: Load on Zookeeper cluster?
Date Tue, 08 Apr 2014 03:42:59 GMT
You probably need to set the proxy.

http://ant.apache.org/manual/proxy.html

On Mon, Apr 7, 2014 at 8:40 PM, Check Peck <comptechgeeky@gmail.com> wrote:
> Thanks a lot Michi. Appreciated  your help.. I tried your suggestion on one
> of my production box but when I tried "fifth" step which is "ant". I got an
> error as shown below. Any thoughts what is wrong? I guess firewall is
> blocking. Is there any other way around for this? I manually copied
> "zookeeper-3.4.6.tar.gz" into that machine using "scp" as well.
> check@phx5tg03c-cfc7:~/zooksmoketest/zookeeper-3.4.6$ ant
> Buildfile: /home/check/zooksmoketest/zookeeper-3.4.6/build.xml
>
> init:
>
> ivy-download:
>       [get] Getting:
> http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.2.0/ivy-2.2.0.jar
>       [get] To:
> /home/check/zooksmoketest/zookeeper-3.4.6/src/java/lib/ivy-2.2.0.jar
>       [get] Error getting
> http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.2.0/ivy-2.2.0.jar to
> /home/check/zooksmoketest/zookeeper-3.4.6/src/java/lib/ivy-2.2.0.jar
>
> BUILD FAILED
> /home/check/zooksmoketest/zookeeper-3.4.6/build.xml:348:
> java.net.ConnectException: Connection timed out
>         at java.net.PlainSocketImpl.socketConnect(Native Method)
>         at
> java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:327)
>         at
> java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:193)
>         at
> java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:180)
>         at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:384)
>         at java.net.Socket.connect(Socket.java:546)
>         at java.net.Socket.connect(Socket.java:495)
>         at sun.net.NetworkClient.doConnect(NetworkClient.java:178)
>         at sun.net.www.http.HttpClient.openServer(HttpClient.java:409)
>         at sun.net.www.http.HttpClient.openServer(HttpClient.java:530)
>         at sun.net.www.http.HttpClient.<init>(HttpClient.java:240)
>         at sun.net.www.http.HttpClient.New(HttpClient.java:321)
>         at sun.net.www.http.HttpClient.New(HttpClient.java:338)
>         at
> sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:935)
>         at
> sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:876)
>         at
> sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:801)
>         at
> org.apache.tools.ant.taskdefs.Get$GetThread.openConnection(Get.java:660)
>         at org.apache.tools.ant.taskdefs.Get$GetThread.get(Get.java:579)
>         at org.apache.tools.ant.taskdefs.Get$GetThread.run(Get.java:569)
>
> Total time: 1 minute 3 seconds
>
>
>
> On Mon, Apr 7, 2014 at 3:08 PM, Michi Mutsuzaki <michi@cs.stanford.edu>
> wrote:
>>
>> Hi Check,
>>
>> Something like this should work on ubuntu.
>>
>> https://paste.apache.org/6kao?action=download
>>
>>
>> On Sun, Apr 6, 2014 at 11:11 PM, Check Peck <comptechgeeky@gmail.com>
>> wrote:
>> > I am not sure from where to start to install zkpython.. I tried
>> > following
>> > that github link but was not able to understand. If you can guide me
>> > what I
>> > am supposed to do step by step, then it will be of great help to me.
>> > Thanks.
>> >
>> >
>> > On Sun, Apr 6, 2014 at 10:57 PM, Pavan Sudheendra
>> > <pavan0591@gmail.com>wrote:
>> >
>> >> Hi Check,
>> >>
>> >> Where are you getting stuck?
>> >>
>> >>
>> >> On Mon, Apr 7, 2014 at 11:13 AM, Check Peck <comptechgeeky@gmail.com>
>> >> wrote:
>> >>
>> >> > Thanks. I tried going through that github link but wasn't able to
>> >> > understand what I am supposed to do clearly. May be I am not that
>> >> > much
>> >> > familiar with Python so that's why I am having hard time figuring
>> >> > that
>> >> out?
>> >> >
>> >> >
>> >> > On Sun, Apr 6, 2014 at 10:06 PM, Michi Mutsuzaki
>> >> > <michi@cs.stanford.edu
>> >> > >wrote:
>> >> >
>> >> > > You need to install zkpython. The steps are described in the README
>> >> > > file. Let us know if you have trouble installing zkpython.
>> >> > >
>> >> > >
>> >> >
>> >>
>> >> https://github.com/apache/zookeeper/blob/trunk/src/contrib/zkpython/README
>> >> > >
>> >> > > On Sun, Apr 6, 2014 at 9:21 PM, Check Peck
>> >> > > <comptechgeeky@gmail.com>
>> >> > > wrote:
>> >> > > > I tried following the steps mentioned on this github link
-
>> >> > > > https://github.com/phunt/zk-smoketest for zk-latencies.py.
>> >> > > >
>> >> > > > I have 3 node ZK cluster-  machineA, machineB, machineC
>> >> > > >
>> >> > > > Now I copied the Python program zk-latencies.py and zkclient.py
>> >> > > > in
>> >> > > another
>> >> > > > machineD in which no zookeeper is running. It's a plain ubuntu
>> >> > > > box.
>> >> > > >
>> >> > > > Now when I ran the program like this -
>> >> > > >
>> >> > > > david@machineD:~/zooksmoketest$ ./zk-latencies.py --servers
>> >> > > > "machineA:2181,machineB::2181,machineC:2181" --znode_count=100
>> >> > > > --znode_size=100 --synchronous
>> >> > > > Traceback (most recent call last):
>> >> > > >   File "./zk-latencies.py", line 22, in <module>
>> >> > > >     import zkclient
>> >> > > >   File "/home/david/zooksmoketest/zkclient.py", line 17,
in
>> >> > > > <module>
>> >> > > >     import zookeeper, time, threading
>> >> > > >
>> >> > > > *ImportError: No module named zookeeper*
>> >> > > >
>> >> > > > I got an error as shown above. Any thoughts what wrong I
am doing
>> >> > here? I
>> >> > > > don't have that much experience with Python. Any suggestions
will
>> >> > > > be
>> >> of
>> >> > > > great help.
>> >> > > >
>> >> > > > @Raul: Any thoughts?
>> >> > > >
>> >> > > >
>> >> > > >
>> >> > > > On Sun, Apr 6, 2014 at 6:46 PM, Check Peck
>> >> > > > <comptechgeeky@gmail.com>
>> >> > > wrote:
>> >> > > >
>> >> > > >> Thanks guys.. I am going to do load test in couple of
days using
>> >> > > >> the
>> >> > > >> exiting Python framework. And I will share the results
once I am
>> >> done.
>> >> > > >>
>> >> > > >>
>> >> > > >> On Tue, Mar 25, 2014 at 11:19 PM, Rakesh R <rakeshr@huawei.com>
>> >> > wrote:
>> >> > > >>
>> >> > > >>>
>> >> > > >>> If I understood the case correctly,
>> >> > > >>> Test :- 3 node ZK cluster, 600 sessions each will
do one read
>> >> > > >>> operation(getChildren call) every one minute.
>> >> > > >>>
>> >> > > >>> I'm assuming the calls are equally distributed in
time frame
>> >> > > >>> and it
>> >> > > would
>> >> > > >>> be like : 600ops/60secs, average 10 ops/sec will
go to 3 node
>> >> cluster
>> >> > > >>> I also feel it should be, also it would be great
if you publish
>> >> > > >>> the
>> >> > > >>> results after your tests.
>> >> > > >>>
>> >> > > >>>
>> >> > > >>> -Rakesh
>> >> > > >>>
>> >> > > >>> -----Original Message-----
>> >> > > >>> From: Check Peck [mailto:comptechgeeky@gmail.com]
>> >> > > >>> Sent: 26 March 2014 11:19
>> >> > > >>> To: user
>> >> > > >>> Subject: Re: Load on Zookeeper cluster?
>> >> > > >>>
>> >> > > >>> Thanks that is also quite useful.
>> >> > > >>>
>> >> > > >>> For my above use case, I just need to get the children
of a
>> >> > particular
>> >> > > >>> znode.. And that's what will be happening from all
the 600
>> >> > application
>> >> > > >>> machines..
>> >> > > >>>
>> >> > > >>> From the wiki you provided, it looks it should be
fine right?
>> >> > > >>>
>> >> > > >>>
>> >> > > >>> On Tue, Mar 25, 2014 at 10:13 PM, Rakesh R <rakeshr@huawei.com>
>> >> > wrote:
>> >> > > >>>
>> >> > > >>> >
>> >> > > >>> > Please go through the below one, hope it will
be helpful to
>> >> > > >>> > you.
>> >> > > Also,
>> >> > > >>> > I would recommend to have a look at the basic
zk
>> >> > > >>> > configurations
>> >> > too.
>> >> > > >>> > All the
>> >> > > >>> > best:)
>> >> > > >>> >
>> >> > > >>> >
>> >> > > >>> >
>> >> > >
>> >> > > https://cwiki.apache.org/confluence/display/ZOOKEEPER/ServiceLatencyOv
>> >> > > >>> > erview
>> >> > > >>> >
>> >> > > >>> >
>> >> > > >>> > What client operations(for ex: simply creating
many znodes,
>> >> > deleting,
>> >> > > >>> > setwatches et.) you are planning to perform.
>> >> > > >>> > Actually I'd like to know what each zkclient
will be doing.
>> >> > > >>> >
>> >> > > >>> > -Rakesh
>> >> > > >>> >
>> >> > > >>> > -----Original Message-----
>> >> > > >>> > From: Check Peck [mailto:comptechgeeky@gmail.com]
>> >> > > >>> > Sent: 26 March 2014 09:40
>> >> > > >>> > To: user
>> >> > > >>> > Subject: Re: Load on Zookeeper cluster?
>> >> > > >>> >
>> >> > > >>> > On Tue, Mar 25, 2014 at 9:00 PM, Raúl Gutiérrez
Segalés <
>> >> > > >>> > rgs@itevenworks.net
>> >> > > >>> > > wrote:
>> >> > > >>> >
>> >> > > >>> > > 1 ZK se
>> >> > > >>> >
>> >> > > >>> >
>> >> > > >>> >
>> >> > > >>> > Yes one ZK session per application. Zookeeper
version I am
>> >> running
>> >> > > >>> > currently is 3.4.5 in production.
>> >> > > >>> >
>> >> > > >>>
>> >> > > >>
>> >> > > >>
>> >> > >
>> >> >
>> >>
>> >>
>> >>
>> >> --
>> >> Regards-
>> >> Pavan
>> >>
>
>

Mime
View raw message