zookeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Check Peck <comptechge...@gmail.com>
Subject Re: Load on Zookeeper cluster?
Date Tue, 08 Apr 2014 03:40:07 GMT
Thanks a lot Michi. Appreciated  your help.. I tried your suggestion on one
of my production box but when I tried "fifth" step which is "ant". I got an
error as shown below. Any thoughts what is wrong? I guess firewall is
blocking. Is there any other way around for this? I manually copied
"zookeeper-3.4.6.tar.gz" into that machine using "scp" as well.
check@phx5tg03c-cfc7:~/zooksmoketest/zookeeper-3.4.6$ ant
Buildfile: /home/check/zooksmoketest/zookeeper-3.4.6/build.xml

init:

ivy-download:
      [get] Getting:
http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.2.0/ivy-2.2.0.jar
      [get] To:
/home/check/zooksmoketest/zookeeper-3.4.6/src/java/lib/ivy-2.2.0.jar
      [get] Error getting
http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.2.0/ivy-2.2.0.jar to
/home/check/zooksmoketest/zookeeper-3.4.6/src/java/lib/ivy-2.2.0.jar

BUILD FAILED
/home/check/zooksmoketest/zookeeper-3.4.6/build.xml:348:
java.net.ConnectException: Connection timed out
        at java.net.PlainSocketImpl.socketConnect(Native Method)
        at
java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:327)
        at
java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:193)
        at
java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:180)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:384)
        at java.net.Socket.connect(Socket.java:546)
        at java.net.Socket.connect(Socket.java:495)
        at sun.net.NetworkClient.doConnect(NetworkClient.java:178)
        at sun.net.www.http.HttpClient.openServer(HttpClient.java:409)
        at sun.net.www.http.HttpClient.openServer(HttpClient.java:530)
        at sun.net.www.http.HttpClient.<init>(HttpClient.java:240)
        at sun.net.www.http.HttpClient.New(HttpClient.java:321)
        at sun.net.www.http.HttpClient.New(HttpClient.java:338)
        at
sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:935)
        at
sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:876)
        at
sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:801)
        at
org.apache.tools.ant.taskdefs.Get$GetThread.openConnection(Get.java:660)
        at org.apache.tools.ant.taskdefs.Get$GetThread.get(Get.java:579)
        at org.apache.tools.ant.taskdefs.Get$GetThread.run(Get.java:569)

Total time: 1 minute 3 seconds



On Mon, Apr 7, 2014 at 3:08 PM, Michi Mutsuzaki <michi@cs.stanford.edu>wrote:

> Hi Check,
>
> Something like this should work on ubuntu.
>
> https://paste.apache.org/6kao?action=download
>
>
> On Sun, Apr 6, 2014 at 11:11 PM, Check Peck <comptechgeeky@gmail.com>
> wrote:
> > I am not sure from where to start to install zkpython.. I tried following
> > that github link but was not able to understand. If you can guide me
> what I
> > am supposed to do step by step, then it will be of great help to me.
> Thanks.
> >
> >
> > On Sun, Apr 6, 2014 at 10:57 PM, Pavan Sudheendra <pavan0591@gmail.com
> >wrote:
> >
> >> Hi Check,
> >>
> >> Where are you getting stuck?
> >>
> >>
> >> On Mon, Apr 7, 2014 at 11:13 AM, Check Peck <comptechgeeky@gmail.com>
> >> wrote:
> >>
> >> > Thanks. I tried going through that github link but wasn't able to
> >> > understand what I am supposed to do clearly. May be I am not that much
> >> > familiar with Python so that's why I am having hard time figuring that
> >> out?
> >> >
> >> >
> >> > On Sun, Apr 6, 2014 at 10:06 PM, Michi Mutsuzaki <
> michi@cs.stanford.edu
> >> > >wrote:
> >> >
> >> > > You need to install zkpython. The steps are described in the README
> >> > > file. Let us know if you have trouble installing zkpython.
> >> > >
> >> > >
> >> >
> >>
> https://github.com/apache/zookeeper/blob/trunk/src/contrib/zkpython/README
> >> > >
> >> > > On Sun, Apr 6, 2014 at 9:21 PM, Check Peck <comptechgeeky@gmail.com
> >
> >> > > wrote:
> >> > > > I tried following the steps mentioned on this github link -
> >> > > > https://github.com/phunt/zk-smoketest for zk-latencies.py.
> >> > > >
> >> > > > I have 3 node ZK cluster-  machineA, machineB, machineC
> >> > > >
> >> > > > Now I copied the Python program zk-latencies.py and zkclient.py
in
> >> > > another
> >> > > > machineD in which no zookeeper is running. It's a plain ubuntu
> box.
> >> > > >
> >> > > > Now when I ran the program like this -
> >> > > >
> >> > > > david@machineD:~/zooksmoketest$ ./zk-latencies.py --servers
> >> > > > "machineA:2181,machineB::2181,machineC:2181" --znode_count=100
> >> > > > --znode_size=100 --synchronous
> >> > > > Traceback (most recent call last):
> >> > > >   File "./zk-latencies.py", line 22, in <module>
> >> > > >     import zkclient
> >> > > >   File "/home/david/zooksmoketest/zkclient.py", line 17, in
> <module>
> >> > > >     import zookeeper, time, threading
> >> > > >
> >> > > > *ImportError: No module named zookeeper*
> >> > > >
> >> > > > I got an error as shown above. Any thoughts what wrong I am doing
> >> > here? I
> >> > > > don't have that much experience with Python. Any suggestions
will
> be
> >> of
> >> > > > great help.
> >> > > >
> >> > > > @Raul: Any thoughts?
> >> > > >
> >> > > >
> >> > > >
> >> > > > On Sun, Apr 6, 2014 at 6:46 PM, Check Peck <
> comptechgeeky@gmail.com>
> >> > > wrote:
> >> > > >
> >> > > >> Thanks guys.. I am going to do load test in couple of days
using
> the
> >> > > >> exiting Python framework. And I will share the results once
I am
> >> done.
> >> > > >>
> >> > > >>
> >> > > >> On Tue, Mar 25, 2014 at 11:19 PM, Rakesh R <rakeshr@huawei.com>
> >> > wrote:
> >> > > >>
> >> > > >>>
> >> > > >>> If I understood the case correctly,
> >> > > >>> Test :- 3 node ZK cluster, 600 sessions each will do
one read
> >> > > >>> operation(getChildren call) every one minute.
> >> > > >>>
> >> > > >>> I'm assuming the calls are equally distributed in time
frame
> and it
> >> > > would
> >> > > >>> be like : 600ops/60secs, average 10 ops/sec will go to
3 node
> >> cluster
> >> > > >>> I also feel it should be, also it would be great if you
publish
> the
> >> > > >>> results after your tests.
> >> > > >>>
> >> > > >>>
> >> > > >>> -Rakesh
> >> > > >>>
> >> > > >>> -----Original Message-----
> >> > > >>> From: Check Peck [mailto:comptechgeeky@gmail.com]
> >> > > >>> Sent: 26 March 2014 11:19
> >> > > >>> To: user
> >> > > >>> Subject: Re: Load on Zookeeper cluster?
> >> > > >>>
> >> > > >>> Thanks that is also quite useful.
> >> > > >>>
> >> > > >>> For my above use case, I just need to get the children
of a
> >> > particular
> >> > > >>> znode.. And that's what will be happening from all the
600
> >> > application
> >> > > >>> machines..
> >> > > >>>
> >> > > >>> From the wiki you provided, it looks it should be fine
right?
> >> > > >>>
> >> > > >>>
> >> > > >>> On Tue, Mar 25, 2014 at 10:13 PM, Rakesh R <rakeshr@huawei.com>
> >> > wrote:
> >> > > >>>
> >> > > >>> >
> >> > > >>> > Please go through the below one, hope it will be
helpful to
> you.
> >> > > Also,
> >> > > >>> > I would recommend to have a look at the basic zk
> configurations
> >> > too.
> >> > > >>> > All the
> >> > > >>> > best:)
> >> > > >>> >
> >> > > >>> >
> >> > > >>> >
> >> > >
> https://cwiki.apache.org/confluence/display/ZOOKEEPER/ServiceLatencyOv
> >> > > >>> > erview
> >> > > >>> >
> >> > > >>> >
> >> > > >>> > What client operations(for ex: simply creating many
znodes,
> >> > deleting,
> >> > > >>> > setwatches et.) you are planning to perform.
> >> > > >>> > Actually I'd like to know what each zkclient will
be doing.
> >> > > >>> >
> >> > > >>> > -Rakesh
> >> > > >>> >
> >> > > >>> > -----Original Message-----
> >> > > >>> > From: Check Peck [mailto:comptechgeeky@gmail.com]
> >> > > >>> > Sent: 26 March 2014 09:40
> >> > > >>> > To: user
> >> > > >>> > Subject: Re: Load on Zookeeper cluster?
> >> > > >>> >
> >> > > >>> > On Tue, Mar 25, 2014 at 9:00 PM, Raúl Gutiérrez
Segalés <
> >> > > >>> > rgs@itevenworks.net
> >> > > >>> > > wrote:
> >> > > >>> >
> >> > > >>> > > 1 ZK se
> >> > > >>> >
> >> > > >>> >
> >> > > >>> >
> >> > > >>> > Yes one ZK session per application. Zookeeper version
I am
> >> running
> >> > > >>> > currently is 3.4.5 in production.
> >> > > >>> >
> >> > > >>>
> >> > > >>
> >> > > >>
> >> > >
> >> >
> >>
> >>
> >>
> >> --
> >> Regards-
> >> Pavan
> >>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message