zookeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Check Peck <comptechge...@gmail.com>
Subject Re: Load on Zookeeper cluster?
Date Tue, 08 Apr 2014 04:10:52 GMT
I manually copied the jar file into the directory it was trying to copy.
Now if I do "ant", then I see like this -

check@phx5tg03c-cfc7:~/zooksmoketest/zookeeper-3.4.6$ ant
Buildfile: /home/check/zooksmoketest/zookeeper-3.4.6/build.xml

init:

ivy-download:

ivy-taskdef:

ivy-init:

ivy-retrieve:
[ivy:retrieve] :: Ivy 2.2.0 - 20100923230623 :: http://ant.apache.org/ivy/::
[ivy:retrieve] :: loading settings :: file =
/home/check/zooksmoketest/zookeeper-3.4.6/ivysettings.xml
[ivy:retrieve] :: resolving dependencies ::
org.apache.zookeeper#zookeeper;3.4.6
[ivy:retrieve]  confs: [default]


And then after this, it doesn't move further, I waited for  a long time and
nothing came up.. And afterwards I did ctrl + c to break.

Any idea what might be wrong?



On Mon, Apr 7, 2014 at 8:42 PM, Michi Mutsuzaki <michi@cs.stanford.edu>wrote:

> You probably need to set the proxy.
>
> http://ant.apache.org/manual/proxy.html
>
> On Mon, Apr 7, 2014 at 8:40 PM, Check Peck <comptechgeeky@gmail.com>
> wrote:
> > Thanks a lot Michi. Appreciated  your help.. I tried your suggestion on
> one
> > of my production box but when I tried "fifth" step which is "ant". I got
> an
> > error as shown below. Any thoughts what is wrong? I guess firewall is
> > blocking. Is there any other way around for this? I manually copied
> > "zookeeper-3.4.6.tar.gz" into that machine using "scp" as well.
> > check@phx5tg03c-cfc7:~/zooksmoketest/zookeeper-3.4.6$ ant
> > Buildfile: /home/check/zooksmoketest/zookeeper-3.4.6/build.xml
> >
> > init:
> >
> > ivy-download:
> >       [get] Getting:
> > http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.2.0/ivy-2.2.0.jar
> >       [get] To:
> > /home/check/zooksmoketest/zookeeper-3.4.6/src/java/lib/ivy-2.2.0.jar
> >       [get] Error getting
> > http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.2.0/ivy-2.2.0.jar to
> > /home/check/zooksmoketest/zookeeper-3.4.6/src/java/lib/ivy-2.2.0.jar
> >
> > BUILD FAILED
> > /home/check/zooksmoketest/zookeeper-3.4.6/build.xml:348:
> > java.net.ConnectException: Connection timed out
> >         at java.net.PlainSocketImpl.socketConnect(Native Method)
> >         at
> >
> java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:327)
> >         at
> >
> java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:193)
> >         at
> >
> java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:180)
> >         at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:384)
> >         at java.net.Socket.connect(Socket.java:546)
> >         at java.net.Socket.connect(Socket.java:495)
> >         at sun.net.NetworkClient.doConnect(NetworkClient.java:178)
> >         at sun.net.www.http.HttpClient.openServer(HttpClient.java:409)
> >         at sun.net.www.http.HttpClient.openServer(HttpClient.java:530)
> >         at sun.net.www.http.HttpClient.<init>(HttpClient.java:240)
> >         at sun.net.www.http.HttpClient.New(HttpClient.java:321)
> >         at sun.net.www.http.HttpClient.New(HttpClient.java:338)
> >         at
> >
> sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:935)
> >         at
> >
> sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:876)
> >         at
> >
> sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:801)
> >         at
> > org.apache.tools.ant.taskdefs.Get$GetThread.openConnection(Get.java:660)
> >         at org.apache.tools.ant.taskdefs.Get$GetThread.get(Get.java:579)
> >         at org.apache.tools.ant.taskdefs.Get$GetThread.run(Get.java:569)
> >
> > Total time: 1 minute 3 seconds
> >
> >
> >
> > On Mon, Apr 7, 2014 at 3:08 PM, Michi Mutsuzaki <michi@cs.stanford.edu>
> > wrote:
> >>
> >> Hi Check,
> >>
> >> Something like this should work on ubuntu.
> >>
> >> https://paste.apache.org/6kao?action=download
> >>
> >>
> >> On Sun, Apr 6, 2014 at 11:11 PM, Check Peck <comptechgeeky@gmail.com>
> >> wrote:
> >> > I am not sure from where to start to install zkpython.. I tried
> >> > following
> >> > that github link but was not able to understand. If you can guide me
> >> > what I
> >> > am supposed to do step by step, then it will be of great help to me.
> >> > Thanks.
> >> >
> >> >
> >> > On Sun, Apr 6, 2014 at 10:57 PM, Pavan Sudheendra
> >> > <pavan0591@gmail.com>wrote:
> >> >
> >> >> Hi Check,
> >> >>
> >> >> Where are you getting stuck?
> >> >>
> >> >>
> >> >> On Mon, Apr 7, 2014 at 11:13 AM, Check Peck <comptechgeeky@gmail.com
> >
> >> >> wrote:
> >> >>
> >> >> > Thanks. I tried going through that github link but wasn't able
to
> >> >> > understand what I am supposed to do clearly. May be I am not that
> >> >> > much
> >> >> > familiar with Python so that's why I am having hard time figuring
> >> >> > that
> >> >> out?
> >> >> >
> >> >> >
> >> >> > On Sun, Apr 6, 2014 at 10:06 PM, Michi Mutsuzaki
> >> >> > <michi@cs.stanford.edu
> >> >> > >wrote:
> >> >> >
> >> >> > > You need to install zkpython. The steps are described in
the
> README
> >> >> > > file. Let us know if you have trouble installing zkpython.
> >> >> > >
> >> >> > >
> >> >> >
> >> >>
> >> >>
> https://github.com/apache/zookeeper/blob/trunk/src/contrib/zkpython/README
> >> >> > >
> >> >> > > On Sun, Apr 6, 2014 at 9:21 PM, Check Peck
> >> >> > > <comptechgeeky@gmail.com>
> >> >> > > wrote:
> >> >> > > > I tried following the steps mentioned on this github
link -
> >> >> > > > https://github.com/phunt/zk-smoketest for zk-latencies.py.
> >> >> > > >
> >> >> > > > I have 3 node ZK cluster-  machineA, machineB, machineC
> >> >> > > >
> >> >> > > > Now I copied the Python program zk-latencies.py and
zkclient.py
> >> >> > > > in
> >> >> > > another
> >> >> > > > machineD in which no zookeeper is running. It's a plain
ubuntu
> >> >> > > > box.
> >> >> > > >
> >> >> > > > Now when I ran the program like this -
> >> >> > > >
> >> >> > > > david@machineD:~/zooksmoketest$ ./zk-latencies.py --servers
> >> >> > > > "machineA:2181,machineB::2181,machineC:2181" --znode_count=100
> >> >> > > > --znode_size=100 --synchronous
> >> >> > > > Traceback (most recent call last):
> >> >> > > >   File "./zk-latencies.py", line 22, in <module>
> >> >> > > >     import zkclient
> >> >> > > >   File "/home/david/zooksmoketest/zkclient.py", line
17, in
> >> >> > > > <module>
> >> >> > > >     import zookeeper, time, threading
> >> >> > > >
> >> >> > > > *ImportError: No module named zookeeper*
> >> >> > > >
> >> >> > > > I got an error as shown above. Any thoughts what wrong
I am
> doing
> >> >> > here? I
> >> >> > > > don't have that much experience with Python. Any suggestions
> will
> >> >> > > > be
> >> >> of
> >> >> > > > great help.
> >> >> > > >
> >> >> > > > @Raul: Any thoughts?
> >> >> > > >
> >> >> > > >
> >> >> > > >
> >> >> > > > On Sun, Apr 6, 2014 at 6:46 PM, Check Peck
> >> >> > > > <comptechgeeky@gmail.com>
> >> >> > > wrote:
> >> >> > > >
> >> >> > > >> Thanks guys.. I am going to do load test in couple
of days
> using
> >> >> > > >> the
> >> >> > > >> exiting Python framework. And I will share the results
once I
> am
> >> >> done.
> >> >> > > >>
> >> >> > > >>
> >> >> > > >> On Tue, Mar 25, 2014 at 11:19 PM, Rakesh R <
> rakeshr@huawei.com>
> >> >> > wrote:
> >> >> > > >>
> >> >> > > >>>
> >> >> > > >>> If I understood the case correctly,
> >> >> > > >>> Test :- 3 node ZK cluster, 600 sessions each
will do one read
> >> >> > > >>> operation(getChildren call) every one minute.
> >> >> > > >>>
> >> >> > > >>> I'm assuming the calls are equally distributed
in time frame
> >> >> > > >>> and it
> >> >> > > would
> >> >> > > >>> be like : 600ops/60secs, average 10 ops/sec
will go to 3 node
> >> >> cluster
> >> >> > > >>> I also feel it should be, also it would be great
if you
> publish
> >> >> > > >>> the
> >> >> > > >>> results after your tests.
> >> >> > > >>>
> >> >> > > >>>
> >> >> > > >>> -Rakesh
> >> >> > > >>>
> >> >> > > >>> -----Original Message-----
> >> >> > > >>> From: Check Peck [mailto:comptechgeeky@gmail.com]
> >> >> > > >>> Sent: 26 March 2014 11:19
> >> >> > > >>> To: user
> >> >> > > >>> Subject: Re: Load on Zookeeper cluster?
> >> >> > > >>>
> >> >> > > >>> Thanks that is also quite useful.
> >> >> > > >>>
> >> >> > > >>> For my above use case, I just need to get the
children of a
> >> >> > particular
> >> >> > > >>> znode.. And that's what will be happening from
all the 600
> >> >> > application
> >> >> > > >>> machines..
> >> >> > > >>>
> >> >> > > >>> From the wiki you provided, it looks it should
be fine right?
> >> >> > > >>>
> >> >> > > >>>
> >> >> > > >>> On Tue, Mar 25, 2014 at 10:13 PM, Rakesh R <
> rakeshr@huawei.com>
> >> >> > wrote:
> >> >> > > >>>
> >> >> > > >>> >
> >> >> > > >>> > Please go through the below one, hope it
will be helpful to
> >> >> > > >>> > you.
> >> >> > > Also,
> >> >> > > >>> > I would recommend to have a look at the
basic zk
> >> >> > > >>> > configurations
> >> >> > too.
> >> >> > > >>> > All the
> >> >> > > >>> > best:)
> >> >> > > >>> >
> >> >> > > >>> >
> >> >> > > >>> >
> >> >> > >
> >> >> > >
> https://cwiki.apache.org/confluence/display/ZOOKEEPER/ServiceLatencyOv
> >> >> > > >>> > erview
> >> >> > > >>> >
> >> >> > > >>> >
> >> >> > > >>> > What client operations(for ex: simply creating
many znodes,
> >> >> > deleting,
> >> >> > > >>> > setwatches et.) you are planning to perform.
> >> >> > > >>> > Actually I'd like to know what each zkclient
will be doing.
> >> >> > > >>> >
> >> >> > > >>> > -Rakesh
> >> >> > > >>> >
> >> >> > > >>> > -----Original Message-----
> >> >> > > >>> > From: Check Peck [mailto:comptechgeeky@gmail.com]
> >> >> > > >>> > Sent: 26 March 2014 09:40
> >> >> > > >>> > To: user
> >> >> > > >>> > Subject: Re: Load on Zookeeper cluster?
> >> >> > > >>> >
> >> >> > > >>> > On Tue, Mar 25, 2014 at 9:00 PM, Raúl
Gutiérrez Segalés <
> >> >> > > >>> > rgs@itevenworks.net
> >> >> > > >>> > > wrote:
> >> >> > > >>> >
> >> >> > > >>> > > 1 ZK se
> >> >> > > >>> >
> >> >> > > >>> >
> >> >> > > >>> >
> >> >> > > >>> > Yes one ZK session per application. Zookeeper
version I am
> >> >> running
> >> >> > > >>> > currently is 3.4.5 in production.
> >> >> > > >>> >
> >> >> > > >>>
> >> >> > > >>
> >> >> > > >>
> >> >> > >
> >> >> >
> >> >>
> >> >>
> >> >>
> >> >> --
> >> >> Regards-
> >> >> Pavan
> >> >>
> >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message