samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yi Pan <nickpa...@gmail.com>
Subject Re: Connection timed out error while installing "Hello Samza"
Date Thu, 14 Sep 2017 22:41:49 GMT
P.S., the attachment you post w/ the previous email does not show up
(Apache mailing list disallow attachments). If would be better if you send
the command line outputs in pure text or html format.

-Yi

On Thu, Sep 14, 2017 at 3:34 PM, Yi Pan <nickpan47@gmail.com> wrote:

> Hi, Anantharaman,
>
> A lot of firewall setup prevents "incoming connections", not "outgoing
> connections" from a box. I.e. if you are downloading files, you are
> establishing outgoing connections and it is fine. When you are hosting a
> server (i.e. ZooKeeper or Kafka), you are making an "incoming connections"
> to the box and will trigger the firewall rules.
>
> Just trying to pin down the problem, could you try on a Linux box w/o any
> firewall rules setup and see whether that works? At least, verify that
> localhost resolves to 127.0.0.1 and try telnet locahost 9092 or 2181?
>
> NOTE: Success in ping simply means that you can access via ICMP, not
> guarantee you can establish TCP connection to the ports via firewall rules.
>
> -Yi
>
> On Thu, Sep 14, 2017 at 12:33 PM, Anantharaman, Srinatha (Contractor) <
> Srinatha_Anantharaman@comcast.com> wrote:
>
>> That is a good catch Naveena the server which I am trying to install is
>> an Hadoop edge node, it has kafka broker and Zookeeper client already
>> installed for my Hadoop
>> Does it matter If I am installing it on a separate folder?. My guess Even
>> if there are conflicts on earlier installations it should throw some other
>> error but not the connection time out
>>
>> Coming to your question " it could either related resolving "localhost"
>> or firewall that prevents communication between ports" - how to prove it is
>> because of Firewall issue. I am able to clone Samza files from Apache git.
>> I can download any external files on this server
>>
>> ~Sri
>>
>> -----Original Message-----
>> From: Navina Ramesh [mailto:nramesh@linkedin.com]
>> Sent: Thursday, September 14, 2017 2:51 PM
>> To: dev@samza.apache.org
>> Subject: Re: Connection timed out error while installing "Hello Samza"
>>
>> I wonder if this has anything to do with previous kafka / zookeeper
>> installed on your box. Just for sanity, try clearing /tmp/zookeeeper* and
>> /tmp/kafka* before re-trying those steps.
>>
>>
>> Same as Yi, I strongly suspect issues with your local laptop setup - it
>> could either related resolving "localhost" or firewall that prevents
>> communication between ports.
>>
>>
>> Navina
>>
>> ________________________________
>> From: Yi Pan <nickpan47@gmail.com>
>> Sent: Thursday, September 14, 2017 11:37:46 AM
>> To: dev@samza.apache.org
>> Subject: Re: Connection timed out error while installing "Hello Samza"
>>
>> Hi, Anantharaman,
>>
>> I just did the same steps as you described in your email and all passed
>> on my box. Hence, I strongly suspect that it is related to your local
>> laptop network setup.
>>
>> Could you post all the command line output when you ran the sequence of
>> commands?
>>
>> -Yi
>>
>> On Thu, Sep 14, 2017 at 11:21 AM, Yi Pan <nickpan47@gmail.com> wrote:
>>
>> > Hi, Ananarath,
>> >
>> > It is very strange that you are seeing this timeout exception that we
>> > do not see. I am trying to follow the exact steps you did to see
>> > whether there is anything broken. I will update you this afternoon.
>> >
>> > Meanwhile, could you check your hostname setup and firewall
>> > configuration to see whether your local laptop has blocked access via
>> > the public IP address to your laptop? Could you verify that your
>> > localhost is resolved to
>> > 127.0.0.1 and is accessible?
>> >
>> > -Yi
>> >
>> > On Thu, Sep 14, 2017 at 11:18 AM, Anantharaman, Srinatha (Contractor)
>> > < Srinatha_Anantharaman@comcast.com> wrote:
>> >
>> >> Yi,
>> >>
>> >> Is there any alternate way to install Samza  Or solution to the
>> >> connection time out error?
>> >>
>> >> Regards,
>> >> ~Sri
>> >>
>> >> From: Anantharaman, Srinatha (Contractor)
>> >> Sent: Wednesday, September 13, 2017 11:37 AM
>> >> To: dev@samza.apache.org
>> >> Subject: RE: Connection timed out error while installing "Hello Samza"
>> >>
>> >>
>> >> Yi,
>> >>
>> >>
>> >>
>> >> I am trying to build Samza locally by following the steps provided by
>> >> Navina.
>> >>
>> >> As per those steps kafka will be installed after Zookeeper, I am
>> >> getting Error while starting Zookeeper after it is installed
>> >>
>> >>
>> >>
>> >>
>> >>
>> >> Steps Followed :
>> >>
>> >>
>> >>
>> >> Yes. You can clone apache/samza locally and build it with:
>> >>
>> >>
>> >>
>> >>
>> >>
>> >> cd <samza-workspace>
>> >>
>> >>
>> >>
>> >> gradle -b bootstrap.gradle
>> >>
>> >>
>> >>
>> >> ./gradlew clean build -x test
>> >>
>> >>
>> >>
>> >> ./gradlew publishToMavenLocal    ## This publishes a snapshot version
>> of
>> >> the latest apache/samza into your local maven repo
>> >>
>> >>
>> >>
>> >>
>> >>
>> >> Then, head to hello-samza workspace and build again:
>> >>
>> >>
>> >>
>> >> cd <hello-samza-workspace>
>> >>
>> >>
>> >>
>> >> mvn clean package  ## This should create a build target
>> >>
>> >>
>> >>
>> >> ./bin/grid install zookeeper
>> >>
>> >>
>> >>
>> >> ./bin/grid start zookeeper
>> >>
>> >>
>> >>
>> >> ./bin/grid install kafka
>> >>
>> >>
>> >>
>> >> ./bin/grid start kafka
>> >>
>> >>
>> >>
>> >> ./bin/grid install yarn
>> >>
>> >>
>> >>
>> >> ./bin/grid start yarn
>> >>
>> >>
>> >>
>> >>
>> >>
>> >> mkdir -p deploy/samza
>> >>
>> >>
>> >>
>> >> tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C deploy/samza
>> >>
>> >>
>> >>
>> >>
>> >>
>> >> NOTE : BTW From the above steps I could not execute " gradle -b
>> >> bootstrap.gradle" since that command does not exists
>> >>
>> >>
>> >>
>> >> Regards,
>> >>
>> >> ~Sri
>> >>
>> >>
>> >>
>> >> -----Original Message-----
>> >> From: Yi Pan [mailto:nickpan47@gmail.com]
>> >> Sent: Tuesday, September 12, 2017 7:13 PM
>> >> To: dev@samza.apache.org<mailto:dev@samza.apache.org>
>> >> Subject: Re: Connection timed out error while installing "Hello Samza"
>> >>
>> >>
>> >>
>> >> Hi, Anantharam,
>> >>
>> >>
>> >>
>> >> Could you confirm at which step your setup failed? It seems that your
>> >> zookeeper server is running. Could you check to see whether your
>> >> Kafka broker is running? You can either do a telnet localhost 9092 or
>> >> do a ps auxww | grep kafka to see whether you got any broker running.
>> >>
>> >>
>> >>
>> >> Sometimes, the Kafka service takes time to start on a single laptop.
>> >> You can just try to run ./bin/grid start kafka
>> >>
>> >>
>> >>
>> >> again to see whether the service is up.
>> >>
>> >>
>> >>
>> >> Thanks!
>> >>
>> >>
>> >>
>> >> -Yi
>> >>
>> >>
>> >>
>> >> On Tue, Sep 12, 2017 at 11:38 AM, Anantharaman, Srinatha (Contractor)
>> >> < Srinatha_Anantharaman@comcast.com<mailto:Srinatha_Anantharam
>> >> an@comcast.com>> wrote:
>> >>
>> >>
>> >>
>> >> > Find below Zookeeper logs:
>> >>
>> >> >
>> >>
>> >> > 2017-09-12 17:05:19,124 [myid:] - INFO  [main:QuorumPeerConfig@101]
>> >> > -
>> >>
>> >> > Reading configuration from: /app/home/eventsvc/samza-git/
>> >>
>> >> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
>> >>
>> >> > 2017-09-12 17:05:19,133 [myid:] - INFO
>> >>
>> >> > [main:DatadirCleanupManager@78] - autopurge.snapRetainCount set to
>> >> > 3
>> >>
>> >> > 2017-09-12 17:05:19,134 [myid:] - INFO
>> >>
>> >> > [main:DatadirCleanupManager@79] - autopurge.purgeInterval set to 0
>> >>
>> >> > 2017-09-12 17:05:19,134 [myid:] - INFO
>> >>
>> >> > [main:DatadirCleanupManager@101]
>> >>
>> >> > - Purge task is not scheduled.
>> >>
>> >> > 2017-09-12 17:05:19,135 [myid:] - WARN  [main:QuorumPeerMain@113] -
>> >>
>> >> > Either no config or no quorum defined in config, running  in
>> >>
>> >> > standalone mode
>> >>
>> >> > 2017-09-12 17:05:19,161 [myid:] - INFO  [main:QuorumPeerConfig@101]
>> >> > -
>> >>
>> >> > Reading configuration from: /app/home/eventsvc/samza-git/
>> >>
>> >> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
>> >>
>> >> > 2017-09-12 17:05:19,162 [myid:] - INFO
>> >> > [main:ZooKeeperServerMain@95]
>> >>
>> >> > - Starting server
>> >>
>> >> > 2017-09-12 17:05:19,175 [myid:] - INFO  [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012
>> >> > 10:48
>> >>
>> >> > GMT
>> >>
>> >> > 2017-09-12 17:05:19,176 [myid:] - INFO  [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:host.name=codehdplak-po-r19p.sys.comcast.net
>> >>
>> >> > 2017-09-12 17:05:19,176 [myid:] - INFO  [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:java.version=1.8.0_31
>> >>
>> >> > 2017-09-12 17:05:19,177 [myid:] - INFO  [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:java.vendor=Oracle Corporation
>> >>
>> >> > 2017-09-12 17:05:19,177 [myid:] - INFO  [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.
>> >>
>> >> > 8.0.31-2.b13.el7.x86_64/jre
>> >>
>> >> > 2017-09-12 17:05:19,178 [myid:] - INFO  [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:java.class.path=/app/home/eventsvc/samza-git/
>> >>
>> >> > hello-samza/deploy/zookeeper/bin/../build/classes:/app/
>> >>
>> >> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
>> >>
>> >> > build/lib/*.jar:/app/home/eventsvc/samza-git/hello-
>> >>
>> >> > samza/deploy/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/
>> >>
>> >> > app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
>> >>
>> >> > bin/../lib/slf4j-api-1.6.1.jar:/app/home/eventsvc/samza-
>> >>
>> >> > git/hello-samza/deploy/zookeeper/bin/../lib/netty-3.
>> >>
>> >> > 2.2.Final.jar:/app/home/eventsvc/samza-git/hello-
>> >>
>> >> > samza/deploy/zookeeper/bin/../lib/log4j-1.2.15.jar:/app/
>> >>
>> >> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
>> >>
>> >> > lib/jline-0.9.94.jar:/app/home/eventsvc/samza-git/hello-
>> >>
>> >> > samza/deploy/zookeeper/bin/../zookeeper-3.4.3.jar:/app/home/
>> >>
>> >> > eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
>> >>
>> >> > src/java/lib/*.jar:/app/home/eventsvc/samza-git/hello-
>> >>
>> >> > samza/deploy/zookeeper/bin/../conf:
>> >>
>> >> > 2017-09-12 17:05:19,178 [myid:] - INFO  [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:java.library.path=/usr/java/packages/lib/amd64:/
>> >>
>> >> > usr/lib64:/lib64:/lib:/usr/lib
>> >>
>> >> > 2017-09-12 17:05:19,179 [myid:] - INFO  [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:java.io.tmpdir=/tmp
>> >>
>> >> > 2017-09-12 17:05:19,179 [myid:] - INFO  [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:java.compiler=<NA>
>> >>
>> >> > 2017-09-12 17:05:19,180 [myid:] - INFO  [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:os.name=Linux
>> >>
>> >> > 2017-09-12 17:05:19,180 [myid:] - INFO  [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:os.arch=amd64
>> >>
>> >> > 2017-09-12 17:05:19,181 [myid:] - INFO  [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:os.version=3.10.0-123.20.1.el7.x86_64
>> >>
>> >> > 2017-09-12 17:05:19,181 [myid:] - INFO  [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:user.name=root
>> >>
>> >> > 2017-09-12 17:05:19,182 [myid:] - INFO  [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:user.home=/root
>> >>
>> >> > 2017-09-12 17:05:19,182 [myid:] - INFO  [main:Environment@98] -
>> >> > Server
>> >>
>> >> > environment:user.dir=/app/home/eventsvc/samza-git/hello-
>> >>
>> >> > samza/deploy/zookeeper
>> >>
>> >> > 2017-09-12 17:05:19,195 [myid:] - INFO  [main:ZooKeeperServer@733]
>> >> > -
>> >>
>> >> > tickTime set to 2000
>> >>
>> >> > 2017-09-12 17:05:19,195 [myid:] - INFO  [main:ZooKeeperServer@742]
>> >> > -
>> >>
>> >> > minSessionTimeout set to -1
>> >>
>> >> > 2017-09-12 17:05:19,195 [myid:] - INFO  [main:ZooKeeperServer@751]
>> >> > -
>> >>
>> >> > maxSessionTimeout set to -1
>> >>
>> >> > 2017-09-12 17:05:19,213 [myid:] - INFO
>> >>
>> >> > [main:NIOServerCnxnFactory@110] - binding to port
>> >> > 0.0.0.0/0.0.0.0:2181
>> >>
>> >> > 2017-09-12 17:05:19,240 [myid:] - INFO  [main:FileTxnSnapLog@238] -
>> >>
>> >> > Snapshotting: 0x0 to /tmp/zookeeper/version-2/snapshot.0
>> >>
>> >> > 2017-09-12 17:05:19,673 [myid:] - INFO
>> >> > [NIOServerCxn.Factory:0.0.0.0/
>> >>
>> >> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket connection
>> >>
>> >> > from
>> >>
>> >> > /0:0:0:0:0:0:0:1:21754
>> >>
>> >> > 2017-09-12 17:17:40,265 [myid:] - WARN
>> >> > [NIOServerCxn.Factory:0.0.0.0/
>> >>
>> >> > 0.0.0.0:2181:NIOServerCnxn@349] - caught end of stream exception
>> >>
>> >> > EndOfStreamException: Unable to read additional data from client
>> >>
>> >> > sessionid 0x0, likely client has closed socket
>> >>
>> >> >         at org.apache.zookeeper.server.NIOServerCnxn.doIO(
>> >>
>> >> > NIOServerCnxn.java:220)
>> >>
>> >> >         at org.apache.zookeeper.server.NIOServerCnxnFactory.run(
>> >>
>> >> > NIOServerCnxnFactory.java:224)
>> >>
>> >> >         at java.lang.Thread.run(Thread.java:745)
>> >>
>> >> > 2017-09-12 17:17:40,267 [myid:] - INFO
>> >> > [NIOServerCxn.Factory:0.0.0.0/
>> >>
>> >> > 0.0.0.0:2181:NIOServerCnxn@1000] - Closed socket connection for
>> >> > client
>> >>
>> >> > /0:0:0:0:0:0:0:1:21754 (no session established for client)
>> >>
>> >> > 2017-09-12 17:18:06,236 [myid:] - INFO
>> >> > [NIOServerCxn.Factory:0.0.0.0/
>> >>
>> >> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket connection
>> >>
>> >> > from /
>> >>
>> >> > 127.0.0.1:48071
>> >>
>> >> > 2017-09-12 17:18:06,247 [myid:] - INFO
>> >> > [NIOServerCxn.Factory:0.0.0.0/
>> >>
>> >> > 0.0.0.0:2181:ZooKeeperServer@838] - Client attempting to establish
>> >> > new
>> >>
>> >> > session at /127.0.0.1:48071
>> >>
>> >> > 2017-09-12 17:18:06,250 [myid:] - INFO
>> >> > [SyncThread:0:FileTxnLog@199]
>> >>
>> >> > - Creating new log file: log.1
>> >>
>> >> > 2017-09-12 17:18:06,263 [myid:] - INFO
>> >>
>> >> > [SyncThread:0:ZooKeeperServer@604]
>> >>
>> >> > - Established session 0x15e770d61920000 with negotiated timeout
>> >> > 6000
>> >>
>> >> > for client /127.0.0.1:48071
>> >>
>> >> > 2017-09-12 17:18:06,321 [myid:] - INFO  [ProcessThread(sid:0
>> cport:-1)::
>> >>
>> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
>> >>
>> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x5
>> >> > zxid:0x3
>> >>
>> >> > txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode =
>> >>
>> >> > NoNode for /brokers
>> >>
>> >> > 2017-09-12 17:18:06,342 [myid:] - INFO  [ProcessThread(sid:0
>> cport:-1)::
>> >>
>> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
>> >>
>> >> > processing sessionid:0x15e770d61920000 type:create cxid:0xb
>> >> > zxid:0x7
>> >>
>> >> > txntype:-1 reqpath:n/a Error Path:/config Error:KeeperErrorCode =
>> >>
>> >> > NoNode for /config
>> >>
>> >> > 2017-09-12 17:18:06,356 [myid:] - INFO  [ProcessThread(sid:0
>> cport:-1)::
>> >>
>> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
>> >>
>> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x13
>> >> > zxid:0xc
>> >>
>> >> > txntype:-1 reqpath:n/a Error Path:/admin Error:KeeperErrorCode =
>> >>
>> >> > NoNode for /admin
>> >>
>> >> > 2017-09-12 17:18:06,457 [myid:] - INFO  [ProcessThread(sid:0
>> cport:-1)::
>> >>
>> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
>> >>
>> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x1b
>> >> > zxid:0x11
>> >>
>> >> > txntype:-1 reqpath:n/a Error Path:/cluster Error:KeeperErrorCode =
>> >>
>> >> > NoNode for /cluster
>> >>
>> >> > 2017-09-12 17:18:06,973 [myid:] - INFO  [ProcessThread(sid:0
>> cport:-1)::
>> >>
>> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
>> >>
>> >> > processing sessionid:0x15e770d61920000 type:setData cxid:0x25
>> >>
>> >> > zxid:0x15
>> >>
>> >> > txntype:-1 reqpath:n/a Error Path:/controller_epoch
>> >>
>> >> > Error:KeeperErrorCode = NoNode for /controller_epoch
>> >>
>> >> > 2017-09-12 17:18:07,050 [myid:] - INFO  [ProcessThread(sid:0
>> cport:-1)::
>> >>
>> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
>> >>
>> >> > processing sessionid:0x15e770d61920000 type:delete cxid:0x34
>> >> > zxid:0x17
>> >>
>> >> > txntype:-1 reqpath:n/a Error Path:/admin/preferred_replica_election
>> >>
>> >> > Error:KeeperErrorCode = NoNode for
>> >> > /admin/preferred_replica_election
>> >>
>> >> > 2017-09-12 17:18:07,288 [myid:] - INFO  [ProcessThread(sid:0
>> cport:-1)::
>> >>
>> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
>> >>
>> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x3f
>> >> > zxid:0x18
>> >>
>> >> > txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode =
>> >>
>> >> > NodeExists for /brokers
>> >>
>> >> > 2017-09-12 17:18:07,290 [myid:] - INFO  [ProcessThread(sid:0
>> cport:-1)::
>> >>
>> >> > PrepRequestProcessor@617] - Got user-level KeeperException when
>> >>
>> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x40
>> >> > zxid:0x19
>> >>
>> >> > txntype:-1 reqpath:n/a Error Path:/brokers/ids
>> >> > Error:KeeperErrorCode =
>> >>
>> >> > NodeExists for /brokers/ids
>> >>
>> >> >
>> >>
>> >> >
>> >>
>> >> >
>> >>
>> >> > -----Original Message-----
>> >>
>> >> > From: Yi Pan [mailto:nickpan47@gmail.com]
>> >>
>> >> > Sent: Tuesday, September 12, 2017 2:02 PM
>> >>
>> >> > To: dev@samza.apache.org<mailto:dev@samza.apache.org>
>> >>
>> >> > Subject: Re: Connection timed out error while installing "Hello
>> Samza"
>> >>
>> >> >
>> >>
>> >> > Hi, Anantharaman,
>> >>
>> >> >
>> >>
>> >> > Could you post your zookeeper startup logs here?
>> >>
>> >> >
>> >>
>> >> > On Tue, Sep 12, 2017 at 10:21 AM, Anantharaman, Srinatha
>> >> > (Contractor)
>> >>
>> >> > < Srinatha_Anantharaman@comcast.com<mailto:Srinatha_Anantharam
>> >> an@comcast.com>> wrote:
>> >>
>> >> >
>> >>
>> >> > > It hangs while bringing up the service
>> >>
>> >> > >
>> >>
>> >> > > [root@codehdplak-po-r19p hello-samza]# pwd
>> >>
>> >> > > /app/home/eventsvc/samza-git/hello-samza
>> >>
>> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install
>> >> > > zookeeper
>> >>
>> >> > > EXECUTING: install zookeeper
>> >>
>> >> > > Using previously downloaded file /root/.samza/download/
>> >>
>> >> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p hello-samza]#
>> >>
>> >> > > ./bin/grid start zookeeper
>> >>
>> >> > > EXECUTING: start zookeeper
>> >>
>> >> > > JMX enabled by default
>> >>
>> >> > > Using config:
>> >>
>> >> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
>> >>
>> >> > > bin/../conf/zoo.cfg
>> >>
>> >> > > Starting zookeeper ... STARTED
>> >>
>> >> > > Waiting for zookeeper to start...
>> >>
>> >> > >
>> >>
>> >> > > ^C
>> >>
>> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start
>> >> > > zookeeper^C
>> >>
>> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install kafka
>> >>
>> >> > > EXECUTING: install kafka
>> >>
>> >> > > Using previously downloaded file /root/.samza/download/kafka_2.
>> >>
>> >> > > 11-0.10.1.1.tgz
>> >>
>> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start kafka
>> >>
>> >> > > EXECUTING: start kafka
>> >>
>> >> > > Waiting for kafka to start...
>> >>
>> >> > > Ncat: Connection refused.
>> >>
>> >> > > .Ncat: Connection refused.
>> >>
>> >> > > .Ncat: Connection refused.
>> >>
>> >> > > .^C
>> >>
>> >> > > [root@codehdplak-po-r19p hello-samza]#
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > -----Original Message-----
>> >>
>> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
>> >>
>> >> > > Sent: Tuesday, September 12, 2017 12:43 PM
>> >>
>> >> > > To: dev@samza.apache.org<mailto:dev@samza.apache.org>
>> >>
>> >> > > Subject: Re: Connection timed out error while installing "Hello
>> Samza"
>> >>
>> >> > >
>> >>
>> >> > > Yes. You can clone apache/samza locally and build it with:
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > cd <samza-workspace>
>> >>
>> >> > >
>> >>
>> >> > > gradle -b bootstrap.gradle
>> >>
>> >> > >
>> >>
>> >> > > ./gradlew clean build -x test
>> >>
>> >> > >
>> >>
>> >> > > ./gradlew publishToMavenLocal    ## This publishes a snapshot
>> version
>> >> of
>> >>
>> >> > > the latest apache/samza into your local maven repo
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > Then, head to hello-samza workspace and build again:
>> >>
>> >> > >
>> >>
>> >> > > cd <hello-samza-workspace>
>> >>
>> >> > >
>> >>
>> >> > > mvn clean package  ## This should create a build target
>> >>
>> >> > >
>> >>
>> >> > > ./bin/grid install zookeeper
>> >>
>> >> > >
>> >>
>> >> > > ./bin/grid start zookeeper
>> >>
>> >> > >
>> >>
>> >> > > ./bin/grid install kafka
>> >>
>> >> > >
>> >>
>> >> > > ./bin/grid start kafka
>> >>
>> >> > >
>> >>
>> >> > > ./bin/grid install yarn
>> >>
>> >> > >
>> >>
>> >> > > ./bin/grid start yarn
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > mkdir -p deploy/samza
>> >>
>> >> > >
>> >>
>> >> > > tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C
>> >> > > deploy/samza
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > After this, you can follow steps in the tutorial to "Run" the
>> >>
>> >> > > example Samza job.
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > HTH! Let me know if you need further help.
>> >>
>> >> > >
>> >>
>> >> > > Navina
>> >>
>> >> > >
>> >>
>> >> > > ________________________________
>> >>
>> >> > > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
>> >>
>> >> > > comcast.com>
>> >>
>> >> > > Sent: Tuesday, September 12, 2017 9:21:53 AM
>> >>
>> >> > > To: dev@samza.apache.org<mailto:dev@samza.apache.org>
>> >>
>> >> > > Subject: RE: Connection timed out error while installing "Hello
>> Samza"
>> >>
>> >> > >
>> >>
>> >> > > Navina,
>> >>
>> >> > >
>> >>
>> >> > > Is there any other way we can install Hello Samza?
>> >>
>> >> > >
>> >>
>> >> > > Regards,
>> >>
>> >> > > ~Sri
>> >>
>> >> > >
>> >>
>> >> > > -----Original Message-----
>> >>
>> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
>> >>
>> >> > > Sent: Tuesday, September 12, 2017 11:42 AM
>> >>
>> >> > > To: dev@samza.apache.org<mailto:dev@samza.apache.org>
>> >>
>> >> > > Subject: Re: Connection timed out error while installing "Hello
>> Samza"
>> >>
>> >> > >
>> >>
>> >> > > Ok. I tried again for the "latest" branch in hello-samza and it
>> >>
>> >> > > still works.
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > > While installing it says "Building samza from master..."
>> >>
>> >> > >
>> >>
>> >> > > It is expected to build from "master" in apache/samza repo. So,
>> >> > > the
>> >>
>> >> > > output line is expected.
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > It is weird that you are unable to connect. Is it possible you
>> >> > > are
>> >>
>> >> > > behind a firewall or something? Can you try to ping "
>> git.apache.org"
>> >> ?
>> >>
>> >> > > Or try the setup on a different box?
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > Navina
>> >>
>> >> > >
>> >>
>> >> > > ________________________________
>> >>
>> >> > > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
>> >>
>> >> > > comcast.com>
>> >>
>> >> > > Sent: Tuesday, September 12, 2017 8:33:30 AM
>> >>
>> >> > > To: dev@samza.apache.org<mailto:dev@samza.apache.org>
>> >>
>> >> > > Subject: RE: Connection timed out error while installing "Hello
>> Samza"
>> >>
>> >> > >
>> >>
>> >> > > Navina,
>> >>
>> >> > >
>> >>
>> >> > > I tried again but still same error
>> >>
>> >> > >
>> >>
>> >> > > While installing it says "Building samza from master..."
>> >>
>> >> > >
>> >>
>> >> > > But when after I cloned I executed " git checkout latest"
>> >>
>> >> > >
>> >>
>> >> > > Regards,
>> >>
>> >> > > ~Sri
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > -----Original Message-----
>> >>
>> >> > > From: Navina Ramesh [mailto:nramesh@linkedin.com]
>> >>
>> >> > > Sent: Tuesday, September 12, 2017 11:10 AM
>> >>
>> >> > > To: dev@samza.apache.org<mailto:dev@samza.apache.org>
>> >>
>> >> > > Subject: Re: Connection timed out error while installing "Hello
>> Samza"
>> >>
>> >> > >
>> >>
>> >> > > Hi Anantharaman,
>> >>
>> >> > >
>> >>
>> >> > > It looks like a transient connection failure to connect to
>> >> > > Apache's
>> >>
>> >> > > git. I tried on my host and it seems to be working.
>> >>
>> >> > >
>> >>
>> >> > > Can you give it another shot?
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > If it still doesn't work, please let me know if you are running
>> >> > > the
>> >>
>> >> > > command under the "master" or "latest" branch of samza-hello-samza.
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > Thanks!
>> >>
>> >> > >
>> >>
>> >> > > Navina
>> >>
>> >> > >
>> >>
>> >> > > ________________________________
>> >>
>> >> > > From: Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@
>> >>
>> >> > > comcast.com>
>> >>
>> >> > > Sent: Tuesday, September 12, 2017 7:45:37 AM
>> >>
>> >> > > To: dev@samza.apache.org<mailto:dev@samza.apache.org>
>> >>
>> >> > > Subject: Connection timed out error while installing "Hello Samza"
>> >>
>> >> > >
>> >>
>> >> > > Hi,
>> >>
>> >> > >
>> >>
>> >> > > I am trying to install "Hello Samza" on a single node Initially
I
>> >>
>> >> > > have installed Kafka, Yarn and Zookeeper using  bin/grid install
>> >>
>> >> > > kafka/yarn/zookeeper When I am trying bin/grid bootstrap getting
>> >>
>> >> > > connection timed out error It also mentions no kafka, yarn and
>> >>
>> >> > > zookeeper installed
>> >>
>> >> > >
>> >>
>> >> > > Please find below the error message
>> >>
>> >> > >
>> >>
>> >> > > [root@codehdplak-po-r19p bin]# cd ..
>> >>
>> >> > > [root@codehdplak-po-r19p hello-samza]#  bin/grid install kafka
>> >>
>> >> > > EXECUTING: install kafka
>> >>
>> >> > > Using previously downloaded file /root/.samza/download/kafka_2.
>> >>
>> >> > > 11-0.10.1.1.tgz
>> >>
>> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install yarn
>> >>
>> >> > > EXECUTING: install yarn
>> >>
>> >> > > Using previously downloaded file
>> >>
>> >> > > /root/.samza/download/hadoop-2.6.1.tar.gz
>> >>
>> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install zookeeper
>> >>
>> >> > > EXECUTING: install zookeeper
>> >>
>> >> > > Using previously downloaded file /root/.samza/download/
>> >>
>> >> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p hello-samza]#
>> >>
>> >> > > bin/grid bootstrap Bootstrapping the system...
>> >>
>> >> > > EXECUTING: stop kafka
>> >>
>> >> > > No kafka server to stop
>> >>
>> >> > > EXECUTING: stop yarn
>> >>
>> >> > > no resourcemanager to stop
>> >>
>> >> > > no nodemanager to stop
>> >>
>> >> > > EXECUTING: stop zookeeper
>> >>
>> >> > > JMX enabled by default
>> >>
>> >> > > Using config:
>> >>
>> >> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
>> >>
>> >> > > bin/../conf/zoo.cfg
>> >>
>> >> > > Stopping zookeeper ... no zookeeper to stop (could not find file
>> >>
>> >> > > /tmp/zookeeper/zookeeper_server.pid)
>> >>
>> >> > > EXECUTING: install samza
>> >>
>> >> > > Building samza from master...
>> >>
>> >> > > ~/.samza/download /app/home/eventsvc/samza-git/hello-samza
>> >>
>> >> > > Cloning into 'samza'...
>> >>
>> >> > > fatal: unable to connect to git.apache.org:
>> >>
>> >> > > git.apache.org[0: 54.84.58.65]: errno=Connection timed out
>> >>
>> >> > >
>> >>
>> >> > >
>> >>
>> >> > > Could you please help me to resolve this issue?
>> >>
>> >> > >
>> >>
>> >> > > Regards,
>> >>
>> >> > > ~Sri
>> >>
>> >> > >
>> >>
>> >> >
>> >>
>> >
>> >
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message