zookeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Paul <netwarrior...@gmail.com>
Subject ZooKeeper and HA
Date Fri, 26 Feb 2016 13:05:45 GMT
Hi there guys,
I'm new to hadoop and I'm trying con setup HA in CDH 5.5.1, I've already
configured ( from the admin console )  yarn and HDFS in HA, now the last
service to configue is zookeeper, when I try to enable it,  I get the
following.

Failed to initialize High Availability state in ZooKeeper for Nameservice
HA-HDFS: Command Initialize Automatic Failover Znode is not currently 
available for execution because role Failover Controller (oryx2test03) must
be in state Stopped, but it is in state Started.

So I stopped the FailOver Controller and try to enable it once again and get
this.

Failed to initialize High Availability state in ZooKeeper for Nameservice
HA-HDFS: Failed to initialize High Availability state in ZooKeeper from
Failover Controller (oryx2test03): 16/02/26 09:30:10 DEBUG
zookeeper.ClientCnxn: Session establishment request sent on
oryx2test/10.10.18.80:2181
16/02/26 09:30:10 INFO zookeeper.ClientCnxn: Session establishment complete
on server oryx2test/10.10.18.80:2181, sessionid = 0x15318e91f3006b9,
negotiated timeout = 5000
16/02/26 09:30:10 DEBUG ha.ActiveStandbyElector: Created new connection for
elector id=1013939722 appData=null cb=Elector callbacks for NameNode at
oryx2test03.localhost/10.10.18.82:8022
16/02/26 09:30:10 DEBUG ha.ActiveStandbyElector: Watcher event type: None
with state:SyncConnected for path:null connectionState: TERMINATED for
elector id=1013939722 appData=null cb=Elector callbacks for NameNode at
oryx2test03.localhost/10.10.18.82:8022
16/02/26 09:30:10 INFO ha.ActiveStandbyElector: Session connected.
16/02/26 09:30:10 DEBUG zookeeper.ClientCnxn: Reading reply
sessionid:0x15318e91f3006b9, packet:: clientPath:null serverPath:null
finished:false header:: 1,3  replyHeader:: 1,38654727555,0  request::
'/hadoop-ha/HA-HDFS,F  response::
s{30065417144,30065417144,1456340890227,1456340890227,0,20,0,0,0,2,38654706980} 
16/02/26 09:30:10 DEBUG ha.ActiveStandbyElector: Terminating ZK connection
for elector id=1013939722 appData=null cb=Elector callbacks for NameNode at
oryx2test03.localhost/10.10.18.82:8022
16/02/26 09:30:10 DEBUG zookeeper.ZooKeeper: Closing session:
0x15318e91f3006b9
16/02/26 09:30:10 DEBUG zookeeper.ClientCnxn: Closing client for session:
0x15318e91f3006b9
16/02/26 09:30:10 DEBUG zookeeper.ClientCnxn: Reading reply
sessionid:0x15318e91f3006b9, packet:: clientPath:null serverPath:null
finished:false header:: 2,-11  replyHeader:: 2,38654727556,0  request:: null
response:: null
16/02/26 09:30:10 DEBUG zookeeper.ClientCnxn: Disconnecting client for
session: 0x15318e91f3006b9
16/02/26 09:30:10 INFO zookeeper.ZooKeeper: Session: 0x15318e91f3006b9
closed
16/02/26 09:30:10 INFO zookeeper.ClientCnxn: EventThread shut down


This is what I see in the logs.

2016-02-26 09:34:42,692 INFO org.apache.zookeeper.server.NIOServerCnxn:
Closed socket connection for client /10.10.18.81:55463 (no session
established for client)
2016-02-26 09:34:42,692 INFO
org.apache.zookeeper.server.NIOServerCnxnFactory: Accepted socket connection
from /10.10.18.82:51764
2016-02-26 09:34:42,692 WARN org.apache.zookeeper.server.NIOServerCnxn:
Exception causing close of session 0x0 due to java.io.EOFException
2016-02-26 09:34:42,692 DEBUG org.apache.zookeeper.server.NIOServerCnxn:
IOException stack trace
java.io.EOFException
        at java.io.DataInputStream.readFully(DataInputStream.java:197)
        at java.io.DataInputStream.readLong(DataInputStream.java:416)
        at
org.apache.jute.BinaryInputArchive.readLong(BinaryInputArchive.java:67)
        at
org.apache.zookeeper.proto.ConnectRequest.deserialize(ConnectRequest.java:87)
        at
org.apache.zookeeper.server.ZooKeeperServer.processConnectRequest(ZooKeeperServer.java:779)
        at
org.apache.zookeeper.server.NIOServerCnxn.readConnectRequest(NIOServerCnxn.java:410)
        at
org.apache.zookeeper.server.NIOServerCnxn.readPayload(NIOServerCnxn.java:200)
        at
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:236)
        at
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
        at java.lang.Thread.run(Thread.java:745)
2016-02-26 09:34:42,693 INFO org.apache.zookeeper.server.NIOServerCnxn:
Closed socket connection for client /10.10.18.82:51764 (no session
established for client)
2016-02-26 09:34:42,693 INFO
org.apache.zookeeper.server.NIOServerCnxnFactory: Accepted socket connection
from /10.10.18.81:55465
2016-02-26 09:34:42,794 WARN org.apache.zookeeper.server.NIOServerCnxn:
Exception causing close of session 0x0 due to java.io.EOFException
2016-02-26 09:34:42,794 DEBUG org.apache.zookeeper.server.NIOServerCnxn:
IOException stack trace
java.io.EOFException
        at java.io.DataInputStream.readFully(DataInputStream.java:197)
        at java.io.DataInputStream.readLong(DataInputStream.java:416)
        at
org.apache.jute.BinaryInputArchive.readLong(BinaryInputArchive.java:67)
        at
org.apache.zookeeper.proto.ConnectRequest.deserialize(ConnectRequest.java:87)
        at
org.apache.zookeeper.server.ZooKeeperServer.processConnectRequest(ZooKeeperServer.java:779)
        at
org.apache.zookeeper.server.NIOServerCnxn.readConnectRequest(NIOServerCnxn.java:410)
        at
org.apache.zookeeper.server.NIOServerCnxn.readPayload(NIOServerCnxn.java:200)
        at
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:236)
        at
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
        at java.lang.Thread.run(Thread.java:745)
2016-02-26 09:34:42,794 INFO org.apache.zookeeper.server.NIOServerCnxn:
Closed socket connection for client /10.10.18.81:55465 (no session
established for client)
2016-02-26 09:34:42,795 INFO
org.apache.zookeeper.server.NIOServerCnxnFactory: Accepted socket connection
from /10.10.18.82:51766
2016-02-26 09:34:42,795 WARN org.apache.zookeeper.server.NIOServerCnxn:
Exception causing close of session 0x0 due to java.io.EOFException
2016-02-26 09:34:42,795 DEBUG org.apache.zookeeper.server.NIOServerCnxn:
IOException stack trace
java.io.EOFException
        at java.io.DataInputStream.readFully(DataInputStream.java:197)
        at java.io.DataInputStream.readLong(DataInputStream.java:416)
        at
org.apache.jute.BinaryInputArchive.readLong(BinaryInputArchive.java:67)
        at
org.apache.zookeeper.proto.ConnectRequest.deserialize(ConnectRequest.java:87)
        at
org.apache.zookeeper.server.ZooKeeperServer.processConnectRequest(ZooKeeperServer.java:779)
        at
org.apache.zookeeper.server.NIOServerCnxn.readConnectRequest(NIOServerCnxn.java:410)
        at
org.apache.zookeeper.server.NIOServerCnxn.readPayload(NIOServerCnxn.java:200)
        at
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:236)
        at
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
        at java.lang.Thread.run(Thread.java:745)
2016-02-26 09:34:42,796 INFO org.apache.zookeeper.server.NIOServerCnxn:
Closed socket connection for client /10.10.18.82:51766 (no session
established for client)
2016-02-26 09:34:42,796 INFO
org.apache.zookeeper.server.NIOServerCnxnFactory: Accepted socket connection
from /10.10.18.81:55467

2016-02-26 09:39:10,027 INFO org.apache.zookeeper.server.NIOServerCnxn:
Closed socket connection for client /10.10.18.81:43747 (no session
established for client)
2016-02-26 09:39:10,060 DEBUG
org.apache.zookeeper.server.quorum.CommitProcessor: Processing request::
sessionid:0x25280518d5eca26 type:ping cxid:0xfffffffffffffffe
zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a
2016-02-26 09:39:10,060 DEBUG
org.apache.zookeeper.server.FinalRequestProcessor: Processing request::
sessionid:0x25280518d5eca26 type:ping cxid:0xfffffffffffffffe
zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a
2016-02-26 09:39:10,060 DEBUG
org.apache.zookeeper.server.FinalRequestProcessor:
sessionid:0x25280518d5eca26 type:ping cxid:0xfffffffffffffffe
zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a
2016-02-26 09:39:10,127 INFO
org.apache.zookeeper.server.NIOServerCnxnFactory: Accepted socket connection
from /10.10.18.82:44791
2016-02-26 09:39:10,129 INFO
org.apache.zookeeper.server.NIOServerCnxnFactory: Accepted socket connection
from /10.10.18.81:43749
2016-02-26 09:39:10,129 WARN org.apache.zookeeper.server.NIOServerCnxn:
Exception causing close of session 0x0 due to java.io.EOFException
2016-02-26 09:39:10,129 DEBUG org.apache.zookeeper.server.NIOServerCnxn:
IOException stack trace
java.io.EOFException


The zookeeper service is running on the three hosts and I can see the port
is open.

Any help really appreciated
Thanks for your time and support
Best Regards








--
View this message in context: http://zookeeper-user.578899.n2.nabble.com/ZooKeeper-and-HA-tp7582082.html
Sent from the zookeeper-user mailing list archive at Nabble.com.

Mime
View raw message