hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Josh Elser <josh.el...@gmail.com>
Subject Re: zookeeper is null
Date Fri, 09 Dec 2016 20:11:30 GMT
ZooKeeper servers should only be deployed in numbers that can determine 
majorities. 1, 3, 5, etc. If you have only two ZooKeeper servers, they 
can not make a decision on elections.

Would recommend that you use only one ZK server if you only have two nodes.

Vincent Fontana wrote:
>   I started this project a few week ago.Thus I use only 2 computer at the
> moment (probably more afterward when it works).
>
> I have change the configuration to:
> <configuration>
>      <property>
>      <name>hbase.cluster.distributed</name>
>      <value>true</value>
>      </property>
>      <property>
>      <name>hbase.rootdir</name>
>      <value>hdfs://fontana-04:9000/opt/hbase</value>
>      </property>
>      <property>
>      <name>hbase.security.authentication</name>
>      <value>simple</value>
>      </property>
>      <property>
>      <name>hbase.ipc.client.fallback-to-simple-auth-allowed</name>
>      <value>true</value>
>      </property>
>      <property>
>          <name>hbase.zookeeper.quorum</name>
>      <value>localhost:2181</value>
>      </property>
>      <property>
>          <name>hbase.client.keyvalue.maxsize</name>
>          <value>0</value>
>      </property>
>     <property>
>          <name>zookeeper.znode.parent</name>
>          <value>/hbase</value>
>      </property>
> </configuration>
>
> and i have remove fontana-03 to slave, regionserver and quorum for more
> clarity.
>
> Did i have make something wrong in other file or it was zookeeper?
>
>
> the 2 error was:
> WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error,
> closing socket connection and attempting reconnect
>
> zookeeper.ClientCnxn: Opening socket connection to server localhost/
> 127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
>
>
>
> 2016-12-08 11:49 GMT+01:00 Ted Yu<yuzhihong@gmail.com>:
>
>> Please check the zookeeper server logs to see what might be happening.
>>
>> bq. fontana-04,fontana-03
>>
>> Why only two servers in the quorum ? Can you add one more zookeeper server
>> ?
>>
>> Cheers
>>
>> On Thu, Dec 8, 2016 at 1:18 AM, Vincent Fontana<74full@gmail.com>  wrote:
>>
>>> now i have this...
>>>
>>> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
>>> environment:java.library.path=/opt/hadoop/lib/native
>>> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
>>> environment:java.io.tmpdir=/tmp
>>> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
>>> environment:java.compiler=<NA>
>>> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client environment:os.name
>>> =Linux
>>> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
>>> environment:os.arch=amd64
>>> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
>>> environment:os.version=4.4.0-51-generic
>>> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client environment:user.name
>>> =hadoop
>>> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
>>> environment:user.home=/home/hadoop
>>> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
>>> environment:user.dir=/opt/hadoop
>>> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Initiating client connection,
>>> connectString=localhost:2181 sessionTimeout=90000
>>> watcher=hconnection-0x65d637e7, quorum=localhost:2181, baseZNode=/hbase
>>> 16/12/08 10:08:32 INFO zookeeper.ClientCnxn: Opening socket connection to
>>> server localhost/127.0.0.1:2181. Will not attempt to authenticate using
>>> SASL (unknown error)
>>> 16/12/08 10:08:32 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
>>> unexpected error, closing socket connection and attempting reconnect
>>> java.net.ConnectException: Connexion refusée
>>>      at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>>>      at
>>> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:744)
>>>      at
>>> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
>>> ClientCnxnSocketNIO.java:361)
>>>      at org.apache.zookeeper.ClientCnxn$SendThread.run(
>>> ClientCnxn.java:1081)
>>> 16/12/08 10:08:32 WARN zookeeper.RecoverableZooKeeper: Possibly
>> transient
>>> ZooKeeper, quorum=localhost:2181,
>>> exception=org.apache.zookeeper.KeeperException$ConnectionLossException:
>>> KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
>>> 16/12/08 10:08:32 INFO util.RetryCounter: Sleeping 1000ms before retry
>>> #0...
>>> 16/12/08 10:08:33 INFO zookeeper.ClientCnxn: Opening socket connection to
>>> server localhost/127.0.0.1:2181. Will not attempt to authenticate using
>>> SASL (unknown error)
>>> 16/12/08 10:08:33 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
>>> unexpected error, closing socket connection and attempting reconnect
>>> java.net.ConnectException: Connexion refusée
>>>      at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>>>      at
>>> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:744)
>>>      at
>>> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
>>> ClientCnxnSocketNIO.java:361)
>>>      at org.apache.zookeeper.ClientCnxn$SendThread.run(
>>> ClientCnxn.java:1081)
>>> 16/12/08 10:08:33 WARN zookeeper.RecoverableZooKeeper: Possibly
>> transient
>>> ZooKeeper, quorum=localhost:2181,
>>> exception=org.apache.zookeeper.KeeperException$ConnectionLossException:
>>> KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
>>> 16/12/08 10:08:33 INFO util.RetryCounter: Sleeping 2000ms before retry
>>> #1...
>>>
>>>
>>> 2016-12-08 10:02 GMT+01:00 Sandeep Nemuri<nhsandeep6@gmail.com>:
>>>
>>>> Looks like your project is unable to pick zookeeper and zk node details
>>>> which are in hbase-site.xml.
>>>>
>>>> quorum=localhost:2181, baseZNode=/hbase
>>>>
>>>> On Thu, Dec 8, 2016 at 2:19 PM,<74full@gmail.com>  wrote:
>>>>
>>>>> Hello,
>>>>>
>>>>> I have and error i can't understand and resolve i think it was cause
>> by
>>>>> this:
>>>>> client.ZooKeeperRegistry: ClusterId read in ZooKeeper is null
>>>>>
>>>>> My project was to use nutch crawler with hadoop and hbase.
>>>>> I have start hbase ,yarn and dfs
>>>>> I when i start a job like Injector Job for nutch, nothing hapend.
>>>>>
>>>>> I have this writing on the console.
>>>>>
>>>>> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
>>>>> environment:java.library.path=/opt/hadoop/lib/native
>>>>> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
>>>>> environment:java.io.tmpdir=/tmp
>>>>> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
>>>>> environment:java.compiler=<NA>
>>>>> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client environment:
>> os.name
>>>>> =Linux
>>>>> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
>>>>> environment:os.arch=amd64
>>>>> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
>>>>> environment:os.version=4.4.0-45-generic
>>>>> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client environment:
>>> user.name
>>>>> =hadoop
>>>>> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
>>>>> environment:user.home=/home/hadoop
>>>>> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
>>>>> environment:user.dir=/opt/hadoop
>>>>> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Initiating client
>>> connection,
>>>>> connectString=localhost:2181 sessionTimeout=90000
>> watcher=hconnection-
>>>> 0x75cf7815,
>>>>> quorum=localhost:2181, baseZNode=/hbase
>>>>> 16/12/02 13:05:14 INFO zookeeper.ClientCnxn: Opening socket
>> connection
>>> to
>>>>> server localhost/127.0.0.1:2181. Will not attempt to authenticate
>>> using
>>>>> SASL (unknown error)
>>>>> 16/12/02 13:05:14 INFO zookeeper.ClientCnxn: Socket connection
>>>> established
>>>>> to localhost/127.0.0.1:2181, initiating session
>>>>> 16/12/02 13:05:14 INFO zookeeper.ClientCnxn: Session establishment
>>>>> complete on server localhost/127.0.0.1:2181, sessionid =
>>>>> 0x58bf6bd3390001, negotiated timeout = 90000
>>>>> 16/12/02 13:05:14 INFO client.ZooKeeperRegistry: ClusterId read in
>>>>> ZooKeeper is null
>>>>> 16/12/02 13:05:14 INFO Configuration.deprecation: hadoop.native.lib
>> is
>>>>> deprecated. Instead, use io.native.lib.available
>>>>> 16/12/02 13:05:15 INFO zookeeper.RecoverableZooKeeper: Process
>>>>> identifier=catalogtracker-on-hconnection-0x75cf7815 connecting to
>>>>> ZooKeeper ensemble=localhost:2181
>>>>> 16/12/02 13:05:15 INFO zookeeper.ZooKeeper: Initiating client
>>> connection,
>>>>> connectString=localhost:2181 sessionTimeout=90000
>>>> watcher=catalogtracker-on-hconnection-0x75cf7815,
>>>>> quorum=localhost:2181, baseZNode=/hbase
>>>>> 16/12/02 13:05:15 INFO zookeeper.ClientCnxn: Opening socket
>> connection
>>> to
>>>>> server localhost/127.0.0.1:2181. Will not attempt to authenticate
>>> using
>>>>> SASL (unknown error)
>>>>> 16/12/02 13:05:15 INFO zookeeper.ClientCnxn: Socket connection
>>>> established
>>>>> to localhost/127.0.0.1:2181, initiating session
>>>>> 16/12/02 13:05:15 INFO zookeeper.ClientCnxn: Session establishment
>>>>> complete on server localhost/127.0.0.1:2181, sessionid =
>>>>> 0x58bf6bd3390002, negotiated timeout = 90000
>>>>>
>>>>> my hbase-site.xml configuration is:
>>>>> <configuration>
>>>>>      <property>
>>>>>      <name>hbase.cluster.distributed</name>
>>>>>      <value>true</value>
>>>>>      </property>
>>>>>      <property>
>>>>>      <name>hbase.rootdir</name>
>>>>>      <value>hdfs://fontana-04:9000/opt/hbase</value>
>>>>>      </property>
>>>>>      <property>
>>>>>      <name>hbase.security.authentication</name>
>>>>>      <value>simple</value>
>>>>>      </property>
>>>>>      <property>
>>>>>      <name>hbase.ipc.client.fallback-to-simple-auth-allowed</name>
>>>>>      <value>true</value>
>>>>>      </property>
>>>>>      <property>
>>>>>          <name>hbase.zookeeper.quorum</name>
>>>>>      <value>fontana-04,fontana-03</value>
>>>>>      </property>
>>>>>      <property>
>>>>>          <name>hbase.client.keyvalue.maxsize</name>
>>>>>          <value>0</value>
>>>>>      </property>
>>>>>     <property>
>>>>>          <name>zookeeper.znode.parent</name>
>>>>>          <value>/hbase</value>
>>>>>      </property>
>>>>> </configuration>
>>>>>
>>>>
>>>>
>>>> --
>>>> *  Regards*
>>>> *  Sandeep Nemuri*
>>>>
>

Mime
View raw message