hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From QI Congyun <Congyun...@alcatel-sbell.com.cn>
Subject RE: problem in launching HBase
Date Wed, 23 Nov 2016 06:00:18 GMT

When I learn the HBase operational guideline on the web, the directory "/home/testuser/zookeeper"
doesn't need to be created according the web's step.

Actually I think of whether that the directory can't be created result from the reason which
the zookeeper can't attempt to authenticate using SASL, just because zookeeper can't set up
a socket connection, it can't log on the localhost, and can't create a given directory according
to the file--"hbase-stie.xml" configuration. 
Do you think?

/////2016-11-22 16:26:20,262 INFO  [main-SendThread(localhost:2181)] zookeeper.ClientCnxn:
Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate
using SASL (unknown error)
2016-11-22 16:26:20,266 WARN  [main-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session
0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
//////

http://hbase.apache.org/book.html#quickstart 
/////You do not need to create the HBase data directory. HBase will do this for you. If you
create the directory, HBase will attempt to do a migration, which is not what you want.



-----Original Message-----
From: Ted Yu [mailto:yuzhihong@gmail.com] 
Sent: Wednesday, November 23, 2016 12:03 PM
To: user@hbase.apache.org
Subject: Re: problem in launching HBase

bq. Unable to create data dir /home/testuser/zookeeper

Can you check why the above directory couldn't be created ?

The attachment didn't come through. Consider using pastebin.

Cheers

On Tue, Nov 22, 2016 at 7:51 PM, QI Congyun <Congyun.Qi@alcatel-sbell.com.cn
> wrote:

>
> It's confirmed. Actually. The attached files are including my 
> /etc/hosts and /hbase/conf/regionservers configuration. I try to 
> modify the regionservers and restart hbase, the problem appear again.
> ............................................................
> ................................................................
> [hadoop@hadoop2 hbase-1.2.3]$ bin/start-hbase.sh
> localhost: starting zookeeper, logging to /home/hadoop/hbase-1.2.3/bin/.
> ./logs/hbase-hadoop-zookeeper-hadoop2.out
> localhost: java.io.IOException: Unable to create data dir 
> /home/testuser/zookeeper
> localhost:      at org.apache.hadoop.hbase.zookeeper.HQuorumPeer.
> writeMyID(HQuorumPeer.java:157)
> localhost:      at org.apache.hadoop.hbase.zookeeper.HQuorumPeer.main(
> HQuorumPeer.java:70)
> starting master, logging to /home/hadoop/hbase-1.2.3/logs/ 
> hbase-hadoop-master-hadoop2.out
> hadoop2: starting regionserver, logging to /home/hadoop/hbase-1.2.3/bin/.
> ./logs/hbase-hadoop-regionserver-hadoop2.out
> ............................................................
> ................................................................
>
> -----Original Message-----
> From: Sen [mailto:besenthil@gmail.com]
> Sent: Tuesday, November 22, 2016 11:55 PM
> To: user@hbase.apache.org
> Subject: Re: problem in launching HBase
>
> Did you ensure your etc/hosts file has the IP addresses of the Hbase 
> server?
>
> On Tue, Nov 22, 2016 at 8:39 PM, Ted Yu <yuzhihong@gmail.com> wrote:
>
> > I think hbase 1.2.3 should run fine with Hadoop 2.7.3
> >
> > Can you replace localhost in your hbase-site.xml and try again 
> > (remember to set corresponding entry in /etc/hosts) ?
> >
> > BTW I would be out of office starting tomorrow morning.
> >
> > On Tue, Nov 22, 2016 at 12:44 AM, QI Congyun < 
> > Congyun.Qi@alcatel-sbell.com.cn> wrote:
> >
> > > Hello Ted,
> > >
> > > I try to remove the folder of Hbase and re-install it many times, 
> > > the
> > same
> > > faults below happened.
> > > I doubt whether the version of HBase1.2.3 is incompatible with the
> > version
> > > of Hadoop2.7.3? I search out the similar issues via the internet, 
> > > the similar issue happened very few.
> > > I'm very bewildered, could you help to find the reasons?
> > >
> > > Thanks.
> > >
> > >
> > > -----Original Message-----
> > > From: Ted Yu [mailto:yuzhihong@gmail.com]
> > > Sent: Wednesday, November 16, 2016 11:13 AM
> > > To: user@hbase.apache.org
> > > Subject: Re: problem in launching HBase
> > >
> > > 2016-10-31 15:49:57,503 INFO
> > > [master/localhost/127.0.0.1:16000-SendThread(localhost:2181)]
> > > zookeeper.ClientCnxn: Opening socket connection to server
> > > localhost/0:0:0:0:0:0:0:1:  2181. Will not attempt to authenticate 
> > > using SASL (unknown error)
> > >
> > > Is your machine running IPv6 ?
> > >
> > > I don't have much experience with IPv6.
> > >
> > > Cheers
> > >
> > > On Tue, Nov 15, 2016 at 6:59 PM, QI Congyun <
> > Congyun.Qi@alcatel-sbell.com.
> > > cn
> > > > wrote:
> > >
> > > > Hi, Ted,
> > > >
> > > > Do you feel what I make some incorrect configuration lead to my 
> > > > encountering issues?
> > > > Thanks.
> > > >
> > > >
> > > > -----Original Message-----
> > > > From: QI Congyun
> > > > Sent: Tuesday, November 15, 2016 1:29 PM
> > > > To: user@hbase.apache.org
> > > > Subject: RE: problem in launching HBase
> > > >
> > > >
> > > > I'm so sorry that I make a mistake. The Hadoop configuration 
> > > > files are attached in the previous e-mail.
> > > >
> > > > The hbase-site.xml are attached, pls check it.
> > > >
> > > >
> > > >
> > > > -----Original Message-----
> > > > From: Ted Yu [mailto:yuzhihong@gmail.com]
> > > > Sent: Tuesday, November 15, 2016 1:25 PM
> > > > To: user@hbase.apache.org
> > > > Subject: Re: problem in launching HBase
> > > >
> > > > I don't see hbase-site.xml attached.
> > > >
> > > > Consider using pastebin.
> > > >
> > > > On Mon, Nov 14, 2016 at 9:19 PM, QI Congyun <
> > > Congyun.Qi@alcatel-sbell.com.
> > > > cn
> > > > > wrote:
> > > >
> > > > >
> > > > > The name node and data node are running normally, such as the 
> > > > > following process. The file "hbase-site.xml" and other 
> > > > > associated files
> > > > are enclosed.
> > > > > Thanks.
> > > > >
> > > > > ------------------------------------------------------------
> > > > > --------------------------------------------------------------
> > > > > --
> > > > > ---
> > > > > [hadoop@hadoop2 conf]$ jps
> > > > > 11805 SecondaryNameNode
> > > > > 32314 Jps
> > > > > 11614 DataNode
> > > > > 507 NodeManager
> > > > > 385 ResourceManager
> > > > > 11379 NameNode
> > > > > ------------------------------------------------------------
> > > > > --------------------------------------------------------------
> > > > > --
> > > > > ----
> > > > > --
> > > > > --
> > > > > [hadoop@hadoop2 hadoop-2.7.3]$ bin/hdfs dfsadmin -report 
> > > > > Configured
> > > > > Capacity: 154684043264 (144.06 GB) Present Capacity:
> > > > > 133174730752
> > > > > (124.03 GB) DFS Remaining: 128144982016 (119.34 GB) DFS Used:
> > > > > 5029748736 (4.68 GB) DFS Used%: 3.78% Under replicated blocks: 
> > > > > 0 Blocks with corrupt replicas: 0 Missing blocks: 0 Missing 
> > > > > blocks (with replication factor 1): 0
> > > > >
> > > > > -------------------------------------------------
> > > > >
> > > > > Live datanodes (1):
> > > > >
> > > > > Name: 127.0.0.1:9866 (localhost)
> > > > > Hostname: localhost
> > > > > Decommission Status : Normal
> > > > > Configured Capacity: 154684043264 (144.06 GB) DFS Used:
> > > > > 5029748736
> > > > > (4.68 GB) Non DFS Used: 21509312512 (20.03 GB) DFS Remaining:
> > > > > 128144982016 (119.34 GB) DFS Used%: 3.25% DFS Remaining%: 
> > > > > 82.84% Configured Cache Capacity: 0 (0 B) Cache Used: 0 (0 B) 
> > > > > Cache
> > > > > Remaining: 0 (0 B) Cache Used%: 100.00% Cache Remaining%: 
> > > > > 0.00%
> > > > > Xceivers: 1
> > > > > Last contact: Tue Nov 15 13:17:01 CST 2016 
> > > > > .....................................................
> > > > > ............................................................
> > > > > ..................................
> > > > >
> > > > >
> > > > >
> > > > > -----Original Message-----
> > > > > From: Ted Yu [mailto:yuzhihong@gmail.com]
> > > > > Sent: Tuesday, November 15, 2016 11:50 AM
> > > > > To: user@hbase.apache.org
> > > > > Subject: Re: problem in launching HBase
> > > > >
> > > > > 2016-10-31 15:49:57,528 FATAL
> > > > > [localhost:16000.activeMasterManager]
> > > > > master.HMaster: Failed to become active master
> > > > > java.net.ConnectException: Call From hadoop2/127.0.0.1 to
> > > > > localhost:8020 failed on connection exception:
> > > > > java.net.ConnectException: Connection refused; For more 
> > > > > details
> see:
> > > > > http://wiki.apache.org/hadoop/ConnectionRefused
> > > > >   at
> > > > > sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> > > > Method)
> > > > >   at
> > > > > sun.reflect.NativeConstructorAccessorImpl.newInstance(
> > > > > NativeConstructorAccessorImpl.java:57)
> > > > > ...
> > > > >   at org.apache.hadoop.hdfs.DFSClient.setSafeMode(
> > DFSClient.java:2264)
> > > > >   at
> > > > > org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(
> > > > > DistributedFileSystem.java:986)
> > > > >   at
> > > > > org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(
> > > > > DistributedFileSystem.java:970)
> > > > >   at org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.
> > > java:525)
> > > > >   at
> > > > > org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.ja
> > > > > va
> > > > > :971
> > > > > )
> > > > >
> > > > > Was the namenode running fine on localhost ?
> > > > >
> > > > > Can you pastebin the contents of hbase-site.xml ?
> > > > >
> > > > > On Mon, Nov 14, 2016 at 7:40 PM, QI Congyun <
> > > > Congyun.Qi@alcatel-sbell.com.
> > > > > cn
> > > > > > wrote:
> > > > >
> > > > > > Dear Ted,
> > > > > >
> > > > > > I had learn the HBase quick-start cookbook although I have 
> > > > > > not yet read all of the document, I have known how to 
> > > > > > configure the HBase primary parameters and basic operation.
> > > > > >
> > > > > > I had ever tried to both make HBase control to use zookeeper

> > > > > > and cancel HBase to start zookeeper server via set up the 
> > > > > > export HBASE_MANAGES_ZK=true/false in the file--hbase-env.sh.
> > > > > > Whatever zookeeper is launched by HBase automatically or 
> > > > > > started manually, the same problems and logs are encountered

> > > > > > as follows you
> > submitted.
> > > > > > I don't understand why zookeeper authentication SASL failed.
> > > > > >
> > > > > > Actually when do the command "start-hbase.sh", the master 
> > > > > > process was opened at the beginning, afterwards it's closed

> > > > > > by itself, meanwhile the zookeeper quorum process is always

> > > > > > running until kill it
> > > > manually.
> > > > > > I had do the command "JPS" to observe the process.
> > > > > >
> > > > > > Thanks.
> > > > > >
> > > > > >
> > > > > > -----Original Message-----
> > > > > > From: Ted Yu [mailto:yuzhihong@gmail.com]
> > > > > > Sent: Tuesday, November 15, 2016 11:01 AM
> > > > > > To: user@hbase.apache.org
> > > > > > Subject: problem in launching HBase
> > > > > >
> > > > > > 2016-11-10 11:25:14,177 INFO 
> > > > > > [main-SendThread(localhost:2181)]
> > > > > > zookeeper.ClientCnxn: Opening socket connection to server
> > localhost/
> > > > > > *127.0.0.1*:2181. Will not attempt to           authenticate
> using
> > > SASL
> > > > > > (unknown error)
> > > > > >
> > > > > > Was the zookeeper quorum running on the localhost ?
> > > > > >
> > > > > > In the future, use pastebin for passing config / log files -

> > > > > > attachment would be stripped by mailing list.
> > > > > >
> > > > > > Have you read this ?
> > > > > >
> > > > > > http://hbase.apache.org/book.html#quickstart_fully_distribut
> > > > > > ed
> > > > > >
> > > > > > On Mon, Nov 14, 2016 at 6:26 PM, QI Congyun <
> > > > > Congyun.Qi@alcatel-sbell.com.
> > > > > > cn
> > > > > > > wrote:
> > > > > >
> > > > > > >
> > > > > > > My previous e-mail is attached, pls check if the relative

> > > > > > > traces are enough to investigate or not?
> > > > > > > My node configuration are also enclosed.
> > > > > > >
> > > > > > > Thanks a lot.
> > > > > > >
> > > > > > >
> > > > > > > ---------- Forwarded message ----------
> > > > > > > From: QI Congyun <Congyun.Qi@alcatel-sbell.com.cn>
> > > > > > > To: "user-info@hbase.apache.org"
> > > > > > > <user-info@hbase.apache.org>
> > > > > > > Cc:
> > > > > > > Date: Mon, 14 Nov 2016 08:20:11 +0000
> > > > > > > Subject: my questions about launching HBase
> > > > > > >
> > > > > > > Hi, Specialist,
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > I try to set up a HBase database, but the HBase is always

> > > > > > > raised some errors. I had ever sent the e-mail to one of

> > > > > > > hbase mail-list, the e-mail is refused some times, then
I 
> > > > > > > try to submit my questions to the new mail-box, hope to

> > > > > > > receive your
> > > response.
> > > > > > >
> > > > > > > Thanks a lot.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > my hadoop version is Hadoop-2.7.3,
> > > > > > >
> > > > > > > my OS is: CEOS linux6.4.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > ---------- Forwarded message ----------
> > > > > > > From: QI Congyun <Congyun.Qi@alcatel-sbell.com.cn>
> > > > > > > To: "hbase-dev@lists.apache.org"
> > > > > > > <hbase-dev@lists.apache.org>
> > > > > > > Cc:
> > > > > > > Date: Fri, 11 Nov 2016 02:01:58 +0000
> > > > > > > Subject: FW: my questions are always not resolved about

> > > > > > > hbase
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > The E-mail can’t be sent to the destination e-mail box,

> > > > > > > resent it
> > > > > again.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > Thanks.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > *From:* QI Congyun
> > > > > > > *Sent:* Thursday, November 10, 2016 11:53 AM
> > > > > > > *To:* 'hbase-dev@lists.apache.org'
> > > > > > > *Subject:* my questions are always not resolved about 
> > > > > > > hbase
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > Hello sir,
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > So sorry to bather you, I’m interested in the Hadoop

> > > > > > > system, and attempted to use Hadoop and Hbase, but the

> > > > > > > Hbase issue can’t be resolved, could you help me? Thanks
in advance.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > 1.       I’m very bewildered why the same issue is always
> > > encountered
> > > > > > > when launching hbase each time, the raised information
is 
> > > > > > > attached as
> > > > > > > follows:
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > *[hadoop@hadoop2 hbase-1.2.3]$ *
> > > > > > >
> > > > > > > *[hadoop@hadoop2 hbase-1.2.3]$ bin/start-hbase.sh *
> > > > > > >
> > > > > > > *localhost: starting zookeeper, logging to
> > > > > > > /home/hadoop/hbase-1.2.3/bin/../logs/hbase-hadoop-zookeepe
> > > > > > > r-
> > > hadoop2.
> > > > > > > ou
> > > > > > > t*
> > > > > > >
> > > > > > > *localhost: java.io.IOException: Unable to create data
dir
> > > > > > > /home/testuser/zookeeper*
> > > > > > >
> > > > > > > *localhost:      at
> > > > > > > org.apache.hadoop.hbase.zookeeper.HQuorumPeer.
> > > writeMyID(HQuorumPeer.
> > > > > > > ja
> > > > > > > va:157)*
> > > > > > >
> > > > > > > *localhost:      at
> > > > > > > org.apache.hadoop.hbase.zookeeper.HQuorumPeer.main(
> > > HQuorumPeer.java:
> > > > > > > 70
> > > > > > > )*
> > > > > > >
> > > > > > > *starting master, logging to 
> > > > > > > /home/hadoop/hbase-1.2.3/logs/hbase-hadoop-master-hadoop2.
> > > > > > > ou
> > > > > > > t*
> > > > > > >
> > > > > > > *starting regionserver, logging to
> > > > > > > /home/hadoop/hbase-1.2.3/logs/hbase-hadoop-1-regionserver-
> > hadoop2.
> > > > > > > ou
> > > > > > > t*
> > > > > > >
> > > > > > > ……………
> > > > > > >
> > > > > > > *[hadoop@hadoop2 hbase-1.2.3]$ jps*
> > > > > > >
> > > > > > > *11805 SecondaryNameNode*
> > > > > > >
> > > > > > > *11614 DataNode*
> > > > > > >
> > > > > > > *507 NodeManager*
> > > > > > >
> > > > > > > *30687 HRegionServer*
> > > > > > >
> > > > > > > *385 ResourceManager*
> > > > > > >
> > > > > > > *11379 NameNode*
> > > > > > >
> > > > > > > *30899 Jps*
> > > > > > >
> > > > > > > *……………………..*
> > > > > > >
> > > > > > > *[hadoop@hadoop2 hbase-1.2.3]$ bin/stop-hbase.sh *
> > > > > > >
> > > > > > > *stopping hbasecat: /tmp/hbase-hadoop-master.pid: No such

> > > > > > > file or
> > > > > > > directory*
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > *localhost: no zookeeper to stop because no pid file
> > > > > > > /tmp/hbase-hadoop-zookeeper.pid*
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > 2.       When I check the logs, and a fatal errors are
raised
> > once
> > > > > again,
> > > > > > > but I don’t know why.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > 2016-11-10 11:25:14,177 INFO 
> > > > > > > [main-SendThread(localhost:2181)]
> > > > > > > zookeeper.ClientCnxn: Opening socket connection to server

> > > > > > > localhost/ 127.0.0.1:2181. Will not attempt to 
> > > > > > > authenticate using SASL (unknown
> > > > > > > error)
> > > > > > >
> > > > > > > 2016-11-10 11:25:14,181 WARN 
> > > > > > > [main-SendThread(localhost:2181)]
> > > > > > > zookeeper.ClientCnxn: Session 0x0 for server null, 
> > > > > > > unexpected error, closing socket connection and attempting

> > > > > > > reconnect
> > > > > > >
> > > > > > > java.net.ConnectException: Connection refused
> > > > > > >
> > > > > > >               at
> > > > > > > sun.nio.ch.SocketChannelImpl.checkConnect(Native
> > > > > > > Method)
> > > > > > >
> > > > > > >               at 
> > > > > > > sun.nio.ch.SocketChannelImpl.finishConnect(
> > > > > > > SocketChannelImpl.java:739)
> > > > > > >
> > > > > > >               at
> > > > > > > org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> > > > > > > ClientCnxnSocketNIO.java:361)
> > > > > > >
> > > > > > >               at
> > > > > > > org.apache.zookeeper.ClientCnxn$SendThread.run(
> > > > > > > ClientCnxn.java:1081)
> > > > > > >
> > > > > > > 2016-11-10 11:25:14,291 INFO 
> > > > > > > [main-SendThread(localhost:2181)]
> > > > > > > zookeeper.ClientCnxn: Opening socket connection to server

> > > > > > > localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to 
> > > > > > > authenticate using SASL (unknown error)
> > > > > > >
> > > > > > > 2016-11-10 11:25:14,294 WARN 
> > > > > > > [main-SendThread(localhost:2181)]
> > > > > > > zookeeper.ClientCnxn: Session 0x0 for server null, 
> > > > > > > unexpected error, closing socket connection and attempting

> > > > > > > reconnect
> > > > > > >
> > > > > > > java.net.ConnectException: Connection refused
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
>
>
> --
> Regards,
> Senthil
>
Mime
View raw message