Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
MIME-Version: 1.0
In-Reply-To: <460E1A006BEC0540B1D3559ED5F0789F0FC59A9E@cnshjmbx02>
References: <CALte62zPigTYGE7ancTqqVd=hMv=5wbKeWD4mRamFYS82Ve12g@mail.gmail.com>
 <460E1A006BEC0540B1D3559ED5F0789F0FC56C15@cnshjmbx02> <CALte62w+zGZi0RfTcP8dTZuq35==DpMMsOpczCOkfhZZUTtQeA@mail.gmail.com>
 <460E1A006BEC0540B1D3559ED5F0789F0FC56C75@cnshjmbx02> <CALte62zRMQ9=c_mP11kR-cd74j8SqAMBKHh-DA0tsPato76A7A@mail.gmail.com>
 <460E1A006BEC0540B1D3559ED5F0789F0FC57F29@cnshjmbx02> <CALte62zyMogt51vP7bCD2zK3ihu+-mGTcZ=Eh=YBpcWCtg0izA@mail.gmail.com>
 <460E1A006BEC0540B1D3559ED5F0789F0FC5894C@cnshjmbx02> <CALte62yC=kLHMUTBMWyK9etjfNg7dSpBNP=WxALB5m7DFnw6Pg@mail.gmail.com>
 <CAMWw23wrg51C05aNhoQDDr0Q8bXBX3TvF1MmAE2Z8cAqTRW-_A@mail.gmail.com> <460E1A006BEC0540B1D3559ED5F0789F0FC59A9E@cnshjmbx02>
From: Ted Yu <yuzhihong@gmail.com>
Date: Tue, 22 Nov 2016 20:03:11 -0800
Message-ID: <CALte62yf8cffaUKzLOv_cpjDFrfO4DxphT8Ja0t8rc0V7Jp8-Q@mail.gmail.com>
Subject: Re: problem in launching HBase
To: "user@hbase.apache.org" <user@hbase.apache.org>
Content-Type: multipart/alternative; boundary=94eb2c14665aad9d850541eff7ca
archived-at: Wed, 23 Nov 2016 04:03:39 -0000

--94eb2c14665aad9d850541eff7ca
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

bq. Unable to create data dir /home/testuser/zookeeper

Can you check why the above directory couldn't be created ?

The attachment didn't come through. Consider using pastebin.

Cheers

On Tue, Nov 22, 2016 at 7:51 PM, QI Congyun <Congyun.Qi@alcatel-sbell.com.c=
n
> wrote:

>
> It's confirmed. Actually. The attached files are including my /etc/hosts
> and /hbase/conf/regionservers configuration. I try to modify the
> regionservers and restart hbase, the problem appear again.
> ............................................................
> ................................................................
> [hadoop@hadoop2 hbase-1.2.3]$ bin/start-hbase.sh
> localhost: starting zookeeper, logging to /home/hadoop/hbase-1.2.3/bin/.
> ./logs/hbase-hadoop-zookeeper-hadoop2.out
> localhost: java.io.IOException: Unable to create data dir
> /home/testuser/zookeeper
> localhost:      at org.apache.hadoop.hbase.zookeeper.HQuorumPeer.
> writeMyID(HQuorumPeer.java:157)
> localhost:      at org.apache.hadoop.hbase.zookeeper.HQuorumPeer.main(
> HQuorumPeer.java:70)
> starting master, logging to /home/hadoop/hbase-1.2.3/logs/
> hbase-hadoop-master-hadoop2.out
> hadoop2: starting regionserver, logging to /home/hadoop/hbase-1.2.3/bin/.
> ./logs/hbase-hadoop-regionserver-hadoop2.out
> ............................................................
> ................................................................
>
> -----Original Message-----
> From: Sen [mailto:besenthil@gmail.com]
> Sent: Tuesday, November 22, 2016 11:55 PM
> To: user@hbase.apache.org
> Subject: Re: problem in launching HBase
>
> Did you ensure your etc/hosts file has the IP addresses of the Hbase
> server?
>
> On Tue, Nov 22, 2016 at 8:39 PM, Ted Yu <yuzhihong@gmail.com> wrote:
>
> > I think hbase 1.2.3 should run fine with Hadoop 2.7.3
> >
> > Can you replace localhost in your hbase-site.xml and try again
> > (remember to set corresponding entry in /etc/hosts) ?
> >
> > BTW I would be out of office starting tomorrow morning.
> >
> > On Tue, Nov 22, 2016 at 12:44 AM, QI Congyun <
> > Congyun.Qi@alcatel-sbell.com.cn> wrote:
> >
> > > Hello Ted,
> > >
> > > I try to remove the folder of Hbase and re-install it many times,
> > > the
> > same
> > > faults below happened.
> > > I doubt whether the version of HBase1.2.3 is incompatible with the
> > version
> > > of Hadoop2.7.3? I search out the similar issues via the internet,
> > > the similar issue happened very few.
> > > I'm very bewildered, could you help to find the reasons?
> > >
> > > Thanks.
> > >
> > >
> > > -----Original Message-----
> > > From: Ted Yu [mailto:yuzhihong@gmail.com]
> > > Sent: Wednesday, November 16, 2016 11:13 AM
> > > To: user@hbase.apache.org
> > > Subject: Re: problem in launching HBase
> > >
> > > 2016-10-31 15:49:57,503 INFO
> > > [master/localhost/127.0.0.1:16000-SendThread(localhost:2181)]
> > > zookeeper.ClientCnxn: Opening socket connection to server
> > > localhost/0:0:0:0:0:0:0:1:  2181. Will not attempt to authenticate
> > > using SASL (unknown error)
> > >
> > > Is your machine running IPv6 ?
> > >
> > > I don't have much experience with IPv6.
> > >
> > > Cheers
> > >
> > > On Tue, Nov 15, 2016 at 6:59 PM, QI Congyun <
> > Congyun.Qi@alcatel-sbell.com.
> > > cn
> > > > wrote:
> > >
> > > > Hi, Ted,
> > > >
> > > > Do you feel what I make some incorrect configuration lead to my
> > > > encountering issues?
> > > > Thanks.
> > > >
> > > >
> > > > -----Original Message-----
> > > > From: QI Congyun
> > > > Sent: Tuesday, November 15, 2016 1:29 PM
> > > > To: user@hbase.apache.org
> > > > Subject: RE: problem in launching HBase
> > > >
> > > >
> > > > I'm so sorry that I make a mistake. The Hadoop configuration files
> > > > are attached in the previous e-mail.
> > > >
> > > > The hbase-site.xml are attached, pls check it.
> > > >
> > > >
> > > >
> > > > -----Original Message-----
> > > > From: Ted Yu [mailto:yuzhihong@gmail.com]
> > > > Sent: Tuesday, November 15, 2016 1:25 PM
> > > > To: user@hbase.apache.org
> > > > Subject: Re: problem in launching HBase
> > > >
> > > > I don't see hbase-site.xml attached.
> > > >
> > > > Consider using pastebin.
> > > >
> > > > On Mon, Nov 14, 2016 at 9:19 PM, QI Congyun <
> > > Congyun.Qi@alcatel-sbell.com.
> > > > cn
> > > > > wrote:
> > > >
> > > > >
> > > > > The name node and data node are running normally, such as the
> > > > > following process. The file "hbase-site.xml" and other
> > > > > associated files
> > > > are enclosed.
> > > > > Thanks.
> > > > >
> > > > > ------------------------------------------------------------
> > > > > ----------------------------------------------------------------
> > > > > ---
> > > > > [hadoop@hadoop2 conf]$ jps
> > > > > 11805 SecondaryNameNode
> > > > > 32314 Jps
> > > > > 11614 DataNode
> > > > > 507 NodeManager
> > > > > 385 ResourceManager
> > > > > 11379 NameNode
> > > > > ------------------------------------------------------------
> > > > > ----------------------------------------------------------------
> > > > > ----
> > > > > --
> > > > > --
> > > > > [hadoop@hadoop2 hadoop-2.7.3]$ bin/hdfs dfsadmin -report
> > > > > Configured
> > > > > Capacity: 154684043264 (144.06 GB) Present Capacity:
> > > > > 133174730752
> > > > > (124.03 GB) DFS Remaining: 128144982016 (119.34 GB) DFS Used:
> > > > > 5029748736 (4.68 GB) DFS Used%: 3.78% Under replicated blocks: 0
> > > > > Blocks with corrupt replicas: 0 Missing blocks: 0 Missing blocks
> > > > > (with replication factor 1): 0
> > > > >
> > > > > -------------------------------------------------
> > > > >
> > > > > Live datanodes (1):
> > > > >
> > > > > Name: 127.0.0.1:9866 (localhost)
> > > > > Hostname: localhost
> > > > > Decommission Status : Normal
> > > > > Configured Capacity: 154684043264 (144.06 GB) DFS Used:
> > > > > 5029748736
> > > > > (4.68 GB) Non DFS Used: 21509312512 (20.03 GB) DFS Remaining:
> > > > > 128144982016 (119.34 GB) DFS Used%: 3.25% DFS Remaining%: 82.84%
> > > > > Configured Cache Capacity: 0 (0 B) Cache Used: 0 (0 B) Cache
> > > > > Remaining: 0 (0 B) Cache Used%: 100.00% Cache Remaining%: 0.00%
> > > > > Xceivers: 1
> > > > > Last contact: Tue Nov 15 13:17:01 CST 2016
> > > > > .....................................................
> > > > > ............................................................
> > > > > ..................................
> > > > >
> > > > >
> > > > >
> > > > > -----Original Message-----
> > > > > From: Ted Yu [mailto:yuzhihong@gmail.com]
> > > > > Sent: Tuesday, November 15, 2016 11:50 AM
> > > > > To: user@hbase.apache.org
> > > > > Subject: Re: problem in launching HBase
> > > > >
> > > > > 2016-10-31 15:49:57,528 FATAL
> > > > > [localhost:16000.activeMasterManager]
> > > > > master.HMaster: Failed to become active master
> > > > > java.net.ConnectException: Call From hadoop2/127.0.0.1 to
> > > > > localhost:8020 failed on connection exception:
> > > > > java.net.ConnectException: Connection refused; For more details
> see:
> > > > > http://wiki.apache.org/hadoop/ConnectionRefused
> > > > >   at
> > > > > sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> > > > Method)
> > > > >   at
> > > > > sun.reflect.NativeConstructorAccessorImpl.newInstance(
> > > > > NativeConstructorAccessorImpl.java:57)
> > > > > ...
> > > > >   at org.apache.hadoop.hdfs.DFSClient.setSafeMode(
> > DFSClient.java:2264)
> > > > >   at
> > > > > org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(
> > > > > DistributedFileSystem.java:986)
> > > > >   at
> > > > > org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(
> > > > > DistributedFileSystem.java:970)
> > > > >   at org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.
> > > java:525)
> > > > >   at
> > > > > org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java
> > > > > :971
> > > > > )
> > > > >
> > > > > Was the namenode running fine on localhost ?
> > > > >
> > > > > Can you pastebin the contents of hbase-site.xml ?
> > > > >
> > > > > On Mon, Nov 14, 2016 at 7:40 PM, QI Congyun <
> > > > Congyun.Qi@alcatel-sbell.com.
> > > > > cn
> > > > > > wrote:
> > > > >
> > > > > > Dear Ted,
> > > > > >
> > > > > > I had learn the HBase quick-start cookbook although I have not
> > > > > > yet read all of the document, I have known how to configure
> > > > > > the HBase primary parameters and basic operation.
> > > > > >
> > > > > > I had ever tried to both make HBase control to use zookeeper
> > > > > > and cancel HBase to start zookeeper server via set up the
> > > > > > export HBASE_MANAGES_ZK=3Dtrue/false in the file--hbase-env.sh.
> > > > > > Whatever zookeeper is launched by HBase automatically or
> > > > > > started manually, the same problems and logs are encountered
> > > > > > as follows you
> > submitted.
> > > > > > I don't understand why zookeeper authentication SASL failed.
> > > > > >
> > > > > > Actually when do the command "start-hbase.sh", the master
> > > > > > process was opened at the beginning, afterwards it's closed by
> > > > > > itself, meanwhile the zookeeper quorum process is always
> > > > > > running until kill it
> > > > manually.
> > > > > > I had do the command "JPS" to observe the process.
> > > > > >
> > > > > > Thanks.
> > > > > >
> > > > > >
> > > > > > -----Original Message-----
> > > > > > From: Ted Yu [mailto:yuzhihong@gmail.com]
> > > > > > Sent: Tuesday, November 15, 2016 11:01 AM
> > > > > > To: user@hbase.apache.org
> > > > > > Subject: problem in launching HBase
> > > > > >
> > > > > > 2016-11-10 11:25:14,177 INFO
> > > > > > [main-SendThread(localhost:2181)]
> > > > > > zookeeper.ClientCnxn: Opening socket connection to server
> > localhost/
> > > > > > *127.0.0.1*:2181. Will not attempt to           authenticate
> using
> > > SASL
> > > > > > (unknown error)
> > > > > >
> > > > > > Was the zookeeper quorum running on the localhost ?
> > > > > >
> > > > > > In the future, use pastebin for passing config / log files -
> > > > > > attachment would be stripped by mailing list.
> > > > > >
> > > > > > Have you read this ?
> > > > > >
> > > > > > http://hbase.apache.org/book.html#quickstart_fully_distributed
> > > > > >
> > > > > > On Mon, Nov 14, 2016 at 6:26 PM, QI Congyun <
> > > > > Congyun.Qi@alcatel-sbell.com.
> > > > > > cn
> > > > > > > wrote:
> > > > > >
> > > > > > >
> > > > > > > My previous e-mail is attached, pls check if the relative
> > > > > > > traces are enough to investigate or not?
> > > > > > > My node configuration are also enclosed.
> > > > > > >
> > > > > > > Thanks a lot.
> > > > > > >
> > > > > > >
> > > > > > > ---------- Forwarded message ----------
> > > > > > > From: QI Congyun <Congyun.Qi@alcatel-sbell.com.cn>
> > > > > > > To: "user-info@hbase.apache.org"
> > > > > > > <user-info@hbase.apache.org>
> > > > > > > Cc:
> > > > > > > Date: Mon, 14 Nov 2016 08:20:11 +0000
> > > > > > > Subject: my questions about launching HBase
> > > > > > >
> > > > > > > Hi, Specialist,
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > I try to set up a HBase database, but the HBase is always
> > > > > > > raised some errors. I had ever sent the e-mail to one of
> > > > > > > hbase mail-list, the e-mail is refused some times, then I
> > > > > > > try to submit my questions to the new mail-box, hope to
> > > > > > > receive your
> > > response.
> > > > > > >
> > > > > > > Thanks a lot.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > my hadoop version is Hadoop-2.7.3,
> > > > > > >
> > > > > > > my OS is: CEOS linux6.4.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > ---------- Forwarded message ----------
> > > > > > > From: QI Congyun <Congyun.Qi@alcatel-sbell.com.cn>
> > > > > > > To: "hbase-dev@lists.apache.org"
> > > > > > > <hbase-dev@lists.apache.org>
> > > > > > > Cc:
> > > > > > > Date: Fri, 11 Nov 2016 02:01:58 +0000
> > > > > > > Subject: FW: my questions are always not resolved about
> > > > > > > hbase
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > The E-mail can=E2=80=99t be sent to the destination e-mail bo=
x,
> > > > > > > resent it
> > > > > again.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > Thanks.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > *From:* QI Congyun
> > > > > > > *Sent:* Thursday, November 10, 2016 11:53 AM
> > > > > > > *To:* 'hbase-dev@lists.apache.org'
> > > > > > > *Subject:* my questions are always not resolved about hbase
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > Hello sir,
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > So sorry to bather you, I=E2=80=99m interested in the Hadoop =
system,
> > > > > > > and attempted to use Hadoop and Hbase, but the Hbase issue
> > > > > > > can=E2=80=99t be resolved, could you help me? Thanks in advan=
ce.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > 1.       I=E2=80=99m very bewildered why the same issue is al=
ways
> > > encountered
> > > > > > > when launching hbase each time, the raised information is
> > > > > > > attached as
> > > > > > > follows:
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > *[hadoop@hadoop2 hbase-1.2.3]$ *
> > > > > > >
> > > > > > > *[hadoop@hadoop2 hbase-1.2.3]$ bin/start-hbase.sh *
> > > > > > >
> > > > > > > *localhost: starting zookeeper, logging to
> > > > > > > /home/hadoop/hbase-1.2.3/bin/../logs/hbase-hadoop-zookeeper-
> > > hadoop2.
> > > > > > > ou
> > > > > > > t*
> > > > > > >
> > > > > > > *localhost: java.io.IOException: Unable to create data dir
> > > > > > > /home/testuser/zookeeper*
> > > > > > >
> > > > > > > *localhost:      at
> > > > > > > org.apache.hadoop.hbase.zookeeper.HQuorumPeer.
> > > writeMyID(HQuorumPeer.
> > > > > > > ja
> > > > > > > va:157)*
> > > > > > >
> > > > > > > *localhost:      at
> > > > > > > org.apache.hadoop.hbase.zookeeper.HQuorumPeer.main(
> > > HQuorumPeer.java:
> > > > > > > 70
> > > > > > > )*
> > > > > > >
> > > > > > > *starting master, logging to
> > > > > > > /home/hadoop/hbase-1.2.3/logs/hbase-hadoop-master-hadoop2.ou
> > > > > > > t*
> > > > > > >
> > > > > > > *starting regionserver, logging to
> > > > > > > /home/hadoop/hbase-1.2.3/logs/hbase-hadoop-1-regionserver-
> > hadoop2.
> > > > > > > ou
> > > > > > > t*
> > > > > > >
> > > > > > > =E2=80=A6=E2=80=A6=E2=80=A6=E2=80=A6=E2=80=A6
> > > > > > >
> > > > > > > *[hadoop@hadoop2 hbase-1.2.3]$ jps*
> > > > > > >
> > > > > > > *11805 SecondaryNameNode*
> > > > > > >
> > > > > > > *11614 DataNode*
> > > > > > >
> > > > > > > *507 NodeManager*
> > > > > > >
> > > > > > > *30687 HRegionServer*
> > > > > > >
> > > > > > > *385 ResourceManager*
> > > > > > >
> > > > > > > *11379 NameNode*
> > > > > > >
> > > > > > > *30899 Jps*
> > > > > > >
> > > > > > > *=E2=80=A6=E2=80=A6=E2=80=A6=E2=80=A6=E2=80=A6=E2=80=A6=E2=80=
=A6=E2=80=A6..*
> > > > > > >
> > > > > > > *[hadoop@hadoop2 hbase-1.2.3]$ bin/stop-hbase.sh *
> > > > > > >
> > > > > > > *stopping hbasecat: /tmp/hbase-hadoop-master.pid: No such
> > > > > > > file or
> > > > > > > directory*
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > *localhost: no zookeeper to stop because no pid file
> > > > > > > /tmp/hbase-hadoop-zookeeper.pid*
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > 2.       When I check the logs, and a fatal errors are raised
> > once
> > > > > again,
> > > > > > > but I don=E2=80=99t know why.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > 2016-11-10 11:25:14,177 INFO
> > > > > > > [main-SendThread(localhost:2181)]
> > > > > > > zookeeper.ClientCnxn: Opening socket connection to server
> > > > > > > localhost/ 127.0.0.1:2181. Will not attempt to authenticate
> > > > > > > using SASL (unknown
> > > > > > > error)
> > > > > > >
> > > > > > > 2016-11-10 11:25:14,181 WARN
> > > > > > > [main-SendThread(localhost:2181)]
> > > > > > > zookeeper.ClientCnxn: Session 0x0 for server null,
> > > > > > > unexpected error, closing socket connection and attempting
> > > > > > > reconnect
> > > > > > >
> > > > > > > java.net.ConnectException: Connection refused
> > > > > > >
> > > > > > >               at
> > > > > > > sun.nio.ch.SocketChannelImpl.checkConnect(Native
> > > > > > > Method)
> > > > > > >
> > > > > > >               at sun.nio.ch.SocketChannelImpl.finishConnect(
> > > > > > > SocketChannelImpl.java:739)
> > > > > > >
> > > > > > >               at
> > > > > > > org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> > > > > > > ClientCnxnSocketNIO.java:361)
> > > > > > >
> > > > > > >               at
> > > > > > > org.apache.zookeeper.ClientCnxn$SendThread.run(
> > > > > > > ClientCnxn.java:1081)
> > > > > > >
> > > > > > > 2016-11-10 11:25:14,291 INFO
> > > > > > > [main-SendThread(localhost:2181)]
> > > > > > > zookeeper.ClientCnxn: Opening socket connection to server
> > > > > > > localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to
> > > > > > > authenticate using SASL (unknown error)
> > > > > > >
> > > > > > > 2016-11-10 11:25:14,294 WARN
> > > > > > > [main-SendThread(localhost:2181)]
> > > > > > > zookeeper.ClientCnxn: Session 0x0 for server null,
> > > > > > > unexpected error, closing socket connection and attempting
> > > > > > > reconnect
> > > > > > >
> > > > > > > java.net.ConnectException: Connection refused
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
>
>
> --
> Regards,
> Senthil
>

--94eb2c14665aad9d850541eff7ca--