hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bing Li <lbl...@gmail.com>
Subject Re: Starting Abnormally After Shutting Down For Some Time
Date Wed, 28 Mar 2012 06:08:52 GMT
Dear Manish and Jean-Daniel,

After starting DFS (/opt/hadoop/bin/start-dfs.sh), I got the following
daemons after tying "jps".

5212 Jps
5150 SecondaryNameNode
4932 DataNode
4737 NameNode

Then, I started the HBase (/opt/hbase/bin/start-hbase.sh). The following
daemons were available.

5797 Jps
5526 HMaster
5150 SecondaryNameNode
5711 HRegionServer
4932 DataNode
4737 NameNode
5456 HQuorumPeer

HMaster was started. It seemed that everything was fine.

But when typing "status" in HBase shell. The following error still occurred.

ERROR: org.apache.hadoop.hbase.MasterNotRunningException: Retried 7 times

In the master log, the following exception was found.

2012-03-28 13:40:01,193 FATAL org.apache.hadoop.hbase.master.HMaster:
Unhandled exception. Starting shutdown.
java.net.ConnectException: Call to localhost/127.0.0.1:9000 failed on
connection exception: java.net.ConnectException: Connection refused
at org.apache.hadoop.ipc.Client.wrapException(Client.java:1095)
at org.apache.hadoop.ipc.Client.call(Client.java:1071)
at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)
at $Proxy10.setSafeMode(Unknown Source)
at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at
org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
at
org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
at $Proxy10.setSafeMode(Unknown Source)
at org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:1120)
at
org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:423)
at org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:439)
at
org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:323)
at
org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:128)
at
org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:113)
at
org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:448)
at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:326)
at java.lang.Thread.run(Thread.java:722)
Caused by: java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:701)
at
org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:656)
at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:434)
at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:560)
at org.apache.hadoop.ipc.Client$Connection.access$2000(Client.java:184)
at org.apache.hadoop.ipc.Client.getConnection(Client.java:1202)
at org.apache.hadoop.ipc.Client.call(Client.java:1046)
... 17 more
2012-03-28 13:40:01,195 INFO org.apache.hadoop.hbase.master.HMaster:
Aborting

What is the problem? Why does it happen after HBase/Hadoop is shutdown for
a couple of days?

Thanks so much!

Bing

On Wed, Mar 28, 2012 at 11:09 AM, Manish Bhoge
<manishbhoge@rocketmail.com>wrote:

> It says you have not started the hbase master. Once you restarted the
> system have you confirmed whether all hadoop daemons are running?
> sudo jps
> If you are using CDH package then you can automatically start the hadoop
> daemons on boot using reconfig package.
>
> Sent from my BlackBerry, pls excuse typo
>
> -----Original Message-----
> From: Bing Li <lblabs@gmail.com>
> Date: Wed, 28 Mar 2012 03:52:12
> To: <hbase-user@hadoop.apache.org>; user<user@hbase.apache.org>
> Reply-To: user@hbase.apache.org
> Subject: Starting Abnormally After Shutting Down For Some Time
>
> Dear all,
>
> I got a weird problem when programming on the pseudo-distributed mode of
> HBase/Hadoop.
>
> The HBase/Hadoop were installed correctly. It also ran well with my Java
> code.
>
> However, if after shutting down the server for some time, for example, four
> or five days, I noticed that HBase/Hadoop got a problem. I got an ERROR
> when typing "status" in the shell of HBase.
>
>    ERROR: org.apache.hadoop.hbase.MasterNotRunningException: Retried 7
> times
>
> Such a problem had happened for three times in the three weeks.
>
> The HBase/Hadoop are installed on Ubuntu 10.
>
> Have you encountered such a problem? How to solve it?
>
> Thanks so much!
>
> Best regards,
> Bing
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message