hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mikael Sitruk <mikael.sit...@gmail.com>
Subject HMaster shutdown when a DNS address cannot be solved
Date Sun, 08 Apr 2012 18:36:03 GMT
Hi devs.

I have a strange situation with my cluster when an address cannot be
resolved.
Few days ago I had two entries in a DNS file, so a computer could be found
either via <host name> or <hostname>.<domain>
Now the domain entries in the DNS resolving was removed, (so only the short
name exists) when i try to start the cluster the master fail indicating
that the server address cannot be resolved see below...
Any help appreciated???
BTW this is hadoop-1.0.0 and HBase-0.92.0

2012-04-08 21:06:45,496 INFO
org.apache.hadoop.hbase.catalog.CatalogTracker: Failed verification of
-ROOT-,,0 at address=server118,60020,1333842630426;
org.apache.hadoop.hbase.NotServingRegionException: org.apache.had
oop.hbase.NotServingRegionException: Region is not online: -ROOT-,,0
2012-04-08 21:06:45,497 INFO
org.apache.hadoop.hbase.catalog.RootLocationEditor: Unsetting ROOT region
location in ZooKeeper
2012-04-08 21:06:45,969 INFO
org.apache.hadoop.hbase.master.handler.OpenedRegionHandler: Handling OPENED
event for -ROOT-,,0.70236052 from server119,60020,1333908308851; deleting
unassigned node
2012-04-08 21:06:45,973 INFO
org.apache.hadoop.hbase.master.AssignmentManager: The master has opened the
region -ROOT-,,0.70236052 that was online on server119,60020,1333908308851
2012-04-08 21:06:45,976 INFO org.apache.hadoop.hbase.master.HMaster: -ROOT-
assigned=1, rit=false, location=server119,60020,1333908308851
2012-04-08 21:06:46,041 FATAL org.apache.hadoop.hbase.master.HMaster:
Master server abort: loaded coprocessors are: []
2012-04-08 21:06:46,042 FATAL org.apache.hadoop.hbase.master.HMaster:
Unhandled exception. Starting shutdown.
java.net.UnknownHostException: unknown host: server116.<domain>
        at
org.apache.hadoop.hbase.ipc.HBaseClient$Connection.<init>(HBaseClient.java:227)
        at
org.apache.hadoop.hbase.ipc.HBaseClient.getConnection(HBaseClient.java:1016)
        at
org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:878)
        at
org.apache.hadoop.hbase.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:150)
        at $Proxy12.getProtocolVersion(Unknown Source)
        at
org.apache.hadoop.hbase.ipc.WritableRpcEngine.getProxy(WritableRpcEngine.java:183)
        at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:303)
        at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:280)
        at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:332)
        at
org.apache.hadoop.hbase.ipc.HBaseRPC.waitForProxy(HBaseRPC.java:236)
        at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getHRegionConnection(HConnectionManager.java:1278)
        at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getHRegionConnection(HConnectionManager.java:1235)
        at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getHRegionConnection(HConnectionManager.java:1222)
        at
org.apache.hadoop.hbase.catalog.CatalogTracker.getCachedConnection(CatalogTracker.java:564)
        at
org.apache.hadoop.hbase.catalog.CatalogTracker.getMetaServerConnection(CatalogTracker.java:422)
        at
org.apache.hadoop.hbase.catalog.CatalogTracker.waitForMeta(CatalogTracker.java:478)
        at
org.apache.hadoop.hbase.catalog.CatalogTracker.waitForMetaServerConnection(CatalogTracker.java:503)
        at
org.apache.hadoop.hbase.catalog.CatalogTracker.verifyMetaRegionLocation(CatalogTracker.java:674)
        at
org.apache.hadoop.hbase.master.HMaster.assignRootAndMeta(HMaster.java:575)
        at
org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:491)
        at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:326)
        at java.lang.Thread.run(Thread.java:662)
2012-04-08 21:06:46,044 INFO org.apache.hadoop.hbase.master.HMaster:
Aborting
2012-04-08 21:06:46,044 INFO org.apache.hadoop.ipc.HBaseServer: Stopping
server on 60000

Mikael.S

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message