Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (athena.apache.org: domain of dwivedishashwat@gmail.com
 designates 209.85.216.169 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAEfu1eOUkVYzSkUSFycxvG_8cFpBhB960Rb1AM_+cSJyGnQX9A@mail.gmail.com>
References: 
 <CAPpvZ9C+t7Fxz=4+8bv_-YT3h9UHPJsaDKF-3PT_5nAuC_TTcw@mail.gmail.com>
	<CAEfu1eOUkVYzSkUSFycxvG_8cFpBhB960Rb1AM_+cSJyGnQX9A@mail.gmail.com>
Date: Mon, 9 Apr 2012 12:41:36 +0530
Message-ID: 
 <CAAXmExUgKJt3o7z87rTsjGnQbET0=xM2MwG5qwdKz6-V6Z-WOA@mail.gmail.com>
Subject: Re: HMaster shutdown when a DNS address cannot be solved
From: shashwat shriparv <dwivedishashwat@gmail.com>
To: user@hbase.apache.org
Content-Type: multipart/alternative; boundary=bcaec524de51895d3004bd39b7a0

--bcaec524de51895d3004bd39b7a0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Since your domain has changed once try to ssh to the new short name you
have added, it will ask to add it to known host just yes to that question,
and check if you can ping to the name you have now,

On Mon, Apr 9, 2012 at 5:19 AM, Amandeep Khurana <amansk@gmail.com> wrote:

> +user
> (bcc: dev)
>
> Mikael,
>
> Such questions are better suited for the user mailing list. You'll
> find more people talking about issues that they ran into and possibly
> get answers to your questions faster.
>
> Hadoop internally using a form of the linux 'hostname' command from
> within Java. When servers report into the master, they register with
> that hostname. Now, if the hosts cannot be reached from outside
> through that name, you'll run into this issue. In other words, you
> need a working DNS to get Hadoop/HBase to work properly.  In your
> case, there is no way for the FQDN (server16.doman=E2=80=A6.) to get mapp=
ed to
> the IP address it seems. You need to fix your host resolution and
> restore it to the working state that it was in earlier.
>
> Hope this helps.
>
> -Amandeep
>
>
> On Sun, Apr 8, 2012 at 11:36 AM, Mikael Sitruk <mikael.sitruk@gmail.com>
> wrote:
> >
> > Hi devs.
> >
> > I have a strange situation with my cluster when an address cannot be
> > resolved.
> > Few days ago I had two entries in a DNS file, so a computer could be
> found
> > either via <host name> or <hostname>.<domain>
> > Now the domain entries in the DNS resolving was removed, (so only the
> short
> > name exists) when i try to start the cluster the master fail indicating
> > that the server address cannot be resolved see below...
> > Any help appreciated???
> > BTW this is hadoop-1.0.0 and HBase-0.92.0
> >
> > 2012-04-08 21:06:45,496 INFO
> > org.apache.hadoop.hbase.catalog.CatalogTracker: Failed verification of
> > -ROOT-,,0 at address=3Dserver118,60020,1333842630426;
> > org.apache.hadoop.hbase.NotServingRegionException: org.apache.had
> > oop.hbase.NotServingRegionException: Region is not online: -ROOT-,,0
> > 2012-04-08 21:06:45,497 INFO
> > org.apache.hadoop.hbase.catalog.RootLocationEditor: Unsetting ROOT regi=
on
> > location in ZooKeeper
> > 2012-04-08 21:06:45,969 INFO
> > org.apache.hadoop.hbase.master.handler.OpenedRegionHandler: Handling
> OPENED
> > event for -ROOT-,,0.70236052 from server119,60020,1333908308851; deleti=
ng
> > unassigned node
> > 2012-04-08 21:06:45,973 INFO
> > org.apache.hadoop.hbase.master.AssignmentManager: The master has opened
> the
> > region -ROOT-,,0.70236052 that was online on
> server119,60020,1333908308851
> > 2012-04-08 21:06:45,976 INFO org.apache.hadoop.hbase.master.HMaster:
> -ROOT-
> > assigned=3D1, rit=3Dfalse, location=3Dserver119,60020,1333908308851
> > 2012-04-08 21:06:46,041 FATAL org.apache.hadoop.hbase.master.HMaster:
> > Master server abort: loaded coprocessors are: []
> > 2012-04-08 21:06:46,042 FATAL org.apache.hadoop.hbase.master.HMaster:
> > Unhandled exception. Starting shutdown.
> > java.net.UnknownHostException: unknown host: server116.<domain>
> >        at
> >
> org.apache.hadoop.hbase.ipc.HBaseClient$Connection.<init>(HBaseClient.jav=
a:227)
> >        at
> >
> org.apache.hadoop.hbase.ipc.HBaseClient.getConnection(HBaseClient.java:10=
16)
> >        at
> > org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:878)
> >        at
> >
> org.apache.hadoop.hbase.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcE=
ngine.java:150)
> >        at $Proxy12.getProtocolVersion(Unknown Source)
> >        at
> >
> org.apache.hadoop.hbase.ipc.WritableRpcEngine.getProxy(WritableRpcEngine.=
java:183)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:303)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:280)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:332)
> >        at
> > org.apache.hadoop.hbase.ipc.HBaseRPC.waitForProxy(HBaseRPC.java:236)
> >        at
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementati=
on.getHRegionConnection(HConnectionManager.java:1278)
> >        at
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementati=
on.getHRegionConnection(HConnectionManager.java:1235)
> >        at
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementati=
on.getHRegionConnection(HConnectionManager.java:1222)
> >        at
> >
> org.apache.hadoop.hbase.catalog.CatalogTracker.getCachedConnection(Catalo=
gTracker.java:564)
> >        at
> >
> org.apache.hadoop.hbase.catalog.CatalogTracker.getMetaServerConnection(Ca=
talogTracker.java:422)
> >        at
> >
> org.apache.hadoop.hbase.catalog.CatalogTracker.waitForMeta(CatalogTracker=
.java:478)
> >        at
> >
> org.apache.hadoop.hbase.catalog.CatalogTracker.waitForMetaServerConnectio=
n(CatalogTracker.java:503)
> >        at
> >
> org.apache.hadoop.hbase.catalog.CatalogTracker.verifyMetaRegionLocation(C=
atalogTracker.java:674)
> >        at
> >
> org.apache.hadoop.hbase.master.HMaster.assignRootAndMeta(HMaster.java:575=
)
> >        at
> >
> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:=
491)
> >        at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:326)
> >        at java.lang.Thread.run(Thread.java:662)
> > 2012-04-08 21:06:46,044 INFO org.apache.hadoop.hbase.master.HMaster:
> > Aborting
> > 2012-04-08 21:06:46,044 INFO org.apache.hadoop.ipc.HBaseServer: Stoppin=
g
> > server on 60000
> >
> > Mikael.S
>


--=20


=E2=88=9E
Shashwat Shriparv

--bcaec524de51895d3004bd39b7a0--