hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shengjie Min <shengjie....@gmail.com>
Subject Re: HBase Java client - unknown host: localhost.localdomain
Date Mon, 26 Aug 2013 03:09:56 GMT
Guys,

I think I got a bit further, I think what happened is:

1. my Hbase client (remote machine) is looking for zookeeper first. It
reads local hbase-site.xml, and finds the zookeeper on the cloudera vm, it
then locates Hbase master no problem.

2. it gets to Hbase master, next step it tries to locate the regions for
the specific HBase table I am asking for, in my case, it's 's1'. It finds
-ROOT- first,

locateRegionInMeta parentTable=-ROOT-,
metaLocation={region=-ROOT-,,0.70236052, hostname=localhost.localdomain,
port=60020} table,

So the problem I guess is that, in hbase, the metadata is pointing to
localhost.localdomain which is correct according to the hbase-site.xml on
my cloudera vm. But My HBase client remotely, of coz, has no idea what is
localhost.localdomain.

I think I need to change the hbase-site.xml in my cloudera vm to point to
the IP address instead of localhost.localdomain. But the question now is,
how do I update the metadata in -ROOT- from localhost to ${IP}? Tried flush
'-ROOT-', didn't work.

hbase(main):002:0> scan '-ROOT-'
ROW                            COLUMN+CELL

 .META.,,1                     column=info:regioninfo,
timestamp=1376375498677, value={NAME => '.META.,,1', STARTKEY
                                => '', ENDKEY => '', ENCODED =>
1028785192,}
 .META.,,1                     column=info:server, timestamp=1377482563657,
value=localhost.localdomain:60020
 .META.,,1                     column=info:serverstartcode,
timestamp=1377482563657, value=1377482552354
 .META.,,1                     column=info:v, timestamp=1376375498677,
value=\x00\x00
1 row(s) in 0.1450 seconds

Shengjie



On 26 August 2013 01:23, Shengjie Min <shengjie.min@gmail.com> wrote:

> Hi Kevin,
>
> Can you be a bit more specific? I need to change my /etc/hosts on my
> Cloudera vm? It is just like this now:
>
> 127.0.0.1   localhost.localdomain   localhost
>
> What you suggest me to do here?
>
> Thanks,
> Shengjie
>
>
> On 26 August 2013 00:59, Kevin O'dell <kevin.odell@cloudera.com> wrote:
>
>> Shengjie,
>>
>>   Looks like you are binding to localhost on your services. Please make
>> sure you correct it so you bind on the interface for zk.
>> On Aug 25, 2013 10:32 AM, "Shengjie Min" <shengjie.min@gmail.com> wrote:
>>
>> > Sure, Kevin,
>> >
>> > http://imgur.com/SQ3Zao9
>> >
>> > Shengjie
>> >
>> >
>> > On 25 August 2013 22:22, Kevin O'dell <kevin.odell@cloudera.com> wrote:
>> >
>> > > Shengjie,
>> > >
>> > >   Good news on being able to connect to the ui from the client. Can
>> you
>> > > post a screen shot on imgur?
>> > > On Aug 25, 2013 10:12 AM, "Jean-Marc Spaggiari" <
>> jean-marc@spaggiari.org
>> > >
>> > > wrote:
>> > >
>> > > > Can you share your client code? Or at least the section where you
do
>> > the
>> > > > connection?
>> > > >
>> > > > Also, have you tried to run the same code from inside the VM?
>> > > >
>> > > > JM
>> > > >
>> > > > 2013/8/25 Shengjie Min <shengjie.min@gmail.com>
>> > > >
>> > > > > Hi Jean-Marc,
>> > > > >
>> > > > > Sorry about the screenshot, yes, my Hbase client is outside of
my
>> VM.
>> > > > And I
>> > > > > can access WebUI from outside: http://cloudera:60010
>> > > > >
>> > > > > Shengjie
>> > > > >
>> > > > >
>> > > > > On 25 August 2013 21:43, Jean-Marc Spaggiari <
>> > jean-marc@spaggiari.org
>> > > > > >wrote:
>> > > > >
>> > > > > > I think you need to post the screenshot on an external website
>> and
>> > > send
>> > > > > the
>> > > > > > link here.
>> > > > > >
>> > > > > > So, you are trying to access your VM from outside of your
VM? Or
>> > your
>> > > > > > client application is into the VM too?
>> > > > > >
>> > > > > > If you are outside of your VM, are you able to access the
VM
>> from
>> > > > > outside?
>> > > > > >
>> > > > > > Like, are you able to access the WebUI from outside of the
VM
>> with
>> > > > > > something like "http://cloudera:60010"?
>> > > > > >
>> > > > > > JM
>> > > > > >
>> > > > > > 2013/8/25 Shengjie Min <shengjie.min@gmail.com>
>> > > > > >
>> > > > > > >
>> > > > > > >
>> > > > > > >
>> > > > > > > On 25 August 2013 21:08, Kevin O'dell <
>> kevin.odell@cloudera.com>
>> > > > > wrote:
>> > > > > > >
>> > > > > > >> Can you attach a screen shot of the HMaster UI?
It appears
>> ZK is
>> > > > > > >> connecting
>> > > > > > >> fine, but can't find .META.
>> > > > > > >> On Aug 25, 2013 8:57 AM, "Shengjie Min" <
>> shengjie.min@gmail.com
>> > >
>> > > > > wrote:
>> > > > > > >>
>> > > > > > >> > Hi Jean-Marc,
>> > > > > > >> >
>> > > > > > >> > You meant my cloudera vm or my client? Here
is my
>> /etc/hosts
>> > > > > > >> >
>> > > > > > >> > cloudera vm:
>> > > > > > >> >
>> > > > > > >> > 127.0.0.1   localhost.localdomain   localhost
>> > > > > > >> >
>> > > > > > >> > client:
>> > > > > > >> > 127.0.0.1       localhost
>> > > > > > >> > 255.255.255.255 broadcasthost
>> > > > > > >> > ::1             localhost
>> > > > > > >> > fe80::1%lo0     localhost
>> > > > > > >> >
>> > > > > > >> > 172.16.144.150  cloudera
>> > > > > > >> >
>> > > > > > >> >
>> > > > > > >> > Shengjie
>> > > > > > >> >
>> > > > > > >> >
>> > > > > > >> > On 25 August 2013 20:28, Jean-Marc Spaggiari
<
>> > > > > jean-marc@spaggiari.org
>> > > > > > >> > >wrote:
>> > > > > > >> >
>> > > > > > >> > > Hi,
>> > > > > > >> > >
>> > > > > > >> > > Do you have your host+ip in your host
file?
>> > > > > > >> > >
>> > > > > > >> > > JM
>> > > > > > >> > >
>> > > > > > >> > > 2013/8/25 Shengjie Min <shengjie.min@gmail.com>
>> > > > > > >> > >
>> > > > > > >> > > > Hi guys,
>> > > > > > >> > > >
>> > > > > > >> > > > I am running cloudera quick start
vm:
>> > > > > > >> > > >
>> > > > > > >> > > > Versions:
>> > > > > > >> > > >
>> > > > > > >> > > > Hadoop: 2.0.0-cdh4.3.1
>> > > > > > >> > > >
>> > > > > > >> > > > HBase: 0.94.6-cdh4.3.1
>> > > > > > >> > > >
>> > > > > > >> > > > Here is my little remote HBase Java
>> > > client(HbaseClient.java),
>> > > > > all
>> > > > > > it
>> > > > > > >> > does
>> > > > > > >> > > > is:
>> > > > > > >> > > >
>> > > > > > >> > > > public static void main(String[]
args) throws
>> IOException
>> > {
>> > > > > > >> > > >     Configuration config = HBaseConfiguration.create();
>> > > > > > >> > > >     HTable table = new HTable(config,
"s1");
>> > > > > > >> > > >     System.out.println(table.getTableName());
>> > > > > > >> > > > }
>> > > > > > >> > > >
>> > > > > > >> > > > hbase-site.xml:
>> > > > > > >> > > >
>> > > > > > >> > > > <property>
>> > > > > > >> > > >     <name>hbase.rootdir</name>
>> > > > > > >> > > >     <value>hdfs://172.16.144.150:8020/hbase</value>
>> > > > > > >> > > >   </property>
>> > > > > > >> > > >   <property>
>> > > > > > >> > > >     <name>zookeeper.znode.parent</name>
>> > > > > > >> > > >     <value>/hbase</value>
>> > > > > > >> > > >   </property>
>> > > > > > >> > > >   .......
>> > > > > > >> > > >   <property>
>> > > > > > >> > > >     <name>zookeeper.znode.rootserver</name>
>> > > > > > >> > > >     <value>root-region-server</value>
>> > > > > > >> > > >   </property>
>> > > > > > >> > > >   <property>
>> > > > > > >> > > >     <name>hbase.zookeeper.quorum</name>
>> > > > > > >> > > >     <value>172.16.144.150</value>
>> > > > > > >> > > >   </property>
>> > > > > > >> > > >
>> > > > > > >> > > > When I run my java client, I get
the error unknown
>> host:
>> > > > > > >> > > > localhost.localdomain:
>> > > > > > >> > > >
>> > > > > > >> > > > Initiating client connection, connectString=
>> > > > 172.16.144.150:2181
>> > > > > > >> > > > sessionTimeout=60000 watcher=hconnection
>> > > > > > >> > > > zookeeper.disableAutoWatchReset
is false
>> > > > > > >> > > > The identifier of this process is
>> > > 41939@smin-MacBook-Pro.local
>> > > > > > >> > > > Opening socket connection to server
cloudera/
>> > > > > 172.16.144.150:2181.
>> > > > > > >> Will
>> > > > > > >> > > > not attempt to authenticate using
SASL (unknown error)
>> > > > > > >> > > > Socket connection established to
cloudera/
>> > > 172.16.144.150:2181
>> > > > ,
>> > > > > > >> > > > initiating session
>> > > > > > >> > > > Session establishment request sent
on cloudera/
>> > > > > > 172.16.144.150:2181
>> > > > > > >> > > > Session establishment complete on
server cloudera/
>> > > > > > >> 172.16.144.150:2181,
>> > > > > > >> > > > sessionid = 0x14076b058850045, negotiated
timeout =
>> 60000
>> > > > > > >> > > > hconnection Received ZooKeeper Event,
type=None,
>> > > > > > >> state=SyncConnected,
>> > > > > > >> > > > path=null
>> > > > > > >> > > > hconnection-0x14076b058850045 connected
>> > > > > > >> > > >
>> > > > > > >> > > > locateRegionInMeta parentTable=-ROOT-,
>> > > > > > >> > > > metaLocation={region=-ROOT-,,0.70236052,
>> > > > > > >> > > > hostname=localhost.localdomain,
port=60020},
>> > > > > > >> > > > attempt=0 of 10 failed; retrying
after sleep of 1000
>> > > because:
>> > > > > > >> > > > unknown host: localhost.localdomain
>> > > > > > >> > > >
>> > > > > > >> > > > Reading reply sessionid:0x14076b058850045,
packet::
>> > > > > > clientPath:null
>> > > > > > >> > > > serverPath:null finished:false header::
17,3
>> >  replyHeader::
>> > > > > > 17,460,0
>> > > > > > >> > > > request:: '/hbase,F  response::
>> > > > > > >> > > > s{20,20,1376375496826,1376375496826,0,32,0,0,0,12,430}
>> > > > > > >> > > > Reading reply sessionid:0x14076b058850045,
packet::
>> > > > > > clientPath:null
>> > > > > > >> > > > serverPath:null finished:false header::
18,4
>> >  replyHeader::
>> > > > > > 18,460,0
>> > > > > > >> > > > request:: '/hbase/root-region-server,T
 response::
>> > > > > > >> > > >
>> > > > > > >> > > >
>> > > > > > >> > >
>> > > > > > >> >
>> > > > > > >>
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> #ffffffff0001b3635323630406c6f63616c686f73742e6c6f63616c646f6d61696e6c6f63616c686f73742e6c6f63616c646f6d61696e2c36303032302c31333737333538373930303037,s{430,430,1377358805621,1377358805621,0,0,0,0,73,0,430}
>> > > > > > >> > > > hconnection-0x14076b058850045 Retrieved
41 byte(s) of
>> data
>> > > > from
>> > > > > > >> znode
>> > > > > > >> > > > /hbase/root-region-server and set
watcher;
>> > > > > > >> > > > localhost.localdomain,60020,1...
>> > > > > > >> > > > Looked up root region location,
>> > > > > > >> > > >
>> > > > > > >> > > >
>> > > > > > >> > >
>> > > > > > >> >
>> > > > > > >>
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@68a7a3a7
>> > > > > > >> > > > ;
>> > > > > > >> > > > serverName=localhost.localdomain,60020,1377358790007
>> > > > > > >> > > >
>> > > > > > >> > > > locateRegionInMeta parentTable=.META.,
>> metaLocation=null,
>> > > > > > attempt=2
>> > > > > > >> of
>> > > > > > >> > > > 10 failed;
>> > > > > > >> > > > retrying after sle
>> > > > > > >> > > >
>> > > > > > >> > > > Any ideas?
>> > > > > > >> > > >
>> > > > > > >> > > > Thanks,
>> > > > > > >> > > >
>> > > > > > >> > > > SHengjie
>> > > > > > >> > > >
>> > > > > > >> > >
>> > > > > > >> >
>> > > > > > >>
>> > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message