hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Buttler, David" <buttl...@llnl.gov>
Subject RE: Hbase copytable and export/import
Date Wed, 31 Aug 2011 18:51:54 GMT
If you are doing distributed clusters (even pseudo-distributed), I don't think you should be
using localhost as the address.  Especially if you want to communicate between two different
clusters

-----Original Message-----
From: Stuti Awasthi [mailto:stutiawasthi@hcl.com] 
Sent: Tuesday, August 30, 2011 9:21 PM
To: user@hbase.apache.org
Subject: RE: Hbase copytable and export/import

Hi Jean,

I will try to explain more clearly. I have 2 cluster each single node Hadoop and Hbase cluster.
I can create tables and perform other operation of Hbase in both the cluster individually.
Now I wanted to copy a table from 1 cluster (say A) to other cluster (say B).



In both the cluster, hbase-site.xml looks like this :



<configuration>

<property>

    <name>hbase.rootdir</name>

    <value>hdfs://localhost:54310/hbase</value>

  </property>



<property>

    <name>dfs.replication</name>

    <value>1</value>

    <description>The replication count for HLog and HFile storage. Should not be greater
than HDFS datanode count.

    </description>

  </property>



</configuration>



Thanks



-----Original Message-----
From: jdcryans@gmail.com [mailto:jdcryans@gmail.com] On Behalf Of Jean-Daniel Cryans
Sent: Tuesday, August 30, 2011 10:33 PM
To: user@hbase.apache.org
Subject: Re: Hbase copytable and export/import



Your remote cluster reports the location of -ROOT- as on localhost on port 41181:



11/08/30 19:27:47 DEBUG

client.HConnectionManager$HConnectionImplementation: Lookedup root region location, connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@10d593e<connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@10d593e<mailto:connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@10d593e%3cconnection=org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@10d593e>>;

hsa=localhost:41181



(hsa is the name of the class in HBase, HServerAddress)



Is that "cluster" really just a standalone instance or something like that? That's usually
what happens.



J-D



On Tue, Aug 30, 2011 at 9:27 AM, Stuti Awasthi <stutiawasthi@hcl.com<mailto:stutiawasthi@hcl.com>>
wrote:

> Hi ,

>

> I tried debugging this and got to know that in my master hbase cluster 41181 port is
not opened. I tried telnet to this port but connection refused.

> Following are the steps  did :

>

> Start Hadoop

> Start Hbase

> Created a table via hbase shell

> List the contents of table via hbase shell Tried Copytable command.

>

> Am I missing something ?

>

> From: Stuti Awasthi

> Sent: Tuesday, August 30, 2011 7:57 PM

> To: 'user@hbase.apache.org'

> Subject: RE: Hbase copytable and export/import

>

> Hi Friends,

>

> I referred http://hbase.apache.org/book.html#copytable and  I am successful in copying
my table within same cluster. I am then trying to copy m table to other Hadoop-Hbase cluster
but facing issues in that .

> I used following command format :

>

> ./hbase org.apache.hadoop.hbase.mapreduce.CopyTable

> --new.name=<NewTableName> --peer.adr=<different cluster

> IP>:2181:/hbase <Tablename>

>

> But facing issues. Do we also need to do some entry in hdfs-site.xml to do it correctly.
Also is there any reqirement of password less ssh in this ?

>

> Console logs are like this :

>

> 11/08/30 19:27:41 INFO zookeeper.ZooKeeper: Initiating client

> connection, connectString=10.33.100.117:2181 sessionTimeout=180000

> watcher=hconnection

> 11/08/30 19:27:41 INFO zookeeper.ClientCnxn: Opening socket connection

> to server /10.33.100.117:2181

> 11/08/30 19:27:47 INFO zookeeper.ClientCnxn: Socket connection

> established to 10.33.100.117/10.33.100.117:2181, initiating session

> 11/08/30 19:27:47 INFO zookeeper.ClientCnxn: Session establishment

> complete on server 10.33.100.117/10.33.100.117:2181, sessionid =

> 0x1321ad9bb980007, negotiated timeout = 40000

> 11/08/30 19:27:47 DEBUG

> client.HConnectionManager$HConnectionImplementation: Lookedup root

> region location,

> connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnecti

> onImplementation@10d593e<mailto:connection=org.apache.hadoop.hbase.cli<mailto:onImplementation@10d593e%3cmailto:connection=org.apache.hadoop.hbase.cli>

> ent.HConnectionManager$HConnectionImplementation@10d593e<mailto:ent.HConnectionManager$HConnectionImplementation@10d593e>>;

> hsa=localhost:41181

> 11/08/30 19:27:47 INFO ipc.HbaseRPC: Server at localhost/127.0.0.1:41181 could not be
reached after 1 tries, giving up.

> 11/08/30 19:27:47 DEBUG

> client.HConnectionManager$HConnectionImplementation:

> locateRegionInMeta parentTable=-ROOT-, metaLocation=address:

> localhost:41181, regioninfo: -ROOT-,,0.70236052, attempt=0 of 10

> failed; retrying after sleep of 1000 because: Failed setting up proxy

> interface org.apache.hadoop.hbase.ipc.HRegionInterface to

> localhost/127.0.0.1:41181 after attempts=1

> 11/08/30 19:27:47 DEBUG

> client.HConnectionManager$HConnectionImplementation: Lookedup root

> region location,

> connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnecti

> onImplementation@10d593e<mailto:connection=org.apache.hadoop.hbase.cli<mailto:onImplementation@10d593e%3cmailto:connection=org.apache.hadoop.hbase.cli>

> ent.HConnectionManager$HConnectionImplementation@10d593e<mailto:ent.HConnectionManager$HConnectionImplementation@10d593e>>;

> hsa=localhost:41181

> 11/08/30 19:27:48 DEBUG

> client.HConnectionManager$HConnectionImplementation: Lookedup root

> region location,

> connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnecti

> onImplementation@10d593e<mailto:connection=org.apache.hadoop.hbase.cli<mailto:onImplementation@10d593e%3cmailto:connection=org.apache.hadoop.hbase.cli>

> ent.HConnectionManager$HConnectionImplementation@10d593e<mailto:ent.HConnectionManager$HConnectionImplementation@10d593e>>;

> hsa=localhost:41181

> 11/08/30 19:27:48 INFO ipc.HbaseRPC: Server at localhost/127.0.0.1:41181 could not be
reached after 1 tries, giving up.

> 11/08/30 19:27:48 DEBUG

> client.HConnectionManager$HConnectionImplementation:

> locateRegionInMeta parentTable=-ROOT-, metaLocation=address:

> localhost:41181, regioninfo: -ROOT-,,0.70236052, attempt=1 of 10

> failed; retrying after sleep of 1000 because: Failed setting up proxy

> interface org.apache.hadoop.hbase.ipc.HRegionInterface to

> localhost/127.0.0.1:41181 after attempts=1

> 11/08/30 19:27:48 DEBUG

> client.HConnectionManager$HConnectionImplementation: Lookedup root

> region location,

> connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnecti

> onImplementation@10d593e<mailto:connection=org.apache.hadoop.hbase.cli<mailto:onImplementation@10d593e%3cmailto:connection=org.apache.hadoop.hbase.cli>

> ent.HConnectionManager$HConnectionImplementation@10d593e<mailto:ent.HConnectionManager$HConnectionImplementation@10d593e>>;

> hsa=localhost:41181

> 11/08/30 19:27:49 DEBUG

> client.HConnectionManager$HConnectionImplementation: Lookedup root

> region location,

> connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnecti

> onImplementation@10d593e<mailto:connection=org.apache.hadoop.hbase.cli<mailto:onImplementation@10d593e%3cmailto:connection=org.apache.hadoop.hbase.cli>

> ent.HConnectionManager$HConnectionImplementation@10d593e<mailto:ent.HConnectionManager$HConnectionImplementation@10d593e>>;

> hsa=localhost:41181

> 11/08/30 19:27:49 INFO ipc.HbaseRPC: Server at localhost/127.0.0.1:41181 could not be
reached after 1 tries, giving up.

> 11/08/30 19:27:49 DEBUG

> client.HConnectionManager$HConnectionImplementation:

> locateRegionInMeta parentTable=-ROOT-, metaLocation=address:

> localhost:41181, regioninfo: -R

>

> Please suggest

>

> Stuti

>

> From: Stuti Awasthi

> Sent: Tuesday, August 30, 2011 2:52 PM

> To: 'user@hbase.apache.org'

> Subject: Hbase copytable and export/import

>

> Hi ,

>

> I want to try copy table and export/import utility of Hbase for data

> backup. I am using Hadoop 0.20.2 and Hbase 0.90.3 I was trying to apply the patch given
at https://issues.apache.org/jira/browse/HBASE-2221 , but this is giving me error. Is this
patch is not for Hbase-0.90.3.

>

> Please guide me to get correct patches

>

> Thanks & Regards

> Stuti Awasthi

>

> ________________________________

> ::DISCLAIMER::

> ----------------------------------------------------------------------

> -------------------------------------------------

>

> The contents of this e-mail and any attachment(s) are confidential and intended for the
named recipient(s) only.

> It shall not attach any liability on the originator or HCL or its

> affiliates. Any views or opinions presented in this email are solely those of the author
and may not necessarily reflect the opinions of HCL or its affiliates.

> Any form of reproduction, dissemination, copying, disclosure,

> modification, distribution and / or publication of this message

> without the prior written consent of the author of this e-mail is

> strictly prohibited. If you have received this email in error please delete it and notify
the sender immediately. Before opening any mail and attachments please check them for viruses
and defect.

>

> ----------------------------------------------------------------------

> -------------------------------------------------

>

Mime
View raw message