hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vimal Jain <vkj...@gmail.com>
Subject Re: Copying data from one Hbase cluster to Another Hbase cluster
Date Fri, 14 Feb 2014 10:15:07 GMT
Hi Samir,
As far as i know all these techniques require map reduce daemons to be up
on source and destination cluster.
Is there any other solution which does not require map reduce at all ?


On Fri, Feb 14, 2014 at 2:41 PM, Samir Ahmic <ahmic.samir@gmail.com> wrote:

> Hi Vimal,
>
> I have few options how to move data from one hbase cluster to another:
>
>
>    1. You can use org.apache.hadoop.hbase.mapreduce.Export tool to export
>    tables to HDFS and then you can use hadoop distcp to move data to
> another
>    cluster. When data is place on second cluster you can use
>    org.apache.hadoop.hbase.mapreduce.Import tool to import tables. Please
>     look at http://hbase.apache.org/book.html#export.
>    2. Second option is to us CopyTable tool, please look at:
>    http://hbase.apache.org/book.html#copytable
>    3. Third option is to enable hbase Snapshots,  create table snapshots,
>    and then use ExportSnapshot tool to move them to second cluster. When
>    snapshots are on second cluster you can clone tables from snapshots.
> Please
>    look: http://hbase.apache.org/book.html#ops.snapshots
>
> I was using 1 and 3 for moving data between clusters and i in my case 3 was
> better solution.
>
> Regards
> Samir
>
>
>
> On Fri, Feb 14, 2014 at 8:33 AM, Vimal Jain <vkjk89@gmail.com> wrote:
>
> > Hi,
> > I have Hbase and Hadoop setup in pseudo distributed mode in production.
> > Now i am planning to move from pseudo distributed mode to fully
> distributed
> > mode ( 2 node cluster).
> > My existing Hbase and Hadoop version are 1.1.2  and  0.94.7.
> > And i am planning to have full distributed mode with Hbase version
> 0.94.16
> > and Hadoop version ( either 1.X or 2.X , not yet decided ).
> >
> > What are different ways to copy data from existing setup ( pseudo
> > distributed mode ) to this new setup ( 2 node fully distributed mode).
> >
> > Please help.
> >
> > --
> > Thanks and Regards,
> > Vimal Jain
> >
>



-- 
Thanks and Regards,
Vimal Jain

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message