hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "arvind@cloudera.com" <arv...@cloudera.com>
Subject Re: is there any tool that facilitate the import of data to hbase
Date Thu, 03 Feb 2011 22:44:05 GMT
On Thu, Feb 3, 2011 at 2:17 PM, Weishung Chung <weishung@gmail.com> wrote:

> that's awesome !!!
> could I go from HBase to Mysql too since I might have to maintain
> backward compatibility between the two systems in the process of switch
> over
> to HBase?
>

At this time Sqoop supports importing data from external databases into Hive
and HBase. However, exporting is not directly supported. You could extract
data into HDFS and then move it back to the external system possibly.

We are working on providing export capability from HBase and Hive
to external databases in Sqoop. This will likely be implemented in the next
few releases.

Arvind


>
> On Thu, Feb 3, 2011 at 4:11 PM, arvind@cloudera.com <arvind@cloudera.com
> >wrote:
>
> > On Thu, Feb 3, 2011 at 1:56 PM, Weishung Chung <weishung@gmail.com>
> wrote:
> >
> > > About Sqoop, could I import the data specifically into HBase ?
> > >
> >
> > Yes - Sqoop supports direct imports from external databases into HBase.
> > More
> > details can be found in Sqoop documentation available
> > here<
> >
> http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html#_importing_data_into_hbase
> > >
> > .
> >
> > Arvind
> >
> >
> > > I know I could write a program to read from mysql and use HBase API to
> > > write
> > > to HBase.
> > >
> > > On Thu, Feb 3, 2011 at 3:49 PM, Weishung Chung <weishung@gmail.com>
> > wrote:
> > >
> > > > thank you for the clarification :) I am reading about sqoop now...
> > > >
> > > >
> > > > On Thu, Feb 3, 2011 at 3:41 PM, Mark Kerzner <markkerzner@gmail.com
> > > >wrote:
> > > >
> > > >> scribe is a tool for log aggregation, at face value, not mysql
> > > >>
> > > >> On Thu, Feb 3, 2011 at 3:37 PM, Weishung Chung <weishung@gmail.com>
> > > >> wrote:
> > > >>
> > > >> > Thank you for all the quick response. This really helps me along.
> > How
> > > >> about
> > > >> > facebook's scribe?
> > > >> >
> > > >> > On Thu, Feb 3, 2011 at 3:35 PM, Mark Kerzner <
> markkerzner@gmail.com
> > >
> > > >> > wrote:
> > > >> >
> > > >> > > Overview:
> > > >> > >
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> http://hadoopinpractice.blogspot.com/2011/01/loading-data-from-mysql-to-hadoop.html
> > > >> > >
> > > >> > > On Thu, Feb 3, 2011 at 3:28 PM, Ryan Rawson <ryanobjc@gmail.com
> >
> > > >> wrote:
> > > >> > >
> > > >> > > > ImportTSV?
> > > >> > > >
> > > >> > > >
> > > >> > > >
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/ImportTsv.html
> > > >> > > >
> > > >> > > > Also writing a job to read from JDBC and write to hbase
isnt
> too
> > > bad
> > > >> > > > if your schema isnt too insanely complex.
> > > >> > > >
> > > >> > > > -ryan
> > > >> > > >
> > > >> > > > On Thu, Feb 3, 2011 at 1:23 PM, Buttler, David <
> > buttler1@llnl.gov
> > > >
> > > >> > > wrote:
> > > >> > > > > Sqoop?
> > > >> > > > > http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html
> > > >> > > > >
> > > >> > > > > -----Original Message-----
> > > >> > > > > From: Weishung Chung [mailto:weishung@gmail.com]
> > > >> > > > > Sent: Thursday, February 03, 2011 1:18 PM
> > > >> > > > > To: user@hbase.apache.org
> > > >> > > > > Subject: is there any tool that facilitate the
import of
> data
> > to
> > > >> > hbase
> > > >> > > > >
> > > >> > > > > I am looking for tool that allows me to import
data from
> mysql
> > > to
> > > >> > > hbase.
> > > >> > > > Any
> > > >> > > > > suggestion?
> > > >> > > > > Thank you :)
> > > >> > > > >
> > > >> > > >
> > > >> > >
> > > >> >
> > > >>
> > > >
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message