hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shahab Yunus <shahab.yu...@gmail.com>
Subject Re: ETL like merge databases to HBase
Date Fri, 02 Aug 2013 03:07:24 GMT
Though it is better as Ted suggested to discuss this in Sqoop mailing list
(as Sqoop 2 supposed to be more feature rich) but just to get this out,
Sqoop does support incremental imports if you can come up with a suitable
and compatible strategy. Tha tmigh thelp you if you configure you imports
on some periodic schedule.

Regards,
Shahab


On Thu, Aug 1, 2013 at 10:17 PM, Jay Vyas <jayunit100@gmail.com> wrote:

> Hbase doesn't have dynamic views on data outside of itself. But you can
> easily re run your sqoop flow to dump information into hbase.
>
> Actually, it might be easier to go with a pure RDBMS solution here since
> nowadays the Slave/master architectures in postgre and MySQL are mature
> enough to handle this sort of thing even for hundreds of thousands of rows.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message