hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From shengjie min <kelvin....@gmail.com>
Subject Re: ETL like merge databases to HBase
Date Sat, 03 Aug 2013 20:03:32 GMT
Thanks  v much guys. Indeed, I've seen more rich features covered in sqoop2, the integration
with oozie sounds v cool as well. will try to ask this in sqoop mailing list again :) 


On 2 Aug 2013, at 11:07, Shahab Yunus <shahab.yunus@gmail.com> wrote:

> Though it is better as Ted suggested to discuss this in Sqoop mailing list
> (as Sqoop 2 supposed to be more feature rich) but just to get this out,
> Sqoop does support incremental imports if you can come up with a suitable
> and compatible strategy. Tha tmigh thelp you if you configure you imports
> on some periodic schedule.
> Regards,
> Shahab
> On Thu, Aug 1, 2013 at 10:17 PM, Jay Vyas <jayunit100@gmail.com> wrote:
>> Hbase doesn't have dynamic views on data outside of itself. But you can
>> easily re run your sqoop flow to dump information into hbase.
>> Actually, it might be easier to go with a pure RDBMS solution here since
>> nowadays the Slave/master architectures in postgre and MySQL are mature
>> enough to handle this sort of thing even for hundreds of thousands of rows.

View raw message