hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shushant Arora <shushantaror...@gmail.com>
Subject Re: data transfer from rdbms to hive
Date Fri, 02 May 2014 04:11:33 GMT
But how to achieve dynamic partitioning. For each row in mysql date from
column get partition name and insert in corresponding partition in hive.
Sqoop requires partition t be told beforehand.




On Fri, May 2, 2014 at 8:36 AM, unmesha sreeveni <unmeshabiju@gmail.com>wrote:

> I suggest you to go for sqoop - They imports data from RDBMS.
>
>
> On Thu, May 1, 2014 at 7:13 PM, Shushant Arora <shushantarora09@gmail.com>wrote:
>
>> Hi
>>
>> I have a requirement to transfer data from RDBMS mysql to partitioned
>> hive table
>> Partitioned on Year and month.
>> Each record in mysql data contains timestamp of user activity.
>>
>> What is the best tool for that.
>>
>> 1.Shall I go with sqoop?
>>
>> 2.How to compute dynamic partition from RDBMS data .
>>
>> Shall I bucketised my fetched data on User Key.
>> Shall I use day also in partition?
>> My requirement is to analyse user activity per day basis.
>>
>> Thanks
>> Shushant
>>
>>
>>
>>
>
>
> --
> *Thanks & Regards *
>
>
> *Unmesha Sreeveni U.B*
> *Hadoop, Bigdata Developer*
> *Center for Cyber Security | Amrita Vishwa Vidyapeetham*
> http://www.unmeshasreeveni.blogspot.in/
>
>
>

Mime
View raw message