hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ibrahim Yakti <iya...@souq.com>
Subject Re: Reflect MySQL updates into Hive
Date Mon, 24 Dec 2012 13:30:09 GMT
Thanks Mohammad, No, we do not have any plans to replace our RDBMS with
Hive. Hadoop/Hive will be used as Data Warehouse & batch processing
computing, as I said we want to use Hive for analytical queries.


--
Ibrahim


On Mon, Dec 24, 2012 at 4:19 PM, Mohammad Tariq <dontariq@gmail.com> wrote:

> Hello Ibrahim,
>
>      A quick questio. Are you planning to replace your SQL DB with Hive?
> If that is the case, I would not suggest to do that. Both are meant for
> entirely different purposes. Hive is for batch processing and not for real
> time system. So if you are requirements involve real time things, you need
> to think before moving ahead.
>
> Yes, Sqoop is 'the' tool. It is primarily meant for this purpose.
>
> HTH
>
> Best Regards,
> Tariq
> +91-9741563634
> https://mtariq.jux.com/
>
>
> On Mon, Dec 24, 2012 at 6:38 PM, Ibrahim Yakti <iyakti@souq.com> wrote:
>
>> Hi All,
>>
>> We are new to hadoop and hive, we are trying to use hive to
>> run analytical queries and we are using sqoop to import data into hive, in
>> our RDBMS the data updated very frequently and this needs to be reflected
>> to hive. Hive does not support update/delete but there are many workarounds
>> to do this task.
>>
>> What's in our mind is importing all the tables into hive as is, then we
>> build the required tables for reporting.
>>
>> My questions are:
>>
>>    1. What is the best way to reflect MySQL updates into Hive with
>>    minimal resources?
>>    2. Is sqoop the right tool to do the ETL?
>>    3. Is Hive the right tool to do this kind of queries or we should
>>    search for alternatives?
>>
>> Any hint will be useful, thanks in advanced.
>>
>> --
>> Ibrahim
>>
>
>

Mime
View raw message