hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ankit Jain <ankitjainc...@gmail.com>
Subject Re: Flume Hive sink
Date Mon, 06 Jun 2011 04:21:31 GMT
Hi,

Load data into hbase using hbase-sink. Ones data store into hbase, create
hive external table corresponding to that hbase table.

On Sun, Jun 5, 2011 at 1:41 AM, bharath vissapragada <
bharathvissapragada1990@gmail.com> wrote:

> Hey,
>
> Hive tables are nothing but some meta-data overlay on top of folders in
> HDFS containing table data. So I guess hdfs-sink of flume suffices.
>
> Please correct me if I am wrong.
>
> Thanks
>
>
> On Sun, Jun 5, 2011 at 1:52 AM, Prashanth R <r.prashanth@gmail.com> wrote:
>
>> Hi,
>>
>> Just throwing this out to get some good ideas. Is anyone aware of any sink
>> for flume that would write / load data directly to the hive tables? If not,
>> one solution that I could think of is dump the data to hdfs or s3 and have a
>> periodic map reduce job load it to hive.
>>
>> --
>> - Prash
>>
>
>
>
> --
> Regards,
> Bharath .V
> w:http://researchweb.iiit.ac.in/~bharath.v
>

Mime
View raw message