hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From bichonfrise74 <bichonfris...@gmail.com>
Subject Re: Extract and Load to Hadoop via Pipes
Date Fri, 06 May 2011 22:57:08 GMT
Thanks Zoltan. I will check it out.

2011/5/6 Zoltan Prekopcsak <preko1984@gmail.com>

>  Hi,
>
> I think this is what Sqoop is for:
> http://www.cloudera.com/blog/2009/06/introducing-sqoop/
> http://www.cloudera.com/downloads/sqoop/
>
> Best, Zoltan
>
>
> 5/6/11 7:45 PM keltezéssel, bichonfrise74 írta:
>
>
>> Hi,
>>
>> I want to be able to extract data from Mysql to Hadoop without writing the
>> data to disk. I was thinking in the line of piping the extract and loading
>> it to Hadoop.
>>
>> Something like this:
>>
>> mysql <extract_query> | hive -e 'load data <via_pipe> into table ...
>>
>> Has anyone done this before?
>>
>>
>

Mime
View raw message