hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ryan LeCompte <lecom...@gmail.com>
Subject Re: Streaming data into Hadoop
Date Wed, 10 Dec 2008 04:18:04 GMT
Even better! I'll try this out tomorrow.

Thanks,
Ryan




On Dec 9, 2008, at 10:36 PM, "Aaron Kimball" <aaron@cloudera.com> wrote:

> Note also that "cat foo | bin/hadoop fs -put - some/hdfs/path" will  
> use
> stdin.
> - Aaron
>
> On Mon, Dec 8, 2008 at 5:56 PM, Ryan LeCompte <lecompte@gmail.com>  
> wrote:
>
>> Just what I need -- thanks!
>>
>> On Mon, Dec 8, 2008 at 7:31 PM, Alex Loddengaard <alex@cloudera.com>
>> wrote:
>>> This should answer your questions:
>>>
>>> <http://wiki.apache.org/hadoop/MountableHDFS>
>>>
>>> Alex
>>>
>>> On Mon, Dec 8, 2008 at 2:19 PM, Ryan LeCompte <lecompte@gmail.com>
>> wrote:
>>>
>>>> Hello all,
>>>>
>>>> I normally upload files into hadoop via bin/hadoop fs -put file  
>>>> dest.
>>>>
>>>> However, is there a way to somehow stream data into Hadoop?
>>>>
>>>> For example, I'd love to do something like this:
>>>>
>>>> zcat xxx >> HADOOP_HDFS_DESTINATION
>>>>
>>>> This would save me a ton of time since I don't have to first unpack
>>>> the .tgz file and upload the raw file into HDFS.
>>>>
>>>> Is this possible with Hadoop 0.19?
>>>>
>>>> Thanks,
>>>> Ryan
>>>>
>>>
>>

Mime
View raw message