hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Manoj Babu <manoj...@gmail.com>
Subject Re: Downloading data directly into HDFS
Date Thu, 29 Nov 2012 02:22:12 GMT
You can take look on this http://wiki.apache.org/hadoop/MountableHDFS


Cheers!
Manoj.



On Thu, Nov 29, 2012 at 1:33 AM, Uri Laserson <laserson@cloudera.com> wrote:

> What is the best way to download data directly into HDFS from some remote
> source?
>
> I used this command, which works:
> curl <remote_url> | funzip | hadoop fs -put - /path/filename
>
> Is this the recommended way to go?
>
> Uri
>
> --
> Uri Laserson, PhD
> Data Scientist, Cloudera
> Twitter/GitHub: @laserson
> +1 617 910 0447
> laserson@cloudera.com
>
>

Mime
View raw message