hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Downloading data directly into HDFS
Date Wed, 28 Nov 2012 20:12:19 GMT
That'd be a proper shell way to go about it, for one-time writes.

On Thu, Nov 29, 2012 at 1:33 AM, Uri Laserson <laserson@cloudera.com> wrote:
> What is the best way to download data directly into HDFS from some remote
> source?
>
> I used this command, which works:
> curl <remote_url> | funzip | hadoop fs -put - /path/filename
>
> Is this the recommended way to go?
>
> Uri
>
> --
> Uri Laserson, PhD
> Data Scientist, Cloudera
> Twitter/GitHub: @laserson
> +1 617 910 0447
> laserson@cloudera.com
>



-- 
Harsh J

Mime
View raw message