hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Uri Laserson <laser...@cloudera.com>
Subject Downloading data directly into HDFS
Date Wed, 28 Nov 2012 20:03:40 GMT
What is the best way to download data directly into HDFS from some remote
source?

I used this command, which works:
curl <remote_url> | funzip | hadoop fs -put - /path/filename

Is this the recommended way to go?

Uri

-- 
Uri Laserson, PhD
Data Scientist, Cloudera
Twitter/GitHub: @laserson
+1 617 910 0447
laserson@cloudera.com

Mime
View raw message