hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Charles Menguy <cmen...@adobe.com>
Subject Securely transferring data from HDFS to S3 using distcp
Date Wed, 30 Apr 2014 18:05:36 GMT
Hi,

I wasn't able to find any information regarding the security of using distcp to transfer data
to S3 using something like "hadoop distcp hdfs://... s3n://<access-key>:<secret-key>@<bucket>/...".
I know for example in the Python library boto you can specify is_secure=True to use SSL, but
it is not clear to me what distcp uses and if there is any way to turn SSL on.

Does anyone have any insight on that?

Thanks,

Charles

Mime
View raw message