spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yasemin Kaya <godo...@gmail.com>
Subject Saving model S3
Date Mon, 21 Mar 2016 13:19:55 GMT
Hi,

I am using S3 read data also I want to save my model S3. In reading part
there is no error, but when I save model I am getting this error
<https://gist.github.com/yaseminn/a22808a9a69a95fbf741>. I tried to change
the way from s3n to s3a but nothing change, different errors comes.

*reading path*
s3n://tani-online/weblog/

*model saving path*
s3n://tani-online/model/

*configuration*
sc.hadoopConfiguration().set("fs.s3.impl","org.apache.hadoop.fs.s3native.NativeS3FileSystem");
sc.hadoopConfiguration().set("fs.s3n.awsAccessKeyId", AWS_ACCESS_KEY_ID);
sc.hadoopConfiguration().set("fs.s3n.awsSecretAccessKey",
AWS_SECRET_ACCESS_KEY);


ps: I am using spark-1.6.0-bin-hadoop2.4

Best,
yasemin

-- 
hiç ender hiç

Mime
View raw message