spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Saurav Sinha <sauravsinh...@gmail.com>
Subject Setting spark.yarn.stagingDir in 1.6
Date Wed, 15 Mar 2017 10:36:47 GMT
Hi Users,


I am running spark job in yarn.

I want to set staging directory to some other location which is by default
hdfs://host:port/home/$User/

In spark 2.0.0, it can be done by setting spark.yarn.stagingDir.

But in production, we have spark 1.6. Can anyone please suggest how it can
be done in spark 1.6.

-- 
Thanks and Regards,

Saurav Sinha

Contact: 9742879062

Mime
View raw message