ambari-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "guxiaobo1982" <guxiaobo1...@qq.com>
Subject Re: Can't execute the SparkPi example in yarn-cluster mode
Date Fri, 13 Feb 2015 07:06:53 GMT
Hi Zhan 
I am sorry, I found the download link for hortonworks distribution on that page, but you mentioned
1.3.0 version of Spark, I am wondering which distribution do you mean, 1.3.0 of the official
distribution or Hortonworks?








------------------ Original ------------------
From:  "guxiaobo1982";<guxiaobo1982@qq.com>;
Send time: Friday, Feb 13, 2015 2:56 PM
To: "Zhan Zhang"<zzhang@hortonworks.com>; 
Cc: "user"<user@ambari.apache.org>; 
Subject:  Re: Can't execute the SparkPi example in yarn-cluster mode



Hi Zhan,
No, I did not follow that link, I use the pre-built version of 1.2.0 from the Spark official
website,  do you mean that there is a hortonworks distribution of Spark, where can I download
it, and which option should I set ?


Thanks.




------------------ Original ------------------
From:  "Zhan Zhang";<zzhang@hortonworks.com>;
Date:  Feb 13, 2015
To:  ""<guxiaobo1982@qq.com>; 
Cc:  "user"<user@ambari.apache.org>; 
Subject:  Re: Can't execute the SparkPi example in yarn-cluster mode



 If you follow the link in  http://hortonworks.com/hadoop-tutorial/using-apache-spark-hdp/,
 there is a spark.driver.extraJavaOptions  needs to be set in spark-defautls, which only support
in spark-1.3. In Hortonworks dist, the feature is back ported to spark-1.2. This is more about
hortonworks specific issue, we can move the discussion to horntonworks forum. 
 
 Thanks.
 
 
 Zhan Zhang
 
  
 
  On Feb 12, 2015, at 6:21 AM, guxiaobo1982 <guxiaobo1982@qq.com> wrote:
 
 rk  1.2.0 pre
Mime
View raw message