ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Srimanth Gunturi" <srima...@hortonworks.com>
Subject Re: Review Request 31020: AMBARI-9572: Enhancements to Spark - Ambari integration
Date Sat, 14 Feb 2015 01:44:16 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31020/#review72476
-----------------------------------------------------------

Ship it!


Ship It!

- Srimanth Gunturi


On Feb. 13, 2015, 9:38 p.m., Gautam Borad wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/31020/
> -----------------------------------------------------------
> 
> (Updated Feb. 13, 2015, 9:38 p.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Srimanth Gunturi, and Yusaku Sako.
> 
> 
> Bugs: AMBARI-9572
>     https://issues.apache.org/jira/browse/AMBARI-9572
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> Add the following enhancements to Spark component :
> 1] Fix service check ( currently it fails on a node where history server is not running
)
> 2] Add dependency of HDFS/YARN client on Spark Client / Spark Job History Server
> 3] Check against hdp_stack_version of 2.2.0.0, since Ambari doesnt support reporting
minor verions currently.
> 4] Add a new file javaopts which till take user input and if user does not provide -Dhdp
version, silently append it.
> 5] Add dependency in role_command_order.json to run service check only when job history
server is started
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/configuration/spark-javaopts-properties.xml
PRE-CREATION 
>   ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/metainfo.xml 68833e0

>   ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/job_history_server.py
06389c7 
>   ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/params.py
8189039 
>   ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/service_check.py
8215c2b 
>   ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/setup_spark.py
128f031 
>   ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/spark_client.py
2391286 
>   ambari-server/src/main/resources/stacks/HDP/2.2/role_command_order.json 79eaf78 
> 
> Diff: https://reviews.apache.org/r/31020/diff/
> 
> 
> Testing
> -------
> 
> Tested on RHEL6 3 node cluster.
> Submitted a job using spark-submit and checked the Job History Server for that job.
> 
> 
> Thanks,
> 
> Gautam Borad
> 
>


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message