ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Onischuk" <aonis...@hortonworks.com>
Subject Review Request 33163: Spark History Server does not start with non-root agent
Date Tue, 14 Apr 2015 08:00:42 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/33163/
-----------------------------------------------------------

Review request for Ambari and Vitalyi Brodetskyi.


Bugs: AMBARI-10461
    https://issues.apache.org/jira/browse/AMBARI-10461


Repository: ambari


Description
-------

When using a non-root agent, the Spark History Server fails to start even
though Ambari thinks the component Started. It appears that there is a failure
to create the: /etc/spark/conf/spark-defaults.conf file. No logs are produced
in /var/log/spark:

    
    
    [ambari@revo5 spark]$ pwd
    /var/log/spark
    [ambari@revo5 spark]$ find .
    .
    [ambari@revo5 spark]$ 
    

This is with Ambari 2.0.0-148 with Stack: 2.2.3.0-2611.

There are no traces of spark-default.conf in /var/log/secure. So it seems like
it's trying to create the directory and file without using sudo, which in this
case will fail as Ambari Agent is running as a non-root 'ambari' user.


Diffs
-----

  ambari-common/src/main/python/resource_management/libraries/functions/__init__.py 6b3d572

  ambari-common/src/main/python/resource_management/libraries/providers/properties_file.py
8b2eba7 
  ambari-common/src/main/python/resource_management/libraries/resources/properties_file.py
0e5afb4 
  ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/job_history_server.py
ff04b58 
  ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/params.py
8d2d285 
  ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/service_check.py
7b8ba38 
  ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/setup_spark.py
6935b08 
  ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/spark_client.py
970dc6d 
  ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/spark_service.py
PRE-CREATION 
  ambari-server/src/test/python/stacks/2.2/SPARK/test_job_history_server.py 469f68e 
  ambari-server/src/test/python/stacks/2.2/SPARK/test_spark_client.py PRE-CREATION 
  ambari-server/src/test/python/stacks/2.2/SPARK/test_spark_service_check.py PRE-CREATION

  ambari-server/src/test/python/stacks/2.2/configs/default.json 0a9a132 
  ambari-server/src/test/python/stacks/2.2/configs/secured.json b2afe06 

Diff: https://reviews.apache.org/r/33163/diff/


Testing
-------

mvn clean test


Thanks,

Andrew Onischuk


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message