ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Hurley" <jhur...@hortonworks.com>
Subject Re: Review Request 33777: Agent Changes For Supporting HDP 2.3 Configuration Directories
Date Sun, 03 May 2015 21:32:48 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/33777/
-----------------------------------------------------------

(Updated May 3, 2015, 5:32 p.m.)


Review request for Ambari, Alejandro Fernandez, Nate Cole, and Tom Beerbower.


Changes
-------

Found an issue with Tez on HDP 2.3


Bugs: AMBARI-10894
    https://issues.apache.org/jira/browse/AMBARI-10894


Repository: ambari


Description
-------

Changes are required to support parallel configurations when performing an upgrade. By the
time a command is serialized to JSON and packaged to the agent, the target config values with
stack are already resolved.

The scope of work is the following:
- The agent must always pass the configuration directory to hadoop components when executing
a command. For HDP 2.3, this means using a new, hard-coded schema of choosing the configuration
directory from within the {{/usr/hdp/current/component/conf}} symlink


Diffs (updated)
-----

  ambari-common/src/main/python/resource_management/libraries/script/script.py a4ddc7c 
  ambari-server/src/main/resources/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/params.py
340f247 
  ambari-server/src/main/resources/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/status_params.py
a7a6408 
  ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/falcon.py
62fb1dd 
  ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/params_linux.py
cb13741 
  ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/status_params.py
c5478e5 
  ambari-server/src/main/resources/common-services/FLUME/1.4.0.2.0/package/scripts/params.py
2bc2ff1 
  ambari-server/src/main/resources/common-services/FLUME/1.4.0.2.0/package/scripts/params_linux.py
b5bf203 
  ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/hbase.py
8ce244a 
  ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/params_linux.py
bd0a7b1 
  ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/status_params.py
4ec91a4 
  ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/params_linux.py
c492f60 
  ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/status_params.py
3e4cfe4 
  ambari-server/src/main/resources/common-services/KAFKA/0.8.1.2.2/package/scripts/params.py
e9f8f56 
  ambari-server/src/main/resources/common-services/KAFKA/0.8.1.2.2/package/scripts/status_params.py
fcb0816 
  ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/params.py
3c3db5b 
  ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/params_linux.py
701bcd4 
  ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/status_params.py
52e9c59 
  ambari-server/src/main/resources/common-services/MAHOUT/1.0.0.2.3/package/scripts/params.py
b37a3a8 
  ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/params_linux.py
4be8a50 
  ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/status_params.py
e318c77 
  ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/params_linux.py
af3e18f 
  ambari-server/src/main/resources/common-services/RANGER/0.4.0/package/scripts/params.py
e2b8ba8 
  ambari-server/src/main/resources/common-services/RANGER_KMS/0.5.0.2.3/package/scripts/params.py
409610a 
  ambari-server/src/main/resources/common-services/SLIDER/0.60.0.2.2/package/scripts/params.py
aa60087 
  ambari-server/src/main/resources/common-services/SLIDER/0.60.0.2.2/package/scripts/params_linux.py
4ed93e5 
  ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/params.py
bda4a76 
  ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/status_params.py
733edc1 
  ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/package/scripts/params.py
beed137 
  ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/package/scripts/params_linux.py
131946a 
  ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/params_linux.py
fbfe623 
  ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/status_params.py
a5fe494 
  ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/params_linux.py
f7985c7 
  ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/tez.py ceafa56

  ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/params_linux.py
96e6e30 
  ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/status_params.py
61402a0 
  ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/params_linux.py
cf555fa 
  ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/status_params.py
7cd99b6 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/params.py
16f78b2 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-ANY/scripts/params.py 2262a20

  ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-ANY/scripts/shared_initialization.py
d4242f8 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py e89fd63

  ambari-server/src/test/python/stacks/2.0.6/FLUME/test_flume.py 2317cf7 
  ambari-server/src/test/python/stacks/2.0.6/HBASE/test_hbase_master.py 2a89a40 
  ambari-server/src/test/python/stacks/2.0.6/HBASE/test_hbase_regionserver.py 99e6033 
  ambari-server/src/test/python/stacks/2.0.6/HBASE/test_hbase_service_check.py f08a31a 
  ambari-server/src/test/python/stacks/2.0.6/HBASE/test_phoenix_queryserver.py 0427fe9 
  ambari-server/src/test/python/stacks/2.0.6/HDFS/test_datanode.py 8a90ec8 
  ambari-server/src/test/python/stacks/2.0.6/OOZIE/test_oozie_client.py ec1a783 
  ambari-server/src/test/python/stacks/2.0.6/PIG/test_pig_client.py cfa5569 
  ambari-server/src/test/python/stacks/2.0.6/ZOOKEEPER/test_zookeeper_service_check.py a936b1d

  ambari-server/src/test/python/stacks/2.1/STORM/test_storm_base.py f7b634c 
  ambari-server/src/test/python/stacks/2.1/STORM/test_storm_jaas_configuration.py 047bfaf

  ambari-server/src/test/python/stacks/2.1/configs/secured-storm-start.json a7834c2 
  ambari-server/src/test/python/stacks/2.2/KAFKA/test_kafka_broker.py 151335c 
  ambari-server/src/test/python/stacks/2.2/KNOX/test_knox_gateway.py 82bee2a 
  ambari-server/src/test/python/stacks/2.2/PIG/test_pig_service_check.py f930780 
  ambari-server/src/test/python/stacks/2.2/RANGER/test_ranger_admin.py 6ac0b63 
  ambari-server/src/test/python/stacks/2.2/SLIDER/test_slider_client.py 2a03cde 
  ambari-server/src/test/python/stacks/2.2/SPARK/test_job_history_server.py 6461964 
  ambari-server/src/test/python/stacks/2.2/SPARK/test_spark_client.py 30235f0 
  ambari-server/src/test/python/stacks/2.3/MAHOUT/test_mahout_client.py 628ca96 
  ambari-server/src/test/python/stacks/2.3/MAHOUT/test_mahout_service_check.py 5e09ad2 

Diff: https://reviews.apache.org/r/33777/diff/


Testing
-------

mvn clean test

Installed full stack HDP 2.3 cluster and examine the output statement to ensure that /usr/hdp/current/
was being used for configurations


Thanks,

Jonathan Hurley


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message