ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dmytro Sen" <d...@hortonworks.com>
Subject Re: Review Request 40433: Add support for ATS v1.5 for HDP versions 2.3 and higher
Date Wed, 18 Nov 2015 12:07:30 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/40433/
-----------------------------------------------------------

(Updated Ноя. 18, 2015, 12:07 п.п.)


Review request for Ambari, Andrew Onischuk and Vitalyi Brodetskyi.


Bugs: AMBARI-13936
    https://issues.apache.org/jira/browse/AMBARI-13936


Repository: ambari


Description
-------

Starting HDP-2.3, Ambari should support ATSv1.5. This involves:
Adding new configs as specified in the doc below. Lets add only the non-advanced configs to
the HDP-2.3 yarn-site (skip all configs after the section ADVANCED CONFIGS)
Adding one new config to tez-site
Ensure that the DFS paths are created and have right permissions
property: yarn.timeline-service.entity-file-cache-store.active-dir (FSPermission 01777)
property: yarn.timeline-service.entity-file-cache-store.done-dir (FSPermission 0700)
Thing(s) to make sure:
yarn.timeline-service.entity-file-cache-store.active-dir and done-dir exist on the cluster
on hdfs. Active dir should have permission 01777, owned by yarn-user, group hadoop-group.
Done dir should have permission 0700, owned by yarn-user, group hadoop-group.
The Tez cache plugin class is in timeline server’s classpath - it should be the case even
now, but lets check
yarn.timeline-service.leveldb-timeline-store.path is a path on local filesystem and needs
to be created with permissions 755 ( owner being the same user as the one which timeline server
is running as ) - this should be happening as well


Diffs (updated)
-----

  ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/params_linux.py
cc42481 
  ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/yarn.py
aa79fe4 
  ambari-server/src/main/resources/stacks/HDP/2.3/services/TEZ/configuration/tez-site.xml
37db69f 
  ambari-server/src/main/resources/stacks/HDP/2.3/services/YARN/configuration/yarn-site.xml
c9e617b 
  ambari-server/src/test/python/stacks/2.1/YARN/test_apptimelineserver.py e949bb0 
  ambari-server/src/test/python/stacks/2.3/YARN/test_ats_1_5.py PRE-CREATION 
  ambari-server/src/test/python/stacks/2.3/configs/ats_1_5.json PRE-CREATION 

Diff: https://reviews.apache.org/r/40433/diff/


Testing
-------

Unit tests passed


Thanks,

Dmytro Sen


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message