ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Onischuk <aonis...@hortonworks.com>
Subject Review Request 43675: Preupload.py should pre-create hdfs directories
Date Wed, 17 Feb 2016 20:48:08 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/43675/
-----------------------------------------------------------

Review request for Ambari and Sumit Gupta.


Bugs: AMBARI-15079
    https://issues.apache.org/jira/browse/AMBARI-15079


Repository: ambari


Description
-------

This should eliminate any 'hadoop --config ... jar' fast-hdfs-resource.jar calls during deploy.
By executing them pre-deploy in preupload.py, and adding to ignore file.
This should benefit ~6 minutes of time deploy, taking the data from 24min cluster. And probably
less for faster deployments.


Diffs
-----

  ambari-common/src/main/python/resource_management/libraries/providers/hdfs_resource.py ebcf1a4

  ambari-common/src/main/python/resource_management/libraries/resources/hdfs_resource.py 7c12409

  ambari-server/src/main/resources/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/params.py
2bd2626 
  ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/scripts/params.py
f3a97fc 
  ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/params_linux.py
b150464 
  ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/params_linux.py
6837bf1 
  ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/params_linux.py
29c4784 
  ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/params_linux.py
dc17dba 
  ambari-server/src/main/resources/common-services/KAFKA/0.8.1.2.2/package/scripts/params.py
47af240 
  ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/params_linux.py
7ec85b5 
  ambari-server/src/main/resources/common-services/MAHOUT/1.0.0.2.3/package/scripts/params.py
69c03ea 
  ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/params_linux.py
7a2f6f6 
  ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/params_linux.py
f923723 
  ambari-server/src/main/resources/common-services/SLIDER/0.60.0.2.2/package/scripts/params_linux.py
09b7876 
  ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/params.py
68c4f37 
  ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/params_linux.py
25da2a1 
  ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/params_linux.py
25f867e 
  ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/params_linux.py
f0b6927 
  ambari-server/src/main/resources/scripts/Ambaripreupload.py 61db286 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py 2a9d7c5


Diff: https://reviews.apache.org/r/43675/diff/


Testing
-------

mvn clean test


Thanks,

Andrew Onischuk


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message