ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dmitro Lisnichenko" <dlysniche...@hortonworks.com>
Subject Re: Review Request 38054: Host check/clean-up logic should clean up new packages and folder names
Date Wed, 02 Sep 2015 13:49:37 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38054/
-----------------------------------------------------------

(Updated Sept. 2, 2015, 1:49 p.m.)


Review request for Ambari and Andrew Onischuk.


Bugs: AMBARI-12581
    https://issues.apache.org/jira/browse/AMBARI-12581


Repository: ambari


Description
-------

Few HDP-2.3 installation ran into problem when install performed on VMs that are not clean.
One of the reported problem is:
Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/hook.py",
line 38, in <module>
    AfterInstallHook().execute()
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
line 218, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/hook.py",
line 35, in hook
    link_configs(self.stroutfile)
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/shared_initialization.py",
line 91, in link_configs
    _link_configs(k, json_version, v)
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/shared_initialization.py",
line 156, in _link_configs
    conf_select.select("HDP", package, version)
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/conf_select.py",
line 241, in select
    shell.checked_call(get_cmd("set-conf-dir", package, version), logoutput=False, quiet=False,
sudo=True)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 70, in inner
    result = function(command, **kwargs)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 92, in checked_call
    tries=tries, try_sleep=try_sleep)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 140, in
_call_wrapper
    result = _call(command, **kwargs_copy)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 291, in
_call
    raise Fail(err_msg)
resource_management.core.exceptions.Fail: Execution of 'conf-select set-conf-dir --package
ranger-kms --stack-version 2.3.0.0-2557 --conf-version 0' returned 1. ranger-kms not installed
or incorrect package name
AMBARI-12515 is looking into making conf-select call more robust but host-clean up script
(along with host checkup) need to be modified to handle the new folders introduced under "/etc"
as well as "/usr/hdp/current" or "/usr/hdp/version".
Suggestion from Nate Cole regarding cleaning up conf dirs.
cd /etc
remove accumulo ambari-* atlas hadoop-* hive* hive-* mahout phoenix ranger spark zookeeper
falcon hadoop hbase kafka knox oozie ranger-* (ranger-admin, ranger-kms, ranger-usersync)
slider sqoop storm pig flume hive-hcatalog
The host check script should be modified to include these folders in the report so that the
cleanup script can clean it.


Diffs
-----

  ambari-agent/src/main/python/ambari_agent/HostCheckReportFileHandler.py a4b898d 
  ambari-agent/src/main/python/ambari_agent/HostInfo.py b979242 
  ambari-server/src/main/resources/custom_actions/scripts/check_host.py 1e54180 

Diff: https://reviews.apache.org/r/38054/diff/


Testing
-------

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Ambari Views ...................................... SUCCESS [2.008s]
[INFO] Ambari Metrics Common ............................. SUCCESS [0.904s]
[INFO] Ambari Server ..................................... SUCCESS [51.725s]
[INFO] Ambari Agent ...................................... SUCCESS [9.076s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 1:07.935s
[INFO] Finished at: Wed Sep 02 16:47:43 EEST 2015
[INFO] Final Memory: 78M/1002M
[INFO] ------------------------------------------------------------------------


Thanks,

Dmitro Lisnichenko


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message