ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Onischuk" <aonis...@hortonworks.com>
Subject Review Request 35006: Unable to install with non-root Agent
Date Wed, 03 Jun 2015 15:06:45 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/35006/
-----------------------------------------------------------

Review request for Ambari and Vitalyi Brodetskyi.


Bugs: AMBARI-11657
    https://issues.apache.org/jira/browse/AMBARI-11657


Repository: ambari


Description
-------

1) non-root ambari server and non-root ambari-agent, umask 027,  
2) Build #1904  
3) I attempt to install HDP 2.3 with hdfs, yarn, hive, zk, tez, atlas...fails
with error below on first component install  
4) switch to agent as root (keeping everything else the same) and things work
fine

    
    
    
    Traceback (most recent call last):
      File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/hook.py",
line 38, in <module>
        BeforeInstallHook().execute()
      File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
line 216, in execute
        method(env)
      File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/hook.py",
line 34, in hook
        install_packages()
      File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/shared_initialization.py",
line 87, in install_packages
        Package(packages)
      File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 116,
in __new__
        cls(name.pop(0), env, provider, **kwargs)
      File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 157,
in __init__
        self.env.run()
      File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line
152, in run
        self.run_action(resource, action)
      File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line
118, in run_action
        provider_action()
      File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py",
line 43, in action_install
        self.install_package(package_name, self.resource.use_repos)
      File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/yumrpm.py",
line 43, in install_package
        if use_repos or not self._check_existence(name):
      File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/yumrpm.py",
line 90, in _check_existence
        package_list = yb.rpmdb.simplePkgList()
      File "/usr/lib64/python2.6/contextlib.py", line 34, in __exit__
        self.gen.throw(type, value, traceback)
      File "/usr/lib/python2.6/site-packages/resource_management/core/utils.py", line 117,
in suppress_stdout
        yield
      File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/yumrpm.py",
line 90, in _check_existence
        package_list = yb.rpmdb.simplePkgList()
      File "/usr/lib/python2.6/site-packages/yum/rpmsack.py", line 502, in simplePkgList
        return self.pkglist
      File "/usr/lib/python2.6/site-packages/yum/rpmsack.py", line 232, in _get_pkglist
        csumpkgtups = self.preloadPackageChecksums(load_packages=False)
      File "/usr/lib/python2.6/site-packages/yum/rpmsack.py", line 979, in preloadPackageChecksums
        rpmdbv = self.simpleVersion(main_only=True)[0]
      File "/usr/lib/python2.6/site-packages/yum/rpmsack.py", line 1125, in simpleVersion
        rpmdbv = self._get_cached_simpleVersion_main()
      File "/usr/lib/python2.6/site-packages/yum/rpmsack.py", line 1075, in _get_cached_simpleVersion_main
        rpmdbv = open(rpmdbvfname).readline()[:-1]
    IOError: [Errno 13] Permission denied: '//var/lib/yum/rpmdb-indexes/version'
    
    stdout:   /var/lib/ambari-agent/data/output-25.txt
    
    2015-06-02 13:49:13,850 - Directory['/var/lib/ambari-agent/data/tmp/AMBARI-artifacts/']
{'recursive': True}
    2015-06-02 13:49:13,874 - File['/var/lib/ambari-agent/data/tmp/AMBARI-artifacts//jce_policy-8.zip']
{'content': DownloadSource('http://c6401.ambari.apache.org:8080/resources//jce_policy-8.zip')}
    2015-06-02 13:49:13,894 - Not downloading the file from http://c6401.ambari.apache.org:8080/resources//jce_policy-8.zip,
because /var/lib/ambari-agent/data/tmp/jce_policy-8.zip already exists
    2015-06-02 13:49:13,914 - Group['hadoopX'] {'ignore_failures': False}
    2015-06-02 13:49:13,915 - Group['usersX'] {'ignore_failures': False}
    2015-06-02 13:49:13,915 - User['ambari-qaX'] {'gid': 'hadoopX', 'ignore_failures': False,
'groups': ['usersX']}
    2015-06-02 13:49:13,916 - User['hcatX'] {'gid': 'hadoopX', 'ignore_failures': False, 'groups':
['hadoopX']}
    2015-06-02 13:49:13,916 - User['yarnX'] {'gid': 'hadoopX', 'ignore_failures': False, 'groups':
['hadoopX']}
    2015-06-02 13:49:13,917 - User['hiveX'] {'gid': 'hadoopX', 'ignore_failures': False, 'groups':
['hadoopX']}
    2015-06-02 13:49:13,917 - User['atlasX'] {'gid': 'hadoopX', 'ignore_failures': False,
'groups': ['hadoopX']}
    2015-06-02 13:49:13,918 - User['hdfsX'] {'gid': 'hadoopX', 'ignore_failures': False, 'groups':
['hadoopX']}
    2015-06-02 13:49:13,919 - User['tezX'] {'gid': 'hadoopX', 'ignore_failures': False, 'groups':
['usersX']}
    2015-06-02 13:49:13,919 - User['zookeeperX'] {'gid': 'hadoopX', 'ignore_failures': False,
'groups': ['hadoopX']}
    2015-06-02 13:49:13,919 - User['mapredX'] {'gid': 'hadoopX', 'ignore_failures': False,
'groups': ['hadoopX']}
    2015-06-02 13:49:13,920 - File['/var/lib/ambari-agent/data/tmp/changeUid.sh'] {'content':
StaticFile('changeToSecureUid.sh'), 'mode': 0555}
    2015-06-02 13:49:13,983 - Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh ambari-qaX
/tmp/hadoop-ambari-qaX,/tmp/hsperfdata_ambari-qaX,/home/ambari-qaX,/tmp/ambari-qaX,/tmp/sqoop-ambari-qaX']
{'not_if': '(test $(id -u ambari-qaX) -gt 1000) || (false)'}
    2015-06-02 13:49:13,988 - Skipping Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh
ambari-qaX /tmp/hadoop-ambari-qaX,/tmp/hsperfdata_ambari-qaX,/home/ambari-qaX,/tmp/ambari-qaX,/tmp/sqoop-ambari-qaX']
due to not_if
    2015-06-02 13:49:13,988 - Group['hdfsX'] {'ignore_failures': False}
    2015-06-02 13:49:13,988 - User['hdfsX'] {'ignore_failures': False, 'groups': ['hadoopX',
'hdfsX']}
    2015-06-02 13:49:13,989 - Directory['/etc/hadoop'] {'mode': 0755}
    2015-06-02 13:49:14,029 - Repository['HDP-2.3'] {'base_url': 'http://s3.amazonaws.com/dev.hortonworks.com/HDP/centos6/2.x/BUILDS/2.3.0.0-2208',
'action': ['create'], 'components': ['HDP', 'main'], 'repo_template': 'repo_suse_rhel.j2',
'repo_file_name': 'HDP', 'mirror_list': None}
    2015-06-02 13:49:14,037 - File['/etc/yum.repos.d/HDP.repo'] {'content': Template('/usr/lib/ambari-server/lib/resource_management/libraries/providers/../data/repo_suse_rhel.j2')}
    2015-06-02 13:49:14,085 - Repository['HDP-UTILS-1.1.0.20'] {'base_url': 'http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.20/repos/centos6',
'action': ['create'], 'components': ['HDP-UTILS', 'main'], 'repo_template': 'repo_suse_rhel.j2',
'repo_file_name': 'HDP-UTILS', 'mirror_list': None}
    2015-06-02 13:49:14,089 - File['/etc/yum.repos.d/HDP-UTILS.repo'] {'content': Template('/usr/lib/ambari-server/lib/resource_management/libraries/providers/../data/repo_suse_rhel.j2')}
    2015-06-02 13:49:14,133 - Package['unzip'] {}
    2015-06-02 13:49:14,221 - Installing package unzip ('/usr/bin/yum -d 0 -e 0 -y install
unzip')
    2015-06-02 13:49:21,096 - Package['curl'] {}


Diffs
-----

  ambari-agent/src/test/python/resource_management/TestPackageResource.py d69f278 
  ambari-common/src/main/python/resource_management/core/providers/package/__init__.py 2358e86

  ambari-common/src/main/python/resource_management/core/providers/package/yumrpm.py 2d39c4d

  ambari-common/src/main/python/resource_management/core/providers/package/zypper.py b7f33f4

  ambari-common/src/main/python/resource_management/core/providers/system.py 43044db 
  ambari-common/src/main/python/resource_management/core/resources/system.py bf10c43 
  ambari-common/src/main/python/resource_management/core/shell.py 2ddc9eb 

Diff: https://reviews.apache.org/r/35006/diff/


Testing
-------

mvn clean test


Thanks,

Andrew Onischuk


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message