ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Onischuk" <aonis...@hortonworks.com>
Subject Review Request 39849: HistoryServer fails to start due to permissions issue (umask 027)
Date Mon, 02 Nov 2015 09:39:02 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/39849/
-----------------------------------------------------------

Review request for Ambari and Vitalyi Brodetskyi.


Bugs: AMBARI-13672
    https://issues.apache.org/jira/browse/AMBARI-13672


Repository: ambari


Description
-------

This jira should also include better error messages for get_user_output
function. Since it was a bit a problem to find out the reason of this one.

    
    
    Traceback (most recent call last):
      File "/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/historyserver.py",
line 182, in <module>
        HistoryServer().execute()
      File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
line 218, in execute
        method(env)
      File "/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/historyserver.py",
line 110, in start
        host_sys_prepped=params.host_sys_prepped) or resource_created
      File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/copy_tarball.py",
line 201, in copy_to_hdfs
        replace_existing_files=replace_existing_files,
      File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 154,
in __init__
        self.env.run()
      File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line
156, in run
        self.run_action(resource, action)
      File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line
119, in run_action
        provider_action()
      File "/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py",
line 394, in action_create_on_execute
        self.action_delayed("create")
      File "/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py",
line 391, in action_delayed
        self.get_hdfs_resource_executor().action_delayed(action_name, self)
      File "/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py",
line 247, in action_delayed
        self._create_resource()
      File "/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py",
line 261, in _create_resource
        self._create_file(self.main_resource.resource.target, source=self.main_resource.resource.source,
mode=self.mode)
      File "/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py",
line 314, in _create_file
        self.util.run_command(target, 'CREATE', method='PUT', overwrite=True, assertable_result=False,
file_to_put=source, **kwargs)
      File "/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py",
line 189, in run_command
        _, out, err = get_user_call_output(cmd, user=self.run_user, logoutput=self.logoutput,
quiet=False)
      File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/get_user_call_output.py",
line 49, in get_user_call_output
        func_result = func(shell.as_user(command_string, user), quiet=quiet, **call_kwargs)
      File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 70,
in inner
        result = function(command, **kwargs)
      File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 92,
in checked_call
        tries=tries, try_sleep=try_sleep)
      File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 140,
in _call_wrapper
        result = _call(command, **kwargs_copy)
      File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 291,
in _call
        raise Fail(err_msg)
    resource_management.core.exceptions.Fail: Execution of 'ambari-sudo.sh su hdfs -l -s /bin/bash
-c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X PUT -T /usr/hdp/2.3.4.0-3106/slider/slider.tar.gz
--negotiate -u : '"'"'http://os-r7-fgghxs-devdeploy-5.novalocal:50070/webhdfs/v1/hdp/apps/2.3.4.0-3106/slider/slider.tar.gz?op=CREATE&user.name=hdfs&overwrite=True&permission=444'"'"'
1>/tmp/tmpWhd3t8 2>/tmp/tmpJfpDIy'' returned 26.
    

After investigation this was found:

    
    
    [root@os-r7-fgghxs-devdeploy-2 ~]# ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS
-L -w '"'"'%{http_code}'"'"' -X PUT -T /usr/hdp/2.3.4.0-3106/slider/slider.tar.gz --negotiate
-u : '"'"'http://os-r7-fgghxs-devdeploy-5.novalocal:50070/webhdfs/v1/hdp/apps/2.3.4.0-3106/slider/slider.tar.gz?op=CREATE&user.name=hdfs&overwrite=True&permission=444'"'"''
    curl: Can't open '/usr/hdp/2.3.4.0-3106/slider/slider.tar.gz'!
    curl: try 'curl --help' or 'curl --manual' for more information
    

For some reason curl cannot open slider tar file.


Diffs
-----

  ambari-common/src/main/python/resource_management/libraries/functions/copy_tarball.py 51a6a3c

  ambari-common/src/main/python/resource_management/libraries/functions/get_user_call_output.py
732cc7f 
  ambari-server/src/main/resources/common-services/SLIDER/0.60.0.2.2/package/scripts/params_linux.py
d7bd296 
  ambari-server/src/main/resources/common-services/SLIDER/0.60.0.2.2/package/scripts/slider.py
1ede7f9 
  ambari-server/src/test/python/stacks/2.2/SLIDER/test_slider_client.py 503cf22 

Diff: https://reviews.apache.org/r/39849/diff/


Testing
-------

mvn clean test


Thanks,

Andrew Onischuk


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message