ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Onischuk" <aonis...@hortonworks.com>
Subject Re: Review Request 31065: Hive and Oozie could not start after upgrade from 1.5.1 to 2.0.0
Date Mon, 16 Feb 2015 17:46:40 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31065/
-----------------------------------------------------------

(Updated Feb. 16, 2015, 5:46 p.m.)


Review request for Ambari and Myroslav Papirkovskyy.


Bugs: AMBARI-9654
    https://issues.apache.org/jira/browse/AMBARI-9654


Repository: ambari


Description
-------

Cluster: <http://172.18.145.176:8080/#/main/services/OOZIE/summary>  
EXTERNAL HOSTNAMES ****************  
172.18.145.176  
172.18.145.139  
172.18.145.92  
172.18.145.137  
172.18.145.136  
INTERNAL HOSTNAMES *******************  
amb-upg151-rhel6postgres1423903811-10.cs1cloud.internal  
amb-upg151-rhel6postgres1423903811-5.cs1cloud.internal  
amb-upg151-rhel6postgres1423903811-1.cs1cloud.internal  
amb-upg151-rhel6postgres1423903811-4.cs1cloud.internal  
amb-upg151-rhel6postgres1423903811-3.cs1cloud.internal

**STR:**  
1)Deploy old version with all services (HIVE_DB=Mysql (newMyaql)  
OOZIE_DB=Mysql (newMyaql))  
2)Make ambari only upgrade to 2.0.0

**Actual result:**  
Hive (Hive Metastore) and Oozie (Oozie server) could not start.

Hive Metastore

    
    
    
    stderr:   /var/lib/ambari-agent/data/errors-428.txt
    
    Traceback (most recent call last):
      File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_metastore.py",
line 133, in <module>
        HiveMetastore().execute()
      File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
line 208, in execute
        method(env)
      File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_metastore.py",
line 53, in start
        self.configure(env)  # FOR SECURITY
      File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_metastore.py",
line 46, in configure
        hive(name = 'metastore')
      File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive.py",
line 76, in hive
        jdbc_connector()
      File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive.py",
line 201, in jdbc_connector
        content = DownloadSource(params.driver_curl_source),
      File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148,
in __init__
        self.env.run()
      File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line
152, in run
        self.run_action(resource, action)
      File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line
118, in run_action
        provider_action()
      File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py",
line 110, in action_create
        content = self._get_content()
      File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py",
line 152, in _get_content
        return content()
      File "/usr/lib/python2.6/site-packages/resource_management/core/source.py", line 49,
in __call__
        return self.get_content()
      File "/usr/lib/python2.6/site-packages/resource_management/core/source.py", line 177,
in get_content
        web_file = opener.open(req)
      File "/usr/lib64/python2.6/urllib2.py", line 397, in open
        response = meth(req, response)
      File "/usr/lib64/python2.6/urllib2.py", line 510, in http_response
        'http', request, response, code, msg, hdrs)
      File "/usr/lib64/python2.6/urllib2.py", line 435, in error
        return self._call_chain(*args)
      File "/usr/lib64/python2.6/urllib2.py", line 369, in _call_chain
        result = func(*args)
      File "/usr/lib64/python2.6/urllib2.py", line 518, in http_error_default
        raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
    urllib2.HTTPError: HTTP Error 404: Not Found
    stdout:   /var/lib/ambari-agent/data/output-428.txt
    
    2015-02-14 11:44:28,969 - u"Group['hadoop']" {'ignore_failures': False}
    2015-02-14 11:44:28,970 - Modifying group hadoop
    2015-02-14 11:44:29,111 - u"Group['nobody']" {'ignore_failures': False}
    2015-02-14 11:44:29,112 - Modifying group nobody
    2015-02-14 11:44:29,210 - u"Group['users']" {'ignore_failures': False}
    2015-02-14 11:44:29,211 - Modifying group users
    2015-02-14 11:44:29,327 - u"User['hive']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
    2015-02-14 11:44:29,328 - Modifying user hive
    2015-02-14 11:44:29,352 - u"User['oozie']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'users']}
    2015-02-14 11:44:29,352 - Modifying user oozie
    2015-02-14 11:44:29,370 - u"User['nobody']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'nobody']}
    2015-02-14 11:44:29,371 - Modifying user nobody
    2015-02-14 11:44:29,390 - u"User['ambari-qa']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'users']}
    2015-02-14 11:44:29,391 - Modifying user ambari-qa
    2015-02-14 11:44:29,411 - u"User['hdfs']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
    2015-02-14 11:44:29,412 - Modifying user hdfs
    2015-02-14 11:44:29,437 - u"User['storm']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
    2015-02-14 11:44:29,437 - Modifying user storm
    2015-02-14 11:44:29,461 - u"User['mapred']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
    2015-02-14 11:44:29,462 - Modifying user mapred
    2015-02-14 11:44:29,484 - u"User['hbase']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
    2015-02-14 11:44:29,484 - Modifying user hbase
    2015-02-14 11:44:29,502 - u"User['tez']" {'gid': 'hadoop', 'ignore_failures': False, 'groups':
[u'users']}
    2015-02-14 11:44:29,503 - Modifying user tez
    2015-02-14 11:44:29,521 - u"User['zookeeper']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
    2015-02-14 11:44:29,521 - Modifying user zookeeper
    2015-02-14 11:44:29,536 - u"User['falcon']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
    2015-02-14 11:44:29,536 - Modifying user falcon
    2015-02-14 11:44:29,555 - u"User['sqoop']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
    2015-02-14 11:44:29,556 - Modifying user sqoop
    2015-02-14 11:44:29,578 - u"User['yarn']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
    2015-02-14 11:44:29,578 - Modifying user yarn
    2015-02-14 11:44:29,594 - u"User['hcat']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
    2015-02-14 11:44:29,595 - Modifying user hcat
    2015-02-14 11:44:29,612 - u"File['/var/lib/ambari-agent/data/tmp/changeUid.sh']" {'content':
StaticFile('changeToSecureUid.sh'), 'mode': 0555}
    2015-02-14 11:44:29,630 - u"Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh ambari-qa
/tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa']"
{'not_if': 'test $(id -u ambari-qa) -gt 1000'}
    2015-02-14 11:44:29,637 - Skipping u"Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh
ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa']"
due to not_if
    2015-02-14 11:44:29,637 - u"Directory['/grid/0/hadoop/hbase']" {'owner': 'hbase', 'recursive':
True, 'mode': 0775, 'cd_access': 'a'}
    2015-02-14 11:44:29,698 - u"File['/var/lib/ambari-agent/data/tmp/changeUid.sh']" {'content':
StaticFile('changeToSecureUid.sh'), 'mode': 0555}
    2015-02-14 11:44:29,716 - u"Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh hbase
/home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/grid/0/hadoop/hbase']" {'not_if': 'test
$(id -u hbase) -gt 1000'}
    2015-02-14 11:44:29,724 - Skipping u"Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh
hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/grid/0/hadoop/hbase']" due to
not_if
    2015-02-14 11:44:29,725 - u"Group['hdfs']" {'ignore_failures': False}
    2015-02-14 11:44:29,726 - Modifying group hdfs
    2015-02-14 11:44:29,844 - u"User['hdfs']" {'groups': [u'hadoop', 'hdfs', 'hadoop', u'hdfs']}
    2015-02-14 11:44:29,844 - Modifying user hdfs
    2015-02-14 11:44:29,870 - u"Directory['/etc/hadoop']" {'mode': 0755}
    2015-02-14 11:44:29,871 - u"Directory['/etc/hadoop/conf.empty']" {'owner': 'hdfs', 'group':
'hadoop', 'recursive': True}
    2015-02-14 11:44:29,872 - u"Link['/etc/hadoop/conf']" {'not_if': 'ls /etc/hadoop/conf',
'to': '/etc/hadoop/conf.empty'}
    2015-02-14 11:44:29,879 - Skipping u"Link['/etc/hadoop/conf']" due to not_if
    2015-02-14 11:44:29,901 - u"File['/etc/hadoop/conf/hadoop-env.sh']" {'content': InlineTemplate(...),
'owner': 'hdfs', 'group': 'hadoop'}
    2015-02-14 11:44:29,933 - u"Execute['('setenforce', '0')']" {'sudo': True, 'only_if':
'test -f /selinux/enforce'}
    2015-02-14 11:44:29,959 - Skipping u"Execute['('setenforce', '0')']" due to only_if
    2015-02-14 11:44:29,959 - u"Directory['/grid/0/log/hadoop']" {'owner': 'root', 'mode':
0775, 'group': 'hadoop', 'recursive': True, 'cd_access': 'a'}
    2015-02-14 11:44:30,022 - u"Directory['/var/run/hadoop']" {'owner': 'root', 'group': 'root',
'recursive': True, 'cd_access': 'a'}
    2015-02-14 11:44:30,059 - u"Directory['/tmp/hadoop-hdfs']" {'owner': 'hdfs', 'recursive':
True, 'cd_access': 'a'}
    2015-02-14 11:44:30,097 - u"File['/etc/hadoop/conf/commons-logging.properties']" {'content':
Template('commons-logging.properties.j2'), 'owner': 'hdfs'}
    2015-02-14 11:44:30,119 - u"File['/etc/hadoop/conf/health_check']" {'content': Template('health_check-v2.j2'),
'owner': 'hdfs'}
    2015-02-14 11:44:30,133 - u"File['/etc/hadoop/conf/log4j.properties']" {'content': '...',
'owner': 'hdfs', 'group': 'hadoop', 'mode': 0644}
    2015-02-14 11:44:30,160 - u"File['/etc/hadoop/conf/hadoop-metrics2.properties']" {'content':
Template('hadoop-metrics2.properties.j2'), 'owner': 'hdfs'}
    2015-02-14 11:44:30,171 - u"File['/etc/hadoop/conf/task-log4j.properties']" {'content':
StaticFile('task-log4j.properties'), 'mode': 0755}
    2015-02-14 11:44:30,188 - u"File['/etc/hadoop/conf/configuration.xsl']" {'owner': 'hdfs',
'group': 'hadoop'}
    2015-02-14 11:44:30,386 - u"Directory['/etc/hive']" {'mode': 0755}
    2015-02-14 11:44:30,387 - u"Directory['/etc/hive/conf']" {'owner': 'hive', 'group': 'hadoop',
'recursive': True}
    2015-02-14 11:44:30,387 - u"XmlConfig['mapred-site.xml']" {'group': 'hadoop', 'conf_dir':
'/etc/hive/conf', 'mode': 0644, 'configuration_attributes': {}, 'owner': 'hive', 'configurations':
...}
    2015-02-14 11:44:30,404 - Generating config: /etc/hive/conf/mapred-site.xml
    2015-02-14 11:44:30,405 - u"File['/etc/hive/conf/mapred-site.xml']" {'owner': 'hive',
'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'}
    2015-02-14 11:44:30,480 - Writing u"File['/etc/hive/conf/mapred-site.xml']" because contents
don't match
    2015-02-14 11:44:30,510 - u"File['/etc/hive/conf/hive-default.xml.template']" {'owner':
'hive', 'group': 'hadoop'}
    2015-02-14 11:44:30,510 - u"File['/etc/hive/conf/hive-env.sh.template']" {'owner': 'hive',
'group': 'hadoop'}
    2015-02-14 11:44:30,511 - u"File['/etc/hive/conf/hive-exec-log4j.properties']" {'content':
'...', 'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
    2015-02-14 11:44:30,529 - u"File['/etc/hive/conf/hive-log4j.properties']" {'content':
'...', 'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
    2015-02-14 11:44:30,539 - u"Directory['/etc/hive/conf.server']" {'owner': 'hive', 'group':
'hadoop', 'recursive': True}
    2015-02-14 11:44:30,539 - u"XmlConfig['mapred-site.xml']" {'group': 'hadoop', 'conf_dir':
'/etc/hive/conf.server', 'mode': 0644, 'configuration_attributes': {}, 'owner': 'hive', 'configurations':
...}
    2015-02-14 11:44:30,553 - Generating config: /etc/hive/conf.server/mapred-site.xml
    2015-02-14 11:44:30,554 - u"File['/etc/hive/conf.server/mapred-site.xml']" {'owner': 'hive',
'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'}
    2015-02-14 11:44:30,610 - Writing u"File['/etc/hive/conf.server/mapred-site.xml']" because
contents don't match
    2015-02-14 11:44:30,641 - u"File['/etc/hive/conf.server/hive-default.xml.template']" {'owner':
'hive', 'group': 'hadoop'}
    2015-02-14 11:44:30,642 - u"File['/etc/hive/conf.server/hive-env.sh.template']" {'owner':
'hive', 'group': 'hadoop'}
    2015-02-14 11:44:30,643 - u"File['/etc/hive/conf.server/hive-exec-log4j.properties']"
{'content': '...', 'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
    2015-02-14 11:44:30,660 - u"File['/etc/hive/conf.server/hive-log4j.properties']" {'content':
'...', 'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
    2015-02-14 11:44:30,673 - u"XmlConfig['hive-site.xml']" {'group': 'hadoop', 'conf_dir':
'/etc/hive/conf.server', 'mode': 0644, 'configuration_attributes': {}, 'owner': 'hive', 'configurations':
...}
    2015-02-14 11:44:30,687 - Generating config: /etc/hive/conf.server/hive-site.xml
    2015-02-14 11:44:30,687 - u"File['/etc/hive/conf.server/hive-site.xml']" {'owner': 'hive',
'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'}
    2015-02-14 11:44:30,783 - Writing u"File['/etc/hive/conf.server/hive-site.xml']" because
contents don't match
    2015-02-14 11:44:30,825 - u"File['/etc/hive/conf.server/hive-env.sh']" {'content': InlineTemplate(...),
'owner': 'hive', 'group': 'hadoop'}
    2015-02-14 11:44:30,848 - u"Execute['('rm', '-f', '/usr/lib/hive/lib//ojdbc6.jar')']"
{'path': ['/bin', '/usr/bin/'], 'sudo': True}
    2015-02-14 11:44:30,869 - u"File['/var/lib/ambari-agent/data/tmp/mysql-connector-java.jar']"
{'content': DownloadSource('http://amb-upg151-rhel6postgres1423903811-10.cs1cloud.internal:8080/resources//mysql-jdbc-driver.jar')}
    2015-02-14 11:44:30,869 - Downloading the file from http://amb-upg151-rhel6postgres1423903811-10.cs1cloud.internal:8080/resources//mysql-jdbc-driver.jar
    

Oozie Server:

    
    
    
    stderr:   /var/lib/ambari-agent/data/errors-419.txt
    
    Traceback (most recent call last):
      File "/var/lib/ambari-agent/cache/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie_server.py",
line 170, in <module>
        OozieServer().execute()
      File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
line 208, in execute
        method(env)
      File "/var/lib/ambari-agent/cache/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie_server.py",
line 60, in start
        self.configure(env)
      File "/var/lib/ambari-agent/cache/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie_server.py",
line 53, in configure
        oozie(is_server=True)
      File "/var/lib/ambari-agent/cache/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie.py",
line 91, in oozie
        oozie_server_specific()
      File "/var/lib/ambari-agent/cache/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie.py",
line 153, in oozie_server_specific
        content = DownloadSource(params.driver_curl_source),
      File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148,
in __init__
        self.env.run()
      File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line
152, in run
        self.run_action(resource, action)
      File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line
118, in run_action
        provider_action()
      File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py",
line 110, in action_create
        content = self._get_content()
      File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py",
line 152, in _get_content
        return content()
      File "/usr/lib/python2.6/site-packages/resource_management/core/source.py", line 49,
in __call__
        return self.get_content()
      File "/usr/lib/python2.6/site-packages/resource_management/core/source.py", line 177,
in get_content
        web_file = opener.open(req)
      File "/usr/lib64/python2.6/urllib2.py", line 397, in open
        response = meth(req, response)
      File "/usr/lib64/python2.6/urllib2.py", line 510, in http_response
        'http', request, response, code, msg, hdrs)
      File "/usr/lib64/python2.6/urllib2.py", line 435, in error
        return self._call_chain(*args)
      File "/usr/lib64/python2.6/urllib2.py", line 369, in _call_chain
        result = func(*args)
      File "/usr/lib64/python2.6/urllib2.py", line 518, in http_error_default
        raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
    urllib2.HTTPError: HTTP Error 404: Not Found
    stdout:   /var/lib/ambari-agent/data/output-419.txt
    
    2015-02-14 11:42:17,726 - u"Group['hadoop']" {'ignore_failures': False}
    2015-02-14 11:42:17,727 - Modifying group hadoop
    2015-02-14 11:42:17,850 - u"Group['nobody']" {'ignore_failures': False}
    2015-02-14 11:42:17,851 - Modifying group nobody
    2015-02-14 11:42:18,001 - u"Group['users']" {'ignore_failures': False}
    2015-02-14 11:42:18,002 - Modifying group users
    2015-02-14 11:42:18,127 - u"User['hive']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
    2015-02-14 11:42:18,128 - Modifying user hive
    2015-02-14 11:42:18,149 - u"User['oozie']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'users']}
    2015-02-14 11:42:18,149 - Modifying user oozie
    2015-02-14 11:42:18,170 - u"User['nobody']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'nobody']}
    2015-02-14 11:42:18,170 - Modifying user nobody
    2015-02-14 11:42:18,191 - u"User['ambari-qa']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'users']}
    2015-02-14 11:42:18,191 - Modifying user ambari-qa
    2015-02-14 11:42:18,209 - u"User['hdfs']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
    2015-02-14 11:42:18,209 - Modifying user hdfs
    2015-02-14 11:42:18,229 - u"User['storm']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
    2015-02-14 11:42:18,229 - Modifying user storm
    2015-02-14 11:42:18,250 - u"User['mapred']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
    2015-02-14 11:42:18,250 - Modifying user mapred
    2015-02-14 11:42:18,270 - u"User['hbase']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
    2015-02-14 11:42:18,270 - Modifying user hbase
    2015-02-14 11:42:18,290 - u"User['tez']" {'gid': 'hadoop', 'ignore_failures': False, 'groups':
[u'users']}
    2015-02-14 11:42:18,291 - Modifying user tez
    2015-02-14 11:42:18,311 - u"User['zookeeper']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
    2015-02-14 11:42:18,311 - Modifying user zookeeper
    2015-02-14 11:42:18,330 - u"User['falcon']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
    2015-02-14 11:42:18,331 - Modifying user falcon
    2015-02-14 11:42:18,351 - u"User['sqoop']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
    2015-02-14 11:42:18,351 - Modifying user sqoop
    2015-02-14 11:42:18,364 - u"User['yarn']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
    2015-02-14 11:42:18,365 - Modifying user yarn
    2015-02-14 11:42:18,385 - u"User['hcat']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
    2015-02-14 11:42:18,385 - Modifying user hcat
    2015-02-14 11:42:18,403 - u"File['/var/lib/ambari-agent/data/tmp/changeUid.sh']" {'content':
StaticFile('changeToSecureUid.sh'), 'mode': 0555}
    2015-02-14 11:42:18,421 - u"Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh ambari-qa
/tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa']"
{'not_if': 'test $(id -u ambari-qa) -gt 1000'}
    2015-02-14 11:42:18,427 - Skipping u"Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh
ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa']"
due to not_if
    2015-02-14 11:42:18,428 - u"Directory['/grid/0/hadoop/hbase']" {'owner': 'hbase', 'recursive':
True, 'mode': 0775, 'cd_access': 'a'}
    2015-02-14 11:42:18,490 - u"File['/var/lib/ambari-agent/data/tmp/changeUid.sh']" {'content':
StaticFile('changeToSecureUid.sh'), 'mode': 0555}
    2015-02-14 11:42:18,506 - u"Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh hbase
/home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/grid/0/hadoop/hbase']" {'not_if': 'test
$(id -u hbase) -gt 1000'}
    2015-02-14 11:42:18,513 - Skipping u"Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh
hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/grid/0/hadoop/hbase']" due to
not_if
    2015-02-14 11:42:18,514 - u"Group['hdfs']" {'ignore_failures': False}
    2015-02-14 11:42:18,515 - Modifying group hdfs
    2015-02-14 11:42:18,618 - u"User['hdfs']" {'groups': [u'hadoop', 'hdfs', 'hadoop', u'hdfs']}
    2015-02-14 11:42:18,618 - Modifying user hdfs
    2015-02-14 11:42:18,635 - u"Directory['/etc/hadoop']" {'mode': 0755}
    2015-02-14 11:42:18,635 - u"Directory['/etc/hadoop/conf.empty']" {'owner': 'hdfs', 'group':
'hadoop', 'recursive': True}
    2015-02-14 11:42:18,636 - u"Link['/etc/hadoop/conf']" {'not_if': 'ls /etc/hadoop/conf',
'to': '/etc/hadoop/conf.empty'}
    2015-02-14 11:42:18,643 - Skipping u"Link['/etc/hadoop/conf']" due to not_if
    2015-02-14 11:42:18,668 - u"File['/etc/hadoop/conf/hadoop-env.sh']" {'content': InlineTemplate(...),
'owner': 'hdfs', 'group': 'hadoop'}
    2015-02-14 11:42:18,695 - u"Execute['('setenforce', '0')']" {'sudo': True, 'only_if':
'test -f /selinux/enforce'}
    2015-02-14 11:42:18,719 - Skipping u"Execute['('setenforce', '0')']" due to only_if
    2015-02-14 11:42:18,720 - u"Directory['/grid/0/log/hadoop']" {'owner': 'root', 'mode':
0775, 'group': 'hadoop', 'recursive': True, 'cd_access': 'a'}
    2015-02-14 11:42:18,781 - u"Directory['/var/run/hadoop']" {'owner': 'root', 'group': 'root',
'recursive': True, 'cd_access': 'a'}
    2015-02-14 11:42:18,830 - u"Directory['/tmp/hadoop-hdfs']" {'owner': 'hdfs', 'recursive':
True, 'cd_access': 'a'}
    2015-02-14 11:42:18,861 - u"File['/etc/hadoop/conf/commons-logging.properties']" {'content':
Template('commons-logging.properties.j2'), 'owner': 'hdfs'}
    2015-02-14 11:42:18,873 - u"File['/etc/hadoop/conf/health_check']" {'content': Template('health_check-v2.j2'),
'owner': 'hdfs'}
    2015-02-14 11:42:18,889 - u"File['/etc/hadoop/conf/log4j.properties']" {'content': '...',
'owner': 'hdfs', 'group': 'hadoop', 'mode': 0644}
    2015-02-14 11:42:18,920 - u"File['/etc/hadoop/conf/hadoop-metrics2.properties']" {'content':
Template('hadoop-metrics2.properties.j2'), 'owner': 'hdfs'}
    2015-02-14 11:42:18,936 - u"File['/etc/hadoop/conf/task-log4j.properties']" {'content':
StaticFile('task-log4j.properties'), 'mode': 0755}
    2015-02-14 11:42:18,951 - u"File['/etc/hadoop/conf/configuration.xsl']" {'owner': 'hdfs',
'group': 'hadoop'}
    2015-02-14 11:42:19,125 - u"HdfsDirectory['/user/oozie']" {'security_enabled': False,
'keytab': [EMPTY], 'conf_dir': '/etc/hadoop/conf', 'hdfs_user': 'hdfs', 'kinit_path_local':
'', 'mode': 0775, 'owner': 'oozie', 'bin_dir': '/usr/bin', 'action': ['create']}
    2015-02-14 11:42:19,127 - u"Execute['hadoop --config /etc/hadoop/conf fs -mkdir -p /user/oozie
&& hadoop --config /etc/hadoop/conf fs -chmod  775 /user/oozie && hadoop --config
/etc/hadoop/conf fs -chown  oozie /user/oozie']" {'not_if': "/usr/bin/sudo su hdfs -l -s /bin/bash
-c 'hadoop --config /etc/hadoop/conf fs -ls /user/oozie'", 'user': 'hdfs', 'path': ['/usr/bin']}
    2015-02-14 11:42:21,829 - Skipping u"Execute['hadoop --config /etc/hadoop/conf fs -mkdir
-p /user/oozie && hadoop --config /etc/hadoop/conf fs -chmod  775 /user/oozie &&
hadoop --config /etc/hadoop/conf fs -chown  oozie /user/oozie']" due to not_if
    2015-02-14 11:42:21,830 - u"Directory['/etc/oozie/conf']" {'owner': 'oozie', 'group':
'hadoop', 'recursive': True}
    2015-02-14 11:42:21,832 - u"XmlConfig['oozie-site.xml']" {'group': 'hadoop', 'conf_dir':
'/etc/oozie/conf', 'mode': 0664, 'configuration_attributes': {}, 'owner': 'oozie', 'configurations':
...}
    2015-02-14 11:42:21,851 - Generating config: /etc/oozie/conf/oozie-site.xml
    2015-02-14 11:42:21,851 - u"File['/etc/oozie/conf/oozie-site.xml']" {'owner': 'oozie',
'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0664, 'encoding': 'UTF-8'}
    2015-02-14 11:42:21,909 - Writing u"File['/etc/oozie/conf/oozie-site.xml']" because contents
don't match
    2015-02-14 11:42:21,937 - Changing permission for /etc/oozie/conf/oozie-site.xml from
644 to 664
    2015-02-14 11:42:21,962 - u"File['/etc/oozie/conf/oozie-env.sh']" {'content': InlineTemplate(...),
'owner': 'oozie'}
    2015-02-14 11:42:21,980 - u"File['/etc/oozie/conf/oozie-log4j.properties']" {'content':
'...', 'owner': 'oozie', 'group': 'hadoop', 'mode': 0644}
    2015-02-14 11:42:22,000 - u"File['/etc/oozie/conf/adminusers.txt']" {'owner': 'oozie',
'group': 'hadoop'}
    2015-02-14 11:42:22,001 - u"File['/usr/lib/ambari-agent/DBConnectionVerification.jar']"
{'content': DownloadSource('http://amb-upg151-rhel6postgres1423903811-10.cs1cloud.internal:8080/resources/DBConnectionVerification.jar')}
    2015-02-14 11:42:22,002 - Not downloading the file from http://amb-upg151-rhel6postgres1423903811-10.cs1cloud.internal:8080/resources/DBConnectionVerification.jar,
because /var/lib/ambari-agent/data/tmp/DBConnectionVerification.jar already exists
    2015-02-14 11:42:22,014 - u"File['/etc/oozie/conf/hadoop-config.xml']" {'owner': 'oozie',
'group': 'hadoop'}
    2015-02-14 11:42:22,015 - u"File['/etc/oozie/conf/oozie-default.xml']" {'owner': 'oozie',
'group': 'hadoop'}
    2015-02-14 11:42:22,015 - u"Directory['/etc/oozie/conf/action-conf']" {'owner': 'oozie',
'group': 'hadoop'}
    2015-02-14 11:42:22,016 - u"File['/etc/oozie/conf/action-conf/hive.xml']" {'owner': 'oozie',
'group': 'hadoop'}
    2015-02-14 11:42:22,017 - u"File['/var/run/oozie/oozie.pid']" {'action': ['delete'], 'not_if':
'ls {pid_file} >/dev/null 2>&1 && !(ps `cat {pid_file}` >/dev/null 2>&1)'}
    2015-02-14 11:42:22,022 - u"Directory['/usr/lib/oozie//var/tmp/oozie']" {'owner': 'oozie',
'cd_access': 'a', 'group': 'hadoop', 'recursive': True, 'mode': 0755}
    2015-02-14 11:42:22,160 - u"Directory['/var/run/oozie']" {'owner': 'oozie', 'cd_access':
'a', 'group': 'hadoop', 'recursive': True, 'mode': 0755}
    2015-02-14 11:42:22,200 - u"Directory['/grid/0/log/oozie']" {'owner': 'oozie', 'cd_access':
'a', 'group': 'hadoop', 'recursive': True, 'mode': 0755}
    2015-02-14 11:42:22,270 - u"Directory['/var/tmp/oozie']" {'owner': 'oozie', 'cd_access':
'a', 'group': 'hadoop', 'recursive': True, 'mode': 0755}
    2015-02-14 11:42:22,355 - u"Directory['/grid/0/hadoop/oozie/data']" {'owner': 'oozie',
'cd_access': 'a', 'group': 'hadoop', 'recursive': True, 'mode': 0755}
    2015-02-14 11:42:22,469 - u"Directory['/var/lib/oozie/']" {'owner': 'oozie', 'cd_access':
'a', 'group': 'hadoop', 'recursive': True, 'mode': 0755}
    2015-02-14 11:42:22,511 - u"Directory['/var/lib/oozie/oozie-server/webapps/']" {'owner':
'oozie', 'cd_access': 'a', 'group': 'hadoop', 'recursive': True, 'mode': 0755}
    2015-02-14 11:42:22,577 - u"Directory['/var/lib/oozie/oozie-server/conf']" {'owner': 'oozie',
'cd_access': 'a', 'group': 'hadoop', 'recursive': True, 'mode': 0755}
    2015-02-14 11:42:22,638 - u"Directory['/var/lib/oozie/oozie-server']" {'owner': 'oozie',
'recursive': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'}
    2015-02-14 11:42:22,680 - u"Directory['/usr/lib/oozie/libext']" {'recursive': True}
    2015-02-14 11:42:22,682 - u"Execute['('tar', '-xvf', '/usr/lib/oozie/oozie-sharelib.tar.gz',
'-C', '/usr/lib/oozie')']" {'not_if': 'ls /var/run/oozie/oozie.pid >/dev/null 2>&1
&& ps -p `cat /var/run/oozie/oozie.pid` >/dev/null 2>&1', 'sudo': True}
    2015-02-14 11:42:25,221 - u"Execute['('cp', '/usr/share/HDP-oozie/ext-2.2.zip', '/usr/lib/oozie/libext')']"
{'not_if': 'ls /var/run/oozie/oozie.pid >/dev/null 2>&1 && ps -p `cat /var/run/oozie/oozie.pid`
>/dev/null 2>&1', 'sudo': True}
    2015-02-14 11:42:25,244 - u"Execute['('chown', u'oozie:hadoop', '/usr/lib/oozie/libext/ext-2.2.zip')']"
{'not_if': 'ls /var/run/oozie/oozie.pid >/dev/null 2>&1 && ps -p `cat /var/run/oozie/oozie.pid`
>/dev/null 2>&1', 'sudo': True}
    2015-02-14 11:42:25,256 - u"Execute['('chown', '-RL', u'oozie:hadoop', '/var/lib/oozie/oozie-server/conf')']"
{'not_if': 'ls /var/run/oozie/oozie.pid >/dev/null 2>&1 && ps -p `cat /var/run/oozie/oozie.pid`
>/dev/null 2>&1', 'sudo': True}
    2015-02-14 11:42:25,268 - u"File['/var/lib/ambari-agent/data/tmp/mysql-connector-java.jar']"
{'content': DownloadSource('http://amb-upg151-rhel6postgres1423903811-10.cs1cloud.internal:8080/resources//mysql-jdbc-driver.jar')}
    2015-02-14 11:42:25,268 - Downloading the file from http://amb-upg151-rhel6postgres1423903811-10.cs1cloud.internal:8080/resources//mysql-jdbc-driver.jar
    

**Expected result:**   
All services are started.


Diffs (updated)
-----

  ambari-server/src/main/java/org/apache/ambari/server/upgrade/UpgradeCatalog200.java 70e5f78

  ambari-server/src/test/java/org/apache/ambari/server/upgrade/UpgradeCatalog200Test.java
c04397f 

Diff: https://reviews.apache.org/r/31065/diff/


Testing
-------

mvn clean test


Thanks,

Andrew Onischuk


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message