ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Onischuk (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (AMBARI-9654) Hive and Oozie could not start after upgrade from 1.5.1 to 2.0.0
Date Mon, 16 Feb 2015 19:18:11 GMT

     [ https://issues.apache.org/jira/browse/AMBARI-9654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Andrew Onischuk resolved AMBARI-9654.
-------------------------------------
    Resolution: Fixed

Committed to trunk

> Hive and Oozie could not start after upgrade from 1.5.1 to 2.0.0
> ----------------------------------------------------------------
>
>                 Key: AMBARI-9654
>                 URL: https://issues.apache.org/jira/browse/AMBARI-9654
>             Project: Ambari
>          Issue Type: Bug
>            Reporter: Andrew Onischuk
>            Assignee: Andrew Onischuk
>             Fix For: 2.0.0
>
>
> Cluster: <http://172.18.145.176:8080/#/main/services/OOZIE/summary>  
> EXTERNAL HOSTNAMES ****************  
> 172.18.145.176  
> 172.18.145.139  
> 172.18.145.92  
> 172.18.145.137  
> 172.18.145.136  
> INTERNAL HOSTNAMES *******************  
> amb-upg151-rhel6postgres1423903811-10.cs1cloud.internal  
> amb-upg151-rhel6postgres1423903811-5.cs1cloud.internal  
> amb-upg151-rhel6postgres1423903811-1.cs1cloud.internal  
> amb-upg151-rhel6postgres1423903811-4.cs1cloud.internal  
> amb-upg151-rhel6postgres1423903811-3.cs1cloud.internal
> **STR:**  
> 1)Deploy old version with all services (HIVE_DB=Mysql (newMyaql)  
> OOZIE_DB=Mysql (newMyaql))  
> 2)Make ambari only upgrade to 2.0.0
> **Actual result:**  
> Hive (Hive Metastore) and Oozie (Oozie server) could not start.
> Hive Metastore
>     
>     
>     
>     stderr:   /var/lib/ambari-agent/data/errors-428.txt
>     
>     Traceback (most recent call last):
>       File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_metastore.py",
line 133, in <module>
>         HiveMetastore().execute()
>       File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
line 208, in execute
>         method(env)
>       File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_metastore.py",
line 53, in start
>         self.configure(env)  # FOR SECURITY
>       File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_metastore.py",
line 46, in configure
>         hive(name = 'metastore')
>       File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive.py",
line 76, in hive
>         jdbc_connector()
>       File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive.py",
line 201, in jdbc_connector
>         content = DownloadSource(params.driver_curl_source),
>       File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line
148, in __init__
>         self.env.run()
>       File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py",
line 152, in run
>         self.run_action(resource, action)
>       File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py",
line 118, in run_action
>         provider_action()
>       File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py",
line 110, in action_create
>         content = self._get_content()
>       File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py",
line 152, in _get_content
>         return content()
>       File "/usr/lib/python2.6/site-packages/resource_management/core/source.py", line
49, in __call__
>         return self.get_content()
>       File "/usr/lib/python2.6/site-packages/resource_management/core/source.py", line
177, in get_content
>         web_file = opener.open(req)
>       File "/usr/lib64/python2.6/urllib2.py", line 397, in open
>         response = meth(req, response)
>       File "/usr/lib64/python2.6/urllib2.py", line 510, in http_response
>         'http', request, response, code, msg, hdrs)
>       File "/usr/lib64/python2.6/urllib2.py", line 435, in error
>         return self._call_chain(*args)
>       File "/usr/lib64/python2.6/urllib2.py", line 369, in _call_chain
>         result = func(*args)
>       File "/usr/lib64/python2.6/urllib2.py", line 518, in http_error_default
>         raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
>     urllib2.HTTPError: HTTP Error 404: Not Found
>     stdout:   /var/lib/ambari-agent/data/output-428.txt
>     
>     2015-02-14 11:44:28,969 - u"Group['hadoop']" {'ignore_failures': False}
>     2015-02-14 11:44:28,970 - Modifying group hadoop
>     2015-02-14 11:44:29,111 - u"Group['nobody']" {'ignore_failures': False}
>     2015-02-14 11:44:29,112 - Modifying group nobody
>     2015-02-14 11:44:29,210 - u"Group['users']" {'ignore_failures': False}
>     2015-02-14 11:44:29,211 - Modifying group users
>     2015-02-14 11:44:29,327 - u"User['hive']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
>     2015-02-14 11:44:29,328 - Modifying user hive
>     2015-02-14 11:44:29,352 - u"User['oozie']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'users']}
>     2015-02-14 11:44:29,352 - Modifying user oozie
>     2015-02-14 11:44:29,370 - u"User['nobody']" {'gid': 'hadoop', 'ignore_failures':
False, 'groups': [u'nobody']}
>     2015-02-14 11:44:29,371 - Modifying user nobody
>     2015-02-14 11:44:29,390 - u"User['ambari-qa']" {'gid': 'hadoop', 'ignore_failures':
False, 'groups': [u'users']}
>     2015-02-14 11:44:29,391 - Modifying user ambari-qa
>     2015-02-14 11:44:29,411 - u"User['hdfs']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
>     2015-02-14 11:44:29,412 - Modifying user hdfs
>     2015-02-14 11:44:29,437 - u"User['storm']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
>     2015-02-14 11:44:29,437 - Modifying user storm
>     2015-02-14 11:44:29,461 - u"User['mapred']" {'gid': 'hadoop', 'ignore_failures':
False, 'groups': [u'hadoop']}
>     2015-02-14 11:44:29,462 - Modifying user mapred
>     2015-02-14 11:44:29,484 - u"User['hbase']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
>     2015-02-14 11:44:29,484 - Modifying user hbase
>     2015-02-14 11:44:29,502 - u"User['tez']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'users']}
>     2015-02-14 11:44:29,503 - Modifying user tez
>     2015-02-14 11:44:29,521 - u"User['zookeeper']" {'gid': 'hadoop', 'ignore_failures':
False, 'groups': [u'hadoop']}
>     2015-02-14 11:44:29,521 - Modifying user zookeeper
>     2015-02-14 11:44:29,536 - u"User['falcon']" {'gid': 'hadoop', 'ignore_failures':
False, 'groups': [u'hadoop']}
>     2015-02-14 11:44:29,536 - Modifying user falcon
>     2015-02-14 11:44:29,555 - u"User['sqoop']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
>     2015-02-14 11:44:29,556 - Modifying user sqoop
>     2015-02-14 11:44:29,578 - u"User['yarn']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
>     2015-02-14 11:44:29,578 - Modifying user yarn
>     2015-02-14 11:44:29,594 - u"User['hcat']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
>     2015-02-14 11:44:29,595 - Modifying user hcat
>     2015-02-14 11:44:29,612 - u"File['/var/lib/ambari-agent/data/tmp/changeUid.sh']"
{'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
>     2015-02-14 11:44:29,630 - u"Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh
ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa']"
{'not_if': 'test $(id -u ambari-qa) -gt 1000'}
>     2015-02-14 11:44:29,637 - Skipping u"Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh
ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa']"
due to not_if
>     2015-02-14 11:44:29,637 - u"Directory['/grid/0/hadoop/hbase']" {'owner': 'hbase',
'recursive': True, 'mode': 0775, 'cd_access': 'a'}
>     2015-02-14 11:44:29,698 - u"File['/var/lib/ambari-agent/data/tmp/changeUid.sh']"
{'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
>     2015-02-14 11:44:29,716 - u"Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh
hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/grid/0/hadoop/hbase']" {'not_if':
'test $(id -u hbase) -gt 1000'}
>     2015-02-14 11:44:29,724 - Skipping u"Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh
hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/grid/0/hadoop/hbase']" due to
not_if
>     2015-02-14 11:44:29,725 - u"Group['hdfs']" {'ignore_failures': False}
>     2015-02-14 11:44:29,726 - Modifying group hdfs
>     2015-02-14 11:44:29,844 - u"User['hdfs']" {'groups': [u'hadoop', 'hdfs', 'hadoop',
u'hdfs']}
>     2015-02-14 11:44:29,844 - Modifying user hdfs
>     2015-02-14 11:44:29,870 - u"Directory['/etc/hadoop']" {'mode': 0755}
>     2015-02-14 11:44:29,871 - u"Directory['/etc/hadoop/conf.empty']" {'owner': 'hdfs',
'group': 'hadoop', 'recursive': True}
>     2015-02-14 11:44:29,872 - u"Link['/etc/hadoop/conf']" {'not_if': 'ls /etc/hadoop/conf',
'to': '/etc/hadoop/conf.empty'}
>     2015-02-14 11:44:29,879 - Skipping u"Link['/etc/hadoop/conf']" due to not_if
>     2015-02-14 11:44:29,901 - u"File['/etc/hadoop/conf/hadoop-env.sh']" {'content': InlineTemplate(...),
'owner': 'hdfs', 'group': 'hadoop'}
>     2015-02-14 11:44:29,933 - u"Execute['('setenforce', '0')']" {'sudo': True, 'only_if':
'test -f /selinux/enforce'}
>     2015-02-14 11:44:29,959 - Skipping u"Execute['('setenforce', '0')']" due to only_if
>     2015-02-14 11:44:29,959 - u"Directory['/grid/0/log/hadoop']" {'owner': 'root', 'mode':
0775, 'group': 'hadoop', 'recursive': True, 'cd_access': 'a'}
>     2015-02-14 11:44:30,022 - u"Directory['/var/run/hadoop']" {'owner': 'root', 'group':
'root', 'recursive': True, 'cd_access': 'a'}
>     2015-02-14 11:44:30,059 - u"Directory['/tmp/hadoop-hdfs']" {'owner': 'hdfs', 'recursive':
True, 'cd_access': 'a'}
>     2015-02-14 11:44:30,097 - u"File['/etc/hadoop/conf/commons-logging.properties']"
{'content': Template('commons-logging.properties.j2'), 'owner': 'hdfs'}
>     2015-02-14 11:44:30,119 - u"File['/etc/hadoop/conf/health_check']" {'content': Template('health_check-v2.j2'),
'owner': 'hdfs'}
>     2015-02-14 11:44:30,133 - u"File['/etc/hadoop/conf/log4j.properties']" {'content':
'...', 'owner': 'hdfs', 'group': 'hadoop', 'mode': 0644}
>     2015-02-14 11:44:30,160 - u"File['/etc/hadoop/conf/hadoop-metrics2.properties']"
{'content': Template('hadoop-metrics2.properties.j2'), 'owner': 'hdfs'}
>     2015-02-14 11:44:30,171 - u"File['/etc/hadoop/conf/task-log4j.properties']" {'content':
StaticFile('task-log4j.properties'), 'mode': 0755}
>     2015-02-14 11:44:30,188 - u"File['/etc/hadoop/conf/configuration.xsl']" {'owner':
'hdfs', 'group': 'hadoop'}
>     2015-02-14 11:44:30,386 - u"Directory['/etc/hive']" {'mode': 0755}
>     2015-02-14 11:44:30,387 - u"Directory['/etc/hive/conf']" {'owner': 'hive', 'group':
'hadoop', 'recursive': True}
>     2015-02-14 11:44:30,387 - u"XmlConfig['mapred-site.xml']" {'group': 'hadoop', 'conf_dir':
'/etc/hive/conf', 'mode': 0644, 'configuration_attributes': {}, 'owner': 'hive', 'configurations':
...}
>     2015-02-14 11:44:30,404 - Generating config: /etc/hive/conf/mapred-site.xml
>     2015-02-14 11:44:30,405 - u"File['/etc/hive/conf/mapred-site.xml']" {'owner': 'hive',
'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'}
>     2015-02-14 11:44:30,480 - Writing u"File['/etc/hive/conf/mapred-site.xml']" because
contents don't match
>     2015-02-14 11:44:30,510 - u"File['/etc/hive/conf/hive-default.xml.template']" {'owner':
'hive', 'group': 'hadoop'}
>     2015-02-14 11:44:30,510 - u"File['/etc/hive/conf/hive-env.sh.template']" {'owner':
'hive', 'group': 'hadoop'}
>     2015-02-14 11:44:30,511 - u"File['/etc/hive/conf/hive-exec-log4j.properties']" {'content':
'...', 'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
>     2015-02-14 11:44:30,529 - u"File['/etc/hive/conf/hive-log4j.properties']" {'content':
'...', 'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
>     2015-02-14 11:44:30,539 - u"Directory['/etc/hive/conf.server']" {'owner': 'hive',
'group': 'hadoop', 'recursive': True}
>     2015-02-14 11:44:30,539 - u"XmlConfig['mapred-site.xml']" {'group': 'hadoop', 'conf_dir':
'/etc/hive/conf.server', 'mode': 0644, 'configuration_attributes': {}, 'owner': 'hive', 'configurations':
...}
>     2015-02-14 11:44:30,553 - Generating config: /etc/hive/conf.server/mapred-site.xml
>     2015-02-14 11:44:30,554 - u"File['/etc/hive/conf.server/mapred-site.xml']" {'owner':
'hive', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'}
>     2015-02-14 11:44:30,610 - Writing u"File['/etc/hive/conf.server/mapred-site.xml']"
because contents don't match
>     2015-02-14 11:44:30,641 - u"File['/etc/hive/conf.server/hive-default.xml.template']"
{'owner': 'hive', 'group': 'hadoop'}
>     2015-02-14 11:44:30,642 - u"File['/etc/hive/conf.server/hive-env.sh.template']" {'owner':
'hive', 'group': 'hadoop'}
>     2015-02-14 11:44:30,643 - u"File['/etc/hive/conf.server/hive-exec-log4j.properties']"
{'content': '...', 'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
>     2015-02-14 11:44:30,660 - u"File['/etc/hive/conf.server/hive-log4j.properties']"
{'content': '...', 'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
>     2015-02-14 11:44:30,673 - u"XmlConfig['hive-site.xml']" {'group': 'hadoop', 'conf_dir':
'/etc/hive/conf.server', 'mode': 0644, 'configuration_attributes': {}, 'owner': 'hive', 'configurations':
...}
>     2015-02-14 11:44:30,687 - Generating config: /etc/hive/conf.server/hive-site.xml
>     2015-02-14 11:44:30,687 - u"File['/etc/hive/conf.server/hive-site.xml']" {'owner':
'hive', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'}
>     2015-02-14 11:44:30,783 - Writing u"File['/etc/hive/conf.server/hive-site.xml']"
because contents don't match
>     2015-02-14 11:44:30,825 - u"File['/etc/hive/conf.server/hive-env.sh']" {'content':
InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop'}
>     2015-02-14 11:44:30,848 - u"Execute['('rm', '-f', '/usr/lib/hive/lib//ojdbc6.jar')']"
{'path': ['/bin', '/usr/bin/'], 'sudo': True}
>     2015-02-14 11:44:30,869 - u"File['/var/lib/ambari-agent/data/tmp/mysql-connector-java.jar']"
{'content': DownloadSource('http://amb-upg151-rhel6postgres1423903811-10.cs1cloud.internal:8080/resources//mysql-jdbc-driver.jar')}
>     2015-02-14 11:44:30,869 - Downloading the file from http://amb-upg151-rhel6postgres1423903811-10.cs1cloud.internal:8080/resources//mysql-jdbc-driver.jar
>     
> Oozie Server:
>     
>     
>     
>     stderr:   /var/lib/ambari-agent/data/errors-419.txt
>     
>     Traceback (most recent call last):
>       File "/var/lib/ambari-agent/cache/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie_server.py",
line 170, in <module>
>         OozieServer().execute()
>       File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
line 208, in execute
>         method(env)
>       File "/var/lib/ambari-agent/cache/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie_server.py",
line 60, in start
>         self.configure(env)
>       File "/var/lib/ambari-agent/cache/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie_server.py",
line 53, in configure
>         oozie(is_server=True)
>       File "/var/lib/ambari-agent/cache/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie.py",
line 91, in oozie
>         oozie_server_specific()
>       File "/var/lib/ambari-agent/cache/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie.py",
line 153, in oozie_server_specific
>         content = DownloadSource(params.driver_curl_source),
>       File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line
148, in __init__
>         self.env.run()
>       File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py",
line 152, in run
>         self.run_action(resource, action)
>       File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py",
line 118, in run_action
>         provider_action()
>       File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py",
line 110, in action_create
>         content = self._get_content()
>       File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py",
line 152, in _get_content
>         return content()
>       File "/usr/lib/python2.6/site-packages/resource_management/core/source.py", line
49, in __call__
>         return self.get_content()
>       File "/usr/lib/python2.6/site-packages/resource_management/core/source.py", line
177, in get_content
>         web_file = opener.open(req)
>       File "/usr/lib64/python2.6/urllib2.py", line 397, in open
>         response = meth(req, response)
>       File "/usr/lib64/python2.6/urllib2.py", line 510, in http_response
>         'http', request, response, code, msg, hdrs)
>       File "/usr/lib64/python2.6/urllib2.py", line 435, in error
>         return self._call_chain(*args)
>       File "/usr/lib64/python2.6/urllib2.py", line 369, in _call_chain
>         result = func(*args)
>       File "/usr/lib64/python2.6/urllib2.py", line 518, in http_error_default
>         raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
>     urllib2.HTTPError: HTTP Error 404: Not Found
>     stdout:   /var/lib/ambari-agent/data/output-419.txt
>     
>     2015-02-14 11:42:17,726 - u"Group['hadoop']" {'ignore_failures': False}
>     2015-02-14 11:42:17,727 - Modifying group hadoop
>     2015-02-14 11:42:17,850 - u"Group['nobody']" {'ignore_failures': False}
>     2015-02-14 11:42:17,851 - Modifying group nobody
>     2015-02-14 11:42:18,001 - u"Group['users']" {'ignore_failures': False}
>     2015-02-14 11:42:18,002 - Modifying group users
>     2015-02-14 11:42:18,127 - u"User['hive']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
>     2015-02-14 11:42:18,128 - Modifying user hive
>     2015-02-14 11:42:18,149 - u"User['oozie']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'users']}
>     2015-02-14 11:42:18,149 - Modifying user oozie
>     2015-02-14 11:42:18,170 - u"User['nobody']" {'gid': 'hadoop', 'ignore_failures':
False, 'groups': [u'nobody']}
>     2015-02-14 11:42:18,170 - Modifying user nobody
>     2015-02-14 11:42:18,191 - u"User['ambari-qa']" {'gid': 'hadoop', 'ignore_failures':
False, 'groups': [u'users']}
>     2015-02-14 11:42:18,191 - Modifying user ambari-qa
>     2015-02-14 11:42:18,209 - u"User['hdfs']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
>     2015-02-14 11:42:18,209 - Modifying user hdfs
>     2015-02-14 11:42:18,229 - u"User['storm']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
>     2015-02-14 11:42:18,229 - Modifying user storm
>     2015-02-14 11:42:18,250 - u"User['mapred']" {'gid': 'hadoop', 'ignore_failures':
False, 'groups': [u'hadoop']}
>     2015-02-14 11:42:18,250 - Modifying user mapred
>     2015-02-14 11:42:18,270 - u"User['hbase']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
>     2015-02-14 11:42:18,270 - Modifying user hbase
>     2015-02-14 11:42:18,290 - u"User['tez']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'users']}
>     2015-02-14 11:42:18,291 - Modifying user tez
>     2015-02-14 11:42:18,311 - u"User['zookeeper']" {'gid': 'hadoop', 'ignore_failures':
False, 'groups': [u'hadoop']}
>     2015-02-14 11:42:18,311 - Modifying user zookeeper
>     2015-02-14 11:42:18,330 - u"User['falcon']" {'gid': 'hadoop', 'ignore_failures':
False, 'groups': [u'hadoop']}
>     2015-02-14 11:42:18,331 - Modifying user falcon
>     2015-02-14 11:42:18,351 - u"User['sqoop']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
>     2015-02-14 11:42:18,351 - Modifying user sqoop
>     2015-02-14 11:42:18,364 - u"User['yarn']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
>     2015-02-14 11:42:18,365 - Modifying user yarn
>     2015-02-14 11:42:18,385 - u"User['hcat']" {'gid': 'hadoop', 'ignore_failures': False,
'groups': [u'hadoop']}
>     2015-02-14 11:42:18,385 - Modifying user hcat
>     2015-02-14 11:42:18,403 - u"File['/var/lib/ambari-agent/data/tmp/changeUid.sh']"
{'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
>     2015-02-14 11:42:18,421 - u"Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh
ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa']"
{'not_if': 'test $(id -u ambari-qa) -gt 1000'}
>     2015-02-14 11:42:18,427 - Skipping u"Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh
ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa']"
due to not_if
>     2015-02-14 11:42:18,428 - u"Directory['/grid/0/hadoop/hbase']" {'owner': 'hbase',
'recursive': True, 'mode': 0775, 'cd_access': 'a'}
>     2015-02-14 11:42:18,490 - u"File['/var/lib/ambari-agent/data/tmp/changeUid.sh']"
{'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
>     2015-02-14 11:42:18,506 - u"Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh
hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/grid/0/hadoop/hbase']" {'not_if':
'test $(id -u hbase) -gt 1000'}
>     2015-02-14 11:42:18,513 - Skipping u"Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh
hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/grid/0/hadoop/hbase']" due to
not_if
>     2015-02-14 11:42:18,514 - u"Group['hdfs']" {'ignore_failures': False}
>     2015-02-14 11:42:18,515 - Modifying group hdfs
>     2015-02-14 11:42:18,618 - u"User['hdfs']" {'groups': [u'hadoop', 'hdfs', 'hadoop',
u'hdfs']}
>     2015-02-14 11:42:18,618 - Modifying user hdfs
>     2015-02-14 11:42:18,635 - u"Directory['/etc/hadoop']" {'mode': 0755}
>     2015-02-14 11:42:18,635 - u"Directory['/etc/hadoop/conf.empty']" {'owner': 'hdfs',
'group': 'hadoop', 'recursive': True}
>     2015-02-14 11:42:18,636 - u"Link['/etc/hadoop/conf']" {'not_if': 'ls /etc/hadoop/conf',
'to': '/etc/hadoop/conf.empty'}
>     2015-02-14 11:42:18,643 - Skipping u"Link['/etc/hadoop/conf']" due to not_if
>     2015-02-14 11:42:18,668 - u"File['/etc/hadoop/conf/hadoop-env.sh']" {'content': InlineTemplate(...),
'owner': 'hdfs', 'group': 'hadoop'}
>     2015-02-14 11:42:18,695 - u"Execute['('setenforce', '0')']" {'sudo': True, 'only_if':
'test -f /selinux/enforce'}
>     2015-02-14 11:42:18,719 - Skipping u"Execute['('setenforce', '0')']" due to only_if
>     2015-02-14 11:42:18,720 - u"Directory['/grid/0/log/hadoop']" {'owner': 'root', 'mode':
0775, 'group': 'hadoop', 'recursive': True, 'cd_access': 'a'}
>     2015-02-14 11:42:18,781 - u"Directory['/var/run/hadoop']" {'owner': 'root', 'group':
'root', 'recursive': True, 'cd_access': 'a'}
>     2015-02-14 11:42:18,830 - u"Directory['/tmp/hadoop-hdfs']" {'owner': 'hdfs', 'recursive':
True, 'cd_access': 'a'}
>     2015-02-14 11:42:18,861 - u"File['/etc/hadoop/conf/commons-logging.properties']"
{'content': Template('commons-logging.properties.j2'), 'owner': 'hdfs'}
>     2015-02-14 11:42:18,873 - u"File['/etc/hadoop/conf/health_check']" {'content': Template('health_check-v2.j2'),
'owner': 'hdfs'}
>     2015-02-14 11:42:18,889 - u"File['/etc/hadoop/conf/log4j.properties']" {'content':
'...', 'owner': 'hdfs', 'group': 'hadoop', 'mode': 0644}
>     2015-02-14 11:42:18,920 - u"File['/etc/hadoop/conf/hadoop-metrics2.properties']"
{'content': Template('hadoop-metrics2.properties.j2'), 'owner': 'hdfs'}
>     2015-02-14 11:42:18,936 - u"File['/etc/hadoop/conf/task-log4j.properties']" {'content':
StaticFile('task-log4j.properties'), 'mode': 0755}
>     2015-02-14 11:42:18,951 - u"File['/etc/hadoop/conf/configuration.xsl']" {'owner':
'hdfs', 'group': 'hadoop'}
>     2015-02-14 11:42:19,125 - u"HdfsDirectory['/user/oozie']" {'security_enabled': False,
'keytab': [EMPTY], 'conf_dir': '/etc/hadoop/conf', 'hdfs_user': 'hdfs', 'kinit_path_local':
'', 'mode': 0775, 'owner': 'oozie', 'bin_dir': '/usr/bin', 'action': ['create']}
>     2015-02-14 11:42:19,127 - u"Execute['hadoop --config /etc/hadoop/conf fs -mkdir -p
/user/oozie && hadoop --config /etc/hadoop/conf fs -chmod  775 /user/oozie &&
hadoop --config /etc/hadoop/conf fs -chown  oozie /user/oozie']" {'not_if': "/usr/bin/sudo
su hdfs -l -s /bin/bash -c 'hadoop --config /etc/hadoop/conf fs -ls /user/oozie'", 'user':
'hdfs', 'path': ['/usr/bin']}
>     2015-02-14 11:42:21,829 - Skipping u"Execute['hadoop --config /etc/hadoop/conf fs
-mkdir -p /user/oozie && hadoop --config /etc/hadoop/conf fs -chmod  775 /user/oozie
&& hadoop --config /etc/hadoop/conf fs -chown  oozie /user/oozie']" due to not_if
>     2015-02-14 11:42:21,830 - u"Directory['/etc/oozie/conf']" {'owner': 'oozie', 'group':
'hadoop', 'recursive': True}
>     2015-02-14 11:42:21,832 - u"XmlConfig['oozie-site.xml']" {'group': 'hadoop', 'conf_dir':
'/etc/oozie/conf', 'mode': 0664, 'configuration_attributes': {}, 'owner': 'oozie', 'configurations':
...}
>     2015-02-14 11:42:21,851 - Generating config: /etc/oozie/conf/oozie-site.xml
>     2015-02-14 11:42:21,851 - u"File['/etc/oozie/conf/oozie-site.xml']" {'owner': 'oozie',
'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0664, 'encoding': 'UTF-8'}
>     2015-02-14 11:42:21,909 - Writing u"File['/etc/oozie/conf/oozie-site.xml']" because
contents don't match
>     2015-02-14 11:42:21,937 - Changing permission for /etc/oozie/conf/oozie-site.xml
from 644 to 664
>     2015-02-14 11:42:21,962 - u"File['/etc/oozie/conf/oozie-env.sh']" {'content': InlineTemplate(...),
'owner': 'oozie'}
>     2015-02-14 11:42:21,980 - u"File['/etc/oozie/conf/oozie-log4j.properties']" {'content':
'...', 'owner': 'oozie', 'group': 'hadoop', 'mode': 0644}
>     2015-02-14 11:42:22,000 - u"File['/etc/oozie/conf/adminusers.txt']" {'owner': 'oozie',
'group': 'hadoop'}
>     2015-02-14 11:42:22,001 - u"File['/usr/lib/ambari-agent/DBConnectionVerification.jar']"
{'content': DownloadSource('http://amb-upg151-rhel6postgres1423903811-10.cs1cloud.internal:8080/resources/DBConnectionVerification.jar')}
>     2015-02-14 11:42:22,002 - Not downloading the file from http://amb-upg151-rhel6postgres1423903811-10.cs1cloud.internal:8080/resources/DBConnectionVerification.jar,
because /var/lib/ambari-agent/data/tmp/DBConnectionVerification.jar already exists
>     2015-02-14 11:42:22,014 - u"File['/etc/oozie/conf/hadoop-config.xml']" {'owner':
'oozie', 'group': 'hadoop'}
>     2015-02-14 11:42:22,015 - u"File['/etc/oozie/conf/oozie-default.xml']" {'owner':
'oozie', 'group': 'hadoop'}
>     2015-02-14 11:42:22,015 - u"Directory['/etc/oozie/conf/action-conf']" {'owner': 'oozie',
'group': 'hadoop'}
>     2015-02-14 11:42:22,016 - u"File['/etc/oozie/conf/action-conf/hive.xml']" {'owner':
'oozie', 'group': 'hadoop'}
>     2015-02-14 11:42:22,017 - u"File['/var/run/oozie/oozie.pid']" {'action': ['delete'],
'not_if': 'ls {pid_file} >/dev/null 2>&1 && !(ps `cat {pid_file}` >/dev/null
2>&1)'}
>     2015-02-14 11:42:22,022 - u"Directory['/usr/lib/oozie//var/tmp/oozie']" {'owner':
'oozie', 'cd_access': 'a', 'group': 'hadoop', 'recursive': True, 'mode': 0755}
>     2015-02-14 11:42:22,160 - u"Directory['/var/run/oozie']" {'owner': 'oozie', 'cd_access':
'a', 'group': 'hadoop', 'recursive': True, 'mode': 0755}
>     2015-02-14 11:42:22,200 - u"Directory['/grid/0/log/oozie']" {'owner': 'oozie', 'cd_access':
'a', 'group': 'hadoop', 'recursive': True, 'mode': 0755}
>     2015-02-14 11:42:22,270 - u"Directory['/var/tmp/oozie']" {'owner': 'oozie', 'cd_access':
'a', 'group': 'hadoop', 'recursive': True, 'mode': 0755}
>     2015-02-14 11:42:22,355 - u"Directory['/grid/0/hadoop/oozie/data']" {'owner': 'oozie',
'cd_access': 'a', 'group': 'hadoop', 'recursive': True, 'mode': 0755}
>     2015-02-14 11:42:22,469 - u"Directory['/var/lib/oozie/']" {'owner': 'oozie', 'cd_access':
'a', 'group': 'hadoop', 'recursive': True, 'mode': 0755}
>     2015-02-14 11:42:22,511 - u"Directory['/var/lib/oozie/oozie-server/webapps/']" {'owner':
'oozie', 'cd_access': 'a', 'group': 'hadoop', 'recursive': True, 'mode': 0755}
>     2015-02-14 11:42:22,577 - u"Directory['/var/lib/oozie/oozie-server/conf']" {'owner':
'oozie', 'cd_access': 'a', 'group': 'hadoop', 'recursive': True, 'mode': 0755}
>     2015-02-14 11:42:22,638 - u"Directory['/var/lib/oozie/oozie-server']" {'owner': 'oozie',
'recursive': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'}
>     2015-02-14 11:42:22,680 - u"Directory['/usr/lib/oozie/libext']" {'recursive': True}
>     2015-02-14 11:42:22,682 - u"Execute['('tar', '-xvf', '/usr/lib/oozie/oozie-sharelib.tar.gz',
'-C', '/usr/lib/oozie')']" {'not_if': 'ls /var/run/oozie/oozie.pid >/dev/null 2>&1
&& ps -p `cat /var/run/oozie/oozie.pid` >/dev/null 2>&1', 'sudo': True}
>     2015-02-14 11:42:25,221 - u"Execute['('cp', '/usr/share/HDP-oozie/ext-2.2.zip', '/usr/lib/oozie/libext')']"
{'not_if': 'ls /var/run/oozie/oozie.pid >/dev/null 2>&1 && ps -p `cat /var/run/oozie/oozie.pid`
>/dev/null 2>&1', 'sudo': True}
>     2015-02-14 11:42:25,244 - u"Execute['('chown', u'oozie:hadoop', '/usr/lib/oozie/libext/ext-2.2.zip')']"
{'not_if': 'ls /var/run/oozie/oozie.pid >/dev/null 2>&1 && ps -p `cat /var/run/oozie/oozie.pid`
>/dev/null 2>&1', 'sudo': True}
>     2015-02-14 11:42:25,256 - u"Execute['('chown', '-RL', u'oozie:hadoop', '/var/lib/oozie/oozie-server/conf')']"
{'not_if': 'ls /var/run/oozie/oozie.pid >/dev/null 2>&1 && ps -p `cat /var/run/oozie/oozie.pid`
>/dev/null 2>&1', 'sudo': True}
>     2015-02-14 11:42:25,268 - u"File['/var/lib/ambari-agent/data/tmp/mysql-connector-java.jar']"
{'content': DownloadSource('http://amb-upg151-rhel6postgres1423903811-10.cs1cloud.internal:8080/resources//mysql-jdbc-driver.jar')}
>     2015-02-14 11:42:25,268 - Downloading the file from http://amb-upg151-rhel6postgres1423903811-10.cs1cloud.internal:8080/resources//mysql-jdbc-driver.jar
>     
> **Expected result:**   
> All services are started.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message