ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jayush Luniya (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AMBARI-9117) Ambari Upgrade leaves empty package directory after services were moved to common services
Date Wed, 14 Jan 2015 01:56:34 GMT

    [ https://issues.apache.org/jira/browse/AMBARI-9117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14276371#comment-14276371
] 

Jayush Luniya commented on AMBARI-9117:
---------------------------------------

This is caused because of incorrect cleanup during upgrade. If you check /var/lib/ambari-server/resources/stacks/HDP/2.0.6/services
after upgrade you will see empty package directory for each service. This results in an empty
archive.zip to be created which is replicated to the ambari-agent cache as an empty folder.
Because of the empty packageDir, stack inheritence will return the packageDir for HDP2.2 HDFS
to be /var/lib/ambari-agent/cache/resources/stacks/HDP/2.0.6/services/HDFS/package instead
of var/lib/ambari-agent/cache/resources/common-services/HDFS/2.1.0.2.0/package because of
which you are seeing this failure.
root@c6401 FLUME# pwd
/var/lib/ambari-server/resources/stacks/HDP/2.0.6/services/FLUME
root@c6401 FLUME# ls -l package/
total 0
-rwxr-xr-x 1 root root 0 Jan 9 03:02 archive.zip
Workaround: 
If you delete the empty package folders (i.e. folders with empty archive.zip as well) from
/var/lib/ambari-server/resources/stacks/HDP and /var/lib/ambari-agent/cache/stacks/HDP and
then start the ambari-server and ambari-agent the issue should resolve itself. I will look
at how we can add this cleanup.

> Ambari Upgrade leaves empty package directory after services were moved to common services
> ------------------------------------------------------------------------------------------
>
>                 Key: AMBARI-9117
>                 URL: https://issues.apache.org/jira/browse/AMBARI-9117
>             Project: Ambari
>          Issue Type: Task
>          Components: ambari-agent, ambari-server
>    Affects Versions: 2.0.0
>            Reporter: Jayush Luniya
>            Assignee: Jayush Luniya
>            Priority: Critical
>             Fix For: 2.0.0
>
>
> After upgrading Ambari from 1.7.0 to 2.0.0, the Dashboard does not come up because the
agent host check fails since the common services scripts are not copied to /var/lib/ambari-agent/cache/
> This could be related to AMBARI-8695
> STR:
> 1. Install Ambari 1.7.0 on a single node cluster, and add HDP 2.2 with HDFS and ZK
> 2. Upgrade Ambari to 2.0.0
> Stop all services
> ambari-server stop
> ambari-agent stop
> wget -nv -O /etc/yum.repos.d/ambari.repo http://s3.amazonaws.com/dev.hortonworks.com/ambari/centos6/1.x/latest/trunk/ambari.repo
> yum clean all
> yum upgrade ambari-server ambari-log4j
> # Note, there's currently in a bug in ambari-server.py,
> # Need to change 
> # if upgrade and compare_versions(version, "1.7.0") >= 0:
> # to
> # if upgrade and compare_versions(version, "1.7.0") == 0:
> ambari-server upgrade
> yum upgrade ambari-agent
> rpm -qa | grep ambari
> ambari-server start
> ambari-agent start
> less /var/log/ambari-agent/ambari-agent.log
> INFO 2015-01-07 21:33:16,239 ActionQueue.py:203 - Executing command with id = 1-1 for
role = check_host of cluster null.
> INFO 2015-01-07 21:33:16,244 PythonExecutor.py:84 - Running command ['/usr/bin/python2.6',
>  u'/var/lib/ambari-agent/cache/custom_actions/check_host.py',
>  u'ACTIONEXECUTE',
> ...skipping...
>     raise AgentException(message)
> AgentException: 'Script /var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/ZOOKEEPER/package/scripts/zookeeper_server.py
does not exist'
> WARNING 2015-01-09 00:00:10,207 FileCache.py:144 - Error occured during cache update.
Error tolerate setting is set to true, so ignoring this error and continuing with current
cache. Error
>  details: Can not unpack zip file to directory /var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/ZOOKEEPER/package
: File is not a zip file
> ERROR 2015-01-09 00:00:10,208 CustomServiceOrchestrator.py:201 - Caught an exception
while executing custom service command: <class 'AgentException.AgentException'>: 'Script
/var/lib/ambar
> i-agent/cache/stacks/HDP/2.0.6/services/ZOOKEEPER/package/scripts/zookeeper_server.py
does not exist'; 'Script /var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/ZOOKEEPER/package/scrip
> ts/zookeeper_server.py does not exist'
> Traceback (most recent call last):
>   File "/usr/lib/python2.6/site-packages/ambari_agent/CustomServiceOrchestrator.py",
line 136, in runCommand
>     script_path = self.resolve_script_path(base_dir, script)
>   File "/usr/lib/python2.6/site-packages/ambari_agent/CustomServiceOrchestrator.py",
line 270, in resolve_script_path
>     raise AgentException(message)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message