Mailing-List: contact dev-help@cloudstack.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@cloudstack.apache.org
Received-SPF: pass (nike.apache.org: domain of creategui@gmail.com designates
 209.85.220.49 as permitted sender)
Content-Type: text/plain; charset=iso-8859-1
Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.2\))
Subject: Re: 4.4 upgrade issues
From: =?iso-8859-1?Q?Carlos_Re=E1tegui?= <creategui@gmail.com>
In-Reply-To: <71DF46D7-23F7-4055-9A13-FF8348DDA2C8@gmail.com>
Date: Mon, 30 Jun 2014 13:01:47 -0700
Cc: dev@cloudstack.apache.org
Content-Transfer-Encoding: quoted-printable
Message-Id: <8C4C192E-E9D8-46F1-B9EF-FC70493A70EC@gmail.com>
References: <C53AF093-FE7D-43A4-8545-0DD0CFA5516D@gmail.com>
 <07B22C5ED940BF49B3438A3983DB577594705A@SJCPEX01CL03.citrite.net>
 <71DF46D7-23F7-4055-9A13-FF8348DDA2C8@gmail.com>
To: users@cloudstack.apache.org

Hi All,

I am having problems bringing my system back up.  I have not checked the =
credentials of my hosts but the upgraded management server is unable to =
connect to them.  Where is the password stored?

thanks.
Carlos


2014-06-30 12:55:59,277 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] =
(ClusteredAgentManager Timer:ctx-060c8ace) Loading directly connected =
host 1(srvengxen01)
2014-06-30 12:56:04,394 DEBUG [c.c.n.l.LBHealthCheckManagerImpl] =
(LBHealthCheck-1:ctx-c6869648) LB HealthCheck Manager is running and =
getting the updates from LB providers and updating service status
2014-06-30 12:56:04,428 DEBUG [c.c.n.l.LBHealthCheckManagerImpl] =
(LBHealthCheck-1:ctx-c6869648) LB HealthCheck Manager is running and =
getting the updates from LB providers and updating service status
2014-06-30 12:56:06,844 DEBUG [c.c.h.x.r.XenServerConnectionPool] =
(ClusteredAgentManager Timer:ctx-060c8ace) Unable to create master =
connection to host(172.30.45.31) , due to The credentials given by the =
user are incorrect, so access has been denied, and you have not been =
issued a session handle.
2014-06-30 12:56:06,848 DEBUG [c.c.h.Status] (ClusteredAgentManager =
Timer:ctx-060c8ace) Transition:[Resource state =3D Enabled, Agent event =
=3D AgentDisconnected, Host id =3D 1, name =3D srvengxen01]
2014-06-30 12:56:06,862 WARN  [c.c.a.m.ClusteredAgentManagerImpl] =
(ClusteredAgentManager Timer:ctx-060c8ace)  can not load directly =
connected host 1(srvengxen01) due to=20
com.cloud.utils.exception.CloudRuntimeException: Unable to create master =
connection to host(172.30.45.31) , due to The credentials given by the =
user are incorrect, so access has been denied, and you have not been =
issued a session handle.
        at =
com.cloud.hypervisor.xen.resource.XenServerConnectionPool.getConnect(XenSe=
rverConnectionPool.java:168)
        at =
com.cloud.hypervisor.xen.resource.CitrixResourceBase.CheckXenHostInfo(Citr=
ixResourceBase.java:5722)
        at =
com.cloud.hypervisor.xen.resource.CitrixResourceBase.configure(CitrixResou=
rceBase.java:5705)
        at =
com.cloud.resource.DiscovererBase.reloadResource(DiscovererBase.java:157)
        at =
com.cloud.agent.manager.AgentManagerImpl.loadDirectlyConnectedHost(AgentMa=
nagerImpl.java:672)
        at =
com.cloud.agent.manager.ClusteredAgentManagerImpl.scanDirectAgentToLoad(Cl=
usteredAgentManagerImpl.java:218)
        at =
com.cloud.agent.manager.ClusteredAgentManagerImpl.runDirectAgentScanTimerT=
ask(ClusteredAgentManagerImpl.java:184)
        at =
com.cloud.agent.manager.ClusteredAgentManagerImpl.access$100(ClusteredAgen=
tManagerImpl.java:98)
        at =
com.cloud.agent.manager.ClusteredAgentManagerImpl$DirectAgentScanTimerTask=
.runInContext(ClusteredAgentManagerImpl.java:234)
        at =
org.apache.cloudstack.managed.context.ManagedContextTimerTask$1.runInConte=
xt(ManagedContextTimerTask.java:30)
        at =
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(Managed=
ContextRunnable.java:49)
        at =
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(De=
faultManagedContext.java:56)
        at =
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithC=
ontext(DefaultManagedContext.java:103)
        at =
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithCo=
ntext(DefaultManagedContext.java:53)
        at =
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedCo=
ntextRunnable.java:46)
        at =
org.apache.cloudstack.managed.context.ManagedContextTimerTask.run(ManagedC=
ontextTimerTask.java:27)
        at java.util.TimerThread.mainLoop(Timer.java:555)
        at java.util.TimerThread.run(Timer.java:505)
Caused by: The credentials given by the user are incorrect, so access =
has been denied, and you have not been issued a session handle.
        at com.xensource.xenapi.Types.checkResponse(Types.java:322)
        at com.xensource.xenapi.Connection.dispatch(Connection.java:350)
        at =
com.xensource.xenapi.Session.loginWithPassword(Session.java:537)
        at =
com.cloud.hypervisor.xen.resource.XenServerConnectionPool.loginWithPasswor=
d(XenServerConnectionPool.java:321)
        at =
com.cloud.hypervisor.xen.resource.XenServerConnectionPool.getConnect(XenSe=
rverConnectionPool.java:154)
        ... 17 more
2014-06-30 12:56:06,864 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] =
(ClusteredAgentManager Timer:ctx-060c8ace) Loading directly connected =
host 2(srvengxen02)
2014-06-30 12:56:09,225 DEBUG [c.c.s.StatsCollector] =
(StatsCollector-1:ctx-8458e286) HostStatsCollector is running...
2014-06-30 12:56:09,226 DEBUG [c.c.s.StatsCollector] =
(StatsCollector-2:ctx-aa245eed) VmStatsCollector is running...
2014-06-30 12:56:09,227 DEBUG [c.c.s.StatsCollector] =
(StatsCollector-3:ctx-19894fa1) StorageCollector is running...
2014-06-30 12:56:09,230 DEBUG [c.c.s.StatsCollector] =
(StatsCollector-4:ctx-d66c71fb) AutoScaling Monitor is running...


On Jun 30, 2014, at 9:54 AM, Carlos Re=E1tegui <creategui@gmail.com> =
wrote:

> Hi Sudha,
> Thanks for checking in.  I was out for the weekend and just getting =
back to this now.
>=20
> My main question at this point is if it is ok for me to kill the =
system vms with the xe vm-shutdown command since the script provided by =
cloudstack does not work with ubuntu.
>=20
> Also it would be great if someone could have a look at my logs to see =
if they look normal. I am seeing a lot of HA-Worker messages but I do =
not have an HA deployment (unless this is the thread that keeps the =
system vas running).
>=20
> thanks,
> Carlos
>=20
>=20
>=20
> On Jun 29, 2014, at 11:51 PM, Sudha Ponnaganti =
<sudha.ponnaganti@citrix.com> wrote:
>=20
>> Hi Carlos,
>>=20
>> Were you able to resolve the following? Was your upgrade successful?
>>=20
>> Thanks
>> /sudha
>>=20
>> -----Original Message-----
>> From: Carlos Re=E1tegui [mailto:creategui@gmail.com]=20
>> Sent: Friday, June 27, 2014 8:55 PM
>> To: CloudStack-Users
>> Cc: dev@cloudstack.apache.org
>> Subject: 4.4 upgrade issues
>>=20
>> I am trying out the upgrade instructions from =
http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/4.3=
/rnotes.html#upgrade-from-4-1-x-to-4-3 but going to 4.4 built from =
source today.
>>=20
>> My setup: XenServer 6.0.2 Hosts, Management Server on Ubuntu 12.04, =
Primary and Secondary on NFS, Basic Network, no security groups
>>=20
>> -----
>> Notes on the docs:
>>=20
>> 8.4 - 8.6: This is only for hosts that use the cloudstack agent. Does =
not apply to KVM. In general this whole section does not do a good job =
of explaining what is on the MS vs the Hosts.
>>=20
>> 13: This fails on ubuntu because: cloudstack-sysvmadm sources =
/etc/rc.d/init.d/functions which does not exist on ubuntu/debian =
systems.
>>=20
>> 14: Copy vhf-util from where? Also the path =
/usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver does not =
exist on the hosts so I am assuming this is on the MS, however the MS =
already has it since it is an upgrade and was put there by the original =
install.  Or is this a new version that needs to be grabbed from =
somewhere?
>>=20
>> Other: earlier versions like 4.1 worked with JDK 1.6 current releases =
require 1.7 but the Upgrade doc does not mention that.
>>=20
>> --
>> Issues:
>>=20
>> Saw the following in catalina.out, not sure if it is an issues:
>> Jun 27, 2014 5:28:42 PM org.apache.catalina.loader.WebappClassLoader =
validateJarFile
>> INFO: =
validateJarFile(/usr/share/cloudstack-management/webapps/client/WEB-INF/li=
b/servlet-api-2.5-20081211.jar) - jar not loaded. See Servlet Spec 2.3, =
section 9.7.2. Offending class: javax/servlet/Servlet.class Jun 27, 2014 =
5:28:42 PM org.apache.catalina.loader.WebappClassLoader validateJarFile
>> INFO: =
validateJarFile(/usr/share/cloudstack-management/webapps/client/WEB-INF/li=
b/tomcat-embed-core-7.0.30.jar) - jar not loaded. See Servlet Spec 2.3, =
section 9.7.2. Offending class: javax/servlet/Servlet.class
>>=20
>> Since the above script in step 13 did not work is it ok to do "xe =
vm-shutdown vm=3D." on each of the system vms?  Will CloudStack notice =
they are ton and start new ones?
>>=20
>> Here are my log files (please note I stopped the service prior to =
capturing these logs in case you are wondering):
>> Management server log: =
https://www.dropbox.com/s/7xhkutt8e724il1/management-server.log
>> Catalina log: =
https://www.dropbox.com/s/f45ypkbazhkogyj/catalina.2014-06-27.log
>>=20
>>=20
>>=20
>>=20
>=20