Mailing-List: contact dev-help@cloudstack.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@cloudstack.apache.org
Received-SPF: pass (athena.apache.org: domain of creategui@gmail.com
 designates 209.85.220.54 as permitted sender)
Content-Type: text/plain; charset=windows-1252
Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\))
Subject: Re: VR will not start after upgrade from 4.1.1 to 4.3
From: =?windows-1252?Q?Carlos_Re=E1tegui?= <creategui@gmail.com>
In-Reply-To: <1201321530.44849.1406374304067.JavaMail.zimbra@arhont.com>
Date: Sat, 26 Jul 2014 09:44:31 -0700
Cc: dev@cloudstack.apache.org
Content-Transfer-Encoding: quoted-printable
Message-Id: <8626538F-DC83-4647-A798-B30A9A1FE9A1@gmail.com>
References: <38A95040-64F4-4017-A303-D080DF7DC280@gmail.com>
 <1201321530.44849.1406374304067.JavaMail.zimbra@arhont.com>
To: users@cloudstack.apache.org

Adding dev list

Thanks Andrei, although not what I wanted to hear.

I decided to try upgrading to 4.4 in hopes the results would be =
different.  Unfortunately not.

So here is what is happening.  I did the upgrade from 4.1.1 with =
everything completely stopped.  I had previously registered the new 4.3 =
svm template which should work for both 4.3 and 4.4.

The problem is that the VR needs to be upgraded, but it can=92t since it =
is stopped.  But starting it also fails because it does not respond =
correctly to /opt/cloud/bin/router_proxy.sh get_template_version.sh. =20

So looks like I have 2 options.=20
- 1) Go back to 4.1.1 and make sure the VR is running before attempting =
the upgrade to 4.3/4
- 2) Mount the VR VHD and try to fix GetDomRVersionCmd so that the VR =
starts and I am then able to upgrade it from the UI (since =
cloudstack-sysvmadm does not work on ubuntu =97 CLOUDSTACK-4778)

Any thoughts on #2?

thanks,
Carlos


On Jul 26, 2014, at 4:31 AM, Andrei Mikhailovsky <andrei@arhont.com> =
wrote:

> I had a similar problem with upgrading to 4.3. My cpvm and ssvm would =
start fine, but I was not able to create new VRs. Most of my existing =
VRs would actually start, but no new VRs would get created. So, I was =
not able to create new networks and not able to restart existing =
networks with the clean up option.=20
>=20
> No one was able to help me fix the issue, so I ended up moving back to =
4.2.1. After the downgrade the problem went away.=20
>=20
> I do hope these problems would be fixed in 4.3.1.=20
>=20
> Cheers=20
>=20
> --=20
> Andrei Mikhailovsky=20
> Director=20
> Arhont Information Security=20
>=20
> Web: http://www.arhont.com=20
> http://www.wi-foo.com=20
> Tel: +44 (0)870 4431337=20
> Fax: +44 (0)208 429 3111=20
> PGP: Key ID - 0x2B3438DE=20
> PGP: Server - keyserver.pgp.com=20
>=20
> DISCLAIMER=20
>=20
> The information contained in this email is intended only for the use =
of the person(s) to whom it is addressed and may be confidential or =
contain legally privileged information. If you are not the intended =
recipient you are hereby notified that any perusal, use, distribution, =
copying or disclosure is strictly prohibited. If you have received this =
email in error please immediately advise us by return email at =
andrei@arhont.com and delete and purge the email and any attachments =
without making a copy.=20
>=20
>=20
> ----- Original Message -----
>=20
> From: "Carlos Re=E1tegui" <creategui@gmail.com>=20
> To: "CloudStack-Users" <users@cloudstack.apache.org>=20
> Sent: Saturday, 26 July, 2014 6:49:34 AM=20
> Subject: VR will not start after upgrade from 4.1.1 to 4.3=20
>=20
> I have tried destroying the VR and restarting it but it won=92t go. =
The SSVM and Console VM are up.=20
>=20
> The MS does not like the response it is getting from the VR but I am =
not sure how to fix.=20
>=20
> Here is the template info:=20
> mysql> select name, =
display_text,url,guest_os_name,hypervisor_type,state from template_view =
where display_text=3D'systemvm-xenserver-4.3';=20
> =
+------------------------+------------------------+-----------------------=
-------------------------------------------------------------------+------=
----------------------+-----------------+-------+=20
> | name | display_text | url | guest_os_name | hypervisor_type | state =
|=20
> =
+------------------------+------------------------+-----------------------=
-------------------------------------------------------------------+------=
----------------------+-----------------+-------+=20
> | systemvm-xenserver-4.3 | systemvm-xenserver-4.3 | =
http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-mast=
er-xen.vhd.bz2 | Debian GNU/Linux 6(64-bit) | XenServer | Ready |=20
> =
+------------------------+------------------------+-----------------------=
-------------------------------------------------------------------+------=
----------------------+-----------------+-------+=20
>=20
>=20
> Here are the relevant logs:=20
>=20
> 2014-07-26 10:49:05,137 DEBUG [c.c.h.x.r.CitrixResourceBase] =
(DirectAgent-467:ctx-6cb72049) Trying to connect to 169.254.2.69 attempt =
2 of 100=20
> 2014-07-26 10:49:05,460 DEBUG [c.c.a.ApiServlet] =
(catalina-exec-25:ctx-b6b6006f) =3D=3D=3DSTART=3D=3D=3D 10.110.3.50 -- =
GET =
command=3DqueryAsyncJobResult&jobId=3D0cfb6b86-dc2e-4040-a06e-f080aee83a15=
&response=3Djson&sessionkey=3DTziV%2FqqSUFAO1eiR6bCbh0lq%2FDc%3D&_=3D14063=
51949321=20
> 2014-07-26 10:49:05,480 DEBUG [c.c.a.ApiServlet] =
(catalina-exec-25:ctx-b6b6006f ctx-782d64ad) =3D=3D=3DEND=3D=3D=3D =
10.110.3.50 -- GET =
command=3DqueryAsyncJobResult&jobId=3D0cfb6b86-dc2e-4040-a06e-f080aee83a15=
&response=3Djson&sessionkey=3DTziV%2FqqSUFAO1eiR6bCbh0lq%2FDc%3D&_=3D14063=
51949321=20
> 2014-07-26 10:49:07,414 DEBUG [c.c.h.x.r.CitrixResourceBase] =
(DirectAgent-467:ctx-6cb72049) Ping command port succeeded for vm =
r-98-VM=20
> 2014-07-26 10:49:08,113 DEBUG [c.c.a.m.DirectAgentAttache] =
(DirectAgent-467:ctx-6cb72049) Seq 3-1423704582: Cancelling because one =
of the answers is false and it is stop on error.=20
> 2014-07-26 10:49:08,114 DEBUG [c.c.a.m.DirectAgentAttache] =
(DirectAgent-467:ctx-6cb72049) Seq 3-1423704582: Response Received:=20
> 2014-07-26 10:49:08,116 DEBUG [c.c.a.t.Request] =
(DirectAgent-467:ctx-6cb72049) Seq 3-1423704582: Processing: { Ans: , =
MgmtId: 159090355471825, via: 3, Ver: v1, Flags: 10, =
[{"com.cloud.agent.api.StartAnswer":{"vm":{"id":98,"name":"r-98-VM","bootl=
oader":"PyGrub","type":"DomainRouter","cpus":1,"minSpeed":500,"maxSpeed":5=
00,"minRam":134217728,"maxRam":134217728,"arch":"x86_64","os":"Debian =
GNU/Linux 6(64-bit)","bootArgs":" template=3DdomP name=3Dr-98-VM =
eth0ip=3D10.120.60.219 eth0mask=3D255.255.255.0 gateway=3D10.120.60.254 =
domain=3Dcs1cloud.internal dhcprange=3D10.120.60.1 eth1ip=3D169.254.2.69 =
eth1mask=3D255.255.0.0 type=3Ddhcpsrvr disable_rp_filter=3Dtrue =
dns1=3D8.8.8.8 =
dns2=3D202.56.230.6","rebootOnCrash":false,"enableHA":true,"limitCpuUse":f=
alse,"enableDynamicallyScaleVm":false,"vncPassword":"72af77840162bb9e","pa=
rams":{},"uuid":"a1197b63-760e-4c5c-86d2-401cfd3ac3b4","disks":[{"data":{"=
org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"b5b1a6cb-165e-4f=
7f-97a6-00011a5c7061","volumeType":"ROOT","dataStore":{"org.apache.cloudst=
ack.storage.to.PrimaryDataStoreTO":{"uuid":"db74fb7a-1647-3599-b751-576587=
58d8d1","id":206,"poolType":"NetworkFilesystem","host":"192.168.200.1","pa=
th":"/export/primary","port":2049,"url":"NetworkFilesystem://192.168.200.1=
//export/primary/?ROLE=3DPrimary&STOREUUID=3Ddb74fb7a-1647-3599-b751-57658=
758d8d1"}},"name":"ROOT-98","size":2621440000,"path":"213c90cc-09a7-46e7-8=
0c9-d96dc11afa64","volumeId":160,"vmName":"r-98-VM","accountId":1,"format"=
:"VHD","id":160,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"p=
ath":"213c90cc-09a7-46e7-80c9-d96dc11afa64","type":"ROOT","_details":{"man=
aged":"false","storagePort":"2049","storageHost":"192.168.200.1","volumeSi=
ze":"2621440000"}}],"nics":[{"deviceId":0,"networkRateMbps":200,"defaultNi=
c":true,"uuid":"c78beb1c-8a23-43bc-b65f-ebca67b5fad4","ip":"10.120.60.219"=
,"netmask":"255.255.255.0","gateway":"10.120.60.254","mac":"06:3e:ca:00:00=
:3c","dns1":"8.8.8.8","dns2":"202.56.230.6","broadcastType":"Vlan","type":=
"Guest","broadcastUri":"vlan://untagged","isolationUri":"ec2://untagged","=
isSecurityGroupEnabled":false},{"deviceId":1,"networkRateMbps":-1,"default=
Nic":false,"uuid":"42408069-20d3-4b7d-8722-c328a5f7018c","ip":"169.254.2.6=
9","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:02:4=
5","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":f=
alse}]},"_iqnToPath":{},"result":true,"wait":0}},{"com.cloud.agent.api.che=
ck.CheckSshAnswer":{"result":true,"wait":0}},{"com.cloud.agent.api.GetDomR=
VersionAnswer":{"result":false,"details":"getDomRVersionCmd =
failed","wait":0}}] }=20
> 2014-07-26 10:49:08,116 DEBUG [c.c.a.t.Request] =
(Job-Executor-8:ctx-a0bce0e2 ctx-28304b43) Seq 3-1423704582: Received: { =
Ans: , MgmtId: 159090355471825, via: 3, Ver: v1, Flags: 10, { =
StartAnswer, CheckSshAnswer, GetDomRVersionAnswer } }=20
> 2014-07-26 10:49:08,125 WARN =
[c.c.n.r.VirtualNetworkApplianceManagerImpl] =
(Job-Executor-8:ctx-a0bce0e2 ctx-28304b43) Unable to get the =
template/scripts version of router r-98-VM due to: getDomRVersionCmd =
failed=20
> 2014-07-26 10:49:08,125 INFO [c.c.v.VirtualMachineManagerImpl] =
(Job-Executor-8:ctx-a0bce0e2 ctx-28304b43) The guru did not like the =
answers so stopping VM[DomainRouter|r-98-VM]=20
> 2014-07-26 10:49:08,130 DEBUG [c.c.a.t.Request] =
(Job-Executor-8:ctx-a0bce0e2 ctx-28304b43) Seq 3-1423704585: Sending { =
Cmd , MgmtId: 159090355471825, via: 3(noilabxen04), Ver: v1, Flags: =
100011, =
[{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":f=
alse,"vmName":"r-98-VM","wait":0}}] }=20
> 2014-07-26 10:49:08,130 DEBUG [c.c.a.t.Request] =
(Job-Executor-8:ctx-a0bce0e2 ctx-28304b43) Seq 3-1423704585: Executing: =
{ Cmd , MgmtId: 159090355471825, via: 3(noilabxen04), Ver: v1, Flags: =
100011, =
[{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":f=
alse,"vmName":"r-98-VM","wait":0}}] }=20
> 2014-07-26 10:49:08,131 DEBUG [c.c.a.m.DirectAgentAttache] =
(DirectAgent-452:ctx-72bd5b30) Seq 3-1423704585: Executing request=20
> 2014-07-26 10:49:08,433 DEBUG [c.c.h.x.r.CitrixResourceBase] =
(DirectAgent-452:ctx-72bd5b30) 9. The VM r-98-VM is in Stopping state=20
> 2014-07-26 10:49:09,063 INFO [c.c.h.x.r.CitrixResourceBase] =
(DirectAgent-452:ctx-72bd5b30) Removed network rules for vm r-98-VM=20
>=20
>=20
> thanks,=20
> Carlos=20
>=20