Return-Path: X-Original-To: apmail-cloudstack-users-archive@www.apache.org Delivered-To: apmail-cloudstack-users-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id AB7A017733 for ; Mon, 6 Oct 2014 09:57:33 +0000 (UTC) Received: (qmail 72998 invoked by uid 500); 6 Oct 2014 09:57:32 -0000 Delivered-To: apmail-cloudstack-users-archive@cloudstack.apache.org Received: (qmail 72938 invoked by uid 500); 6 Oct 2014 09:57:32 -0000 Mailing-List: contact users-help@cloudstack.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@cloudstack.apache.org Delivered-To: mailing list users@cloudstack.apache.org Received: (qmail 72926 invoked by uid 99); 6 Oct 2014 09:57:31 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Oct 2014 09:57:31 +0000 X-ASF-Spam-Status: No, hits=0.3 required=5.0 tests=SPF_PASS,URIBL_RHS_DOB X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of ugo.vasi@procne.it designates 193.239.52.24 as permitted sender) Received: from [193.239.52.24] (HELO smtp.procne.it) (193.239.52.24) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Oct 2014 09:57:27 +0000 Received: from [192.168.0.82] (procneadsl [87.28.111.63]) by smtp.procne.it (Postfix) with ESMTPSA id C1AE31FB54 for ; Mon, 6 Oct 2014 11:57:04 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=procne.it; s=procne; t=1412589425; bh=0urK5ArwxK5bmFlRZmG8YWPo8DOeSg2ZSK6XM6S7PPY=; h=Date:From:To:Subject:References:In-Reply-To; b=VY5kh1M4XbyRGCcBYMWQecnl+C8Vzsnzbb7t9Q+K+3M6S6kmeOuUaMFnQ6joU1toB lnpgoqlGCPMG/n+pdyd0KZ8jYdAyH8FCkBu/B3p0wh0g2I4mVY/WLclNR9+p0snWsN pdj+Yw4T1ye2GatQzb4vJRU+1AA8enw1noZb+1/I= Message-ID: <54326770.1000808@procne.it> Date: Mon, 06 Oct 2014 11:57:04 +0200 From: Ugo Vasi Organization: PROCNE SRL User-Agent: Mozilla/5.0 (X11; Linux i686; rv:24.0) Gecko/20100101 Thunderbird/24.5.0 MIME-Version: 1.0 To: users@cloudstack.apache.org Subject: Re: Unable to start a VM due to insufficient capacity References: <53DA552C.5010909@procne.it> ,<53DB4A66.1050309@procne.it> <94B6896A-874A-4D65-B7A7-734726E2DB77@shapeblue.com>,<54114C73.4040906@procne.it> <152B12C7-7947-4A33-A7F9-33ACDB87FBE8@shapeblue.com> In-Reply-To: <152B12C7-7947-4A33-A7F9-33ACDB87FBE8@shapeblue.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org Hi Geoff, the problem is occurring in different networks (all?) that are not change= d. For us is a big problem because I can not predict when it occurs and the = creation of new machines is blocked until a network restarts (this=20 method, among other things, cause a small interruption of service). What can I do to fix the problem? Il 11/09/2014 09:28, Geoff Higginbottom ha scritto: > Hi Ugo, > > Did restarting the network with cleanup option resolve your issue last = time, if yes have you tried the same on this network? > > Regards > > Geoff Higginbottom > CTO / Cloud Architect > > D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581 > > geoff.higginbottom@shapeblue.com | www.shapeblue.com | Twitter:@cloudstackgur= u > > ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N 4HS > > > On 11 Sep 2014, at 08:17, "Ugo Vasi" > wrote: > > Hi Geoff, > I still have the problem creating new VMs but in another isolated netwo= rk. The problem seems to be the same: > > 2014-09-11 08:55:27,048 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Ex= ecutor-55:ctx-b5c34ec7 ctx-3715f5de) VM is being created in podId: 1 > 2014-09-11 08:55:27,050 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Exec= utor-55:ctx-b5c34ec7 ctx-3715f5de) Network id=3D212 is already implemente= d > 2014-09-11 08:55:27,118 DEBUG [c.c.n.NetworkModelImpl] (Job-Executor-55= :ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not supported in the= network id=3D212 > 2014-09-11 08:55:27,122 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Exec= utor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of nics for net= work id=3D212 on 1 > 2014-09-11 08:55:27,174 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Exec= utor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to prepare for Ni= c[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19] > 2014-09-11 08:55:27,181 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerIm= pl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Lock is acquired for netw= ork id 212 as a part of router startup in Dest[Zone(Id)-Pod(Id)-Cluster(I= d)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Clu= ster(1)-Host(7)-Storage(Volume(98|ROOT-->Pool(6))] > 2014-09-11 08:55:27,183 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerIm= pl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Lock is released for netw= ork id 212 as a part of router startup in Dest[Zone(Id)-Pod(Id)-Cluster(I= d)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Clu= ster(1)-Host(7)-Storage(Volume(98|ROOT-->Pool(6))] > 2014-09-11 08:55:27,189 DEBUG [c.c.n.NetworkModelImpl] (Job-Executor-55= :ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not supported in the= network id=3D212 > 2014-09-11 08:55:27,198 DEBUG [c.c.n.NetworkModelImpl] (Job-Executor-55= :ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not supported in the= network id=3D212 > 2014-09-11 08:55:27,202 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerIm= pl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Applying dhcp entry in ne= twork Ntwk[212|Guest|8] > 2014-09-11 08:55:27,215 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5= c34ec7 ctx-3715f5de) Seq 7-564304056: Sending { Cmd , MgmtId: 7791639035= 3436, via: 7(csh1b), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.routi= ng.DhcpEntryCommand":{"vmMac":"02:00:15:76:00:0e","vmIpAddress":"10.1.1.1= 9","vmName":"giannitest","defaultRouter":"10.1.1.1","defaultDns":"10.1.1.= 1","duid":"00:03:00:01:02:00:15:76:00:0e","isDefault":true,"executeInSequ= ence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.t= ype":"Advanced","router.name":"r-60-VM","router.ip":"169.254.1.230"},"wai= t":0}}] } > 2014-09-11 08:55:27,941 DEBUG [c.c.s.s.SecondaryStorageManagerImpl] (se= cstorage-1:ctx-327037b2) Zone 1 is ready to launch secondary storage VM > 2014-09-11 08:55:28,022 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consolep= roxy-1:ctx-a8ba3b1e) Zone 1 is ready to launch console proxy > 2014-09-11 08:55:28,820 DEBUG [c.c.a.ApiServlet] (catalina-exec-16:ctx-= 58e92382) =3D=3D=3DSTART=3D=3D=3D 192.168.130.89 -- GET command=3DqueryA= syncJobResult&jobId=3D195bf80a-9823-4ec3-add4-8907b98fbaf0&response=3Djso= n&sessionkey=3DqGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=3D1410418528731 > 2014-09-11 08:55:29,069 DEBUG [c.c.a.t.Request] (AgentManager-Handler-1= 3:null) Seq 7-564304056: Processing: { Ans: , MgmtId: 77916390353436, vi= a: 7, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"= wait":0}}] } > 2014-09-11 08:55:29,069 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5= c34ec7 ctx-3715f5de) Seq 7-564304056: Received: { Ans: , MgmtId: 7791639= 0353436, via: 7, Ver: v1, Flags: 10, { Answer } } > 2014-09-11 08:55:29,075 DEBUG [c.c.n.NetworkModelImpl] (Job-Executor-55= :ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not supported in the= network id=3D212 > 2014-09-11 08:55:29,078 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerIm= pl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Applying userdata and pas= sword entry in network Ntwk[212|Guest|8] > 2014-09-11 08:55:29,089 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5= c34ec7 ctx-3715f5de) Seq 7-564304057: Sending { Cmd , MgmtId: 7791639035= 3436, via: 7(csh1b), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.routi= ng.SavePasswordCommand":{,"vmIpAddress":"10.1.1.19","vmName":"giannitest"= ,"executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1",= "zone.network.type":"Advanced","router.ip":"169.254.1.230","router.name":= "r-60-VM"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIp= Address":"10.1.1.19","vmName":"giannitest","executeInSequence":false,"acc= essDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced",= "router.ip":"169.254.1.230","router.name":"r-60-VM"},"wait":0}}] } > 2014-09-11 08:55:29,399 DEBUG [c.c.a.t.Request] (AgentManager-Handler-1= 0:null) Seq 7-564304057: Processing: { Ans: , MgmtId: 77916390353436, vi= a: 7, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"= wait":0}},{"com.cloud.agent.api.Answer":{"result":false,"details":"VmData= Command failed, check agent logs","wait":0}}] } > 2014-09-11 08:55:29,491 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5= c34ec7 ctx-3715f5de) Seq 7-564304057: Received: { Ans: , MgmtId: 7791639= 0353436, via: 7, Ver: v1, Flags: 10, { Answer, Answer } } > 2014-09-11 08:55:29,491 INFO [c.c.v.VirtualMachineManagerImpl] (Job-Ex= ecutor-55:ctx-b5c34ec7 ctx-3715f5de) Unable to contact resource. > com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:= 1] is unreachable: Unable to apply userdata and password entry on router > at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.= applyRules(VirtualNetworkApplianceManagerImpl.java:3915) > at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.= applyUserData(VirtualNetworkApplianceManagerImpl.java:3118) > at sun.reflect.GeneratedMethodAccessor472.invoke(Unknown Source= ) > ... > 2014-09-11 08:55:29,755 DEBUG [c.c.a.ApiServlet] (catalina-exec-16:ctx-= 58e92382 ctx-ad8ddf67) =3D=3D=3DEND=3D=3D=3D 192.168.130.89 -- GET comman= d=3DqueryAsyncJobResult&jobId=3D195bf80a-9823-4ec3-add4-8907b98fbaf0&resp= onse=3Djson&sessionkey=3DqGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=3D141041852= 8731 > 2014-09-11 08:55:29,798 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Ex= ecutor-55:ctx-b5c34ec7 ctx-3715f5de) Cleaning up resources for the vm VM[= User|giannitest] in Starting state > 2014-09-11 08:55:29,800 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5= c34ec7 ctx-3715f5de) Seq 7-564304058: Sending { Cmd , MgmtId: 7791639035= 3436, via: 7(csh1b), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopC= ommand":{"isProxy":false,"executeInSequence":false,"vmName":"i-2-86-VM","= wait":0}}] } > 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request] (AgentManager-Handler-6= :null) Seq 7-564304058: Processing: { Ans: , MgmtId: 77916390353436, via= : 7, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":tru= e,"wait":0}}] } > 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5= c34ec7 ctx-3715f5de) Seq 7-564304058: Received: { Ans: , MgmtId: 7791639= 0353436, via: 7, Ver: v1, Flags: 10, { StopAnswer } } > 2014-09-11 08:55:29,955 DEBUG [c.c.n.NetworkModelImpl] (Job-Executor-55= :ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not supported in the= network id=3D212 > 2014-09-11 08:55:29,957 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Exec= utor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of nics for net= work id=3D212 on -1 > 2014-09-11 08:55:30,051 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Exec= utor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to release NicPro= file[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19-null > 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Ex= ecutor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully released network resour= ces for the vm VM[User|giannitest] > 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Ex= ecutor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully cleanued up resources f= or the vm VM[User|giannitest] in Starting state > 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Jo= b-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [], clusters= : [], hosts: [7] > 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Jo= b-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id =3D '1' provided i= s in avoid set, DeploymentPlanner cannot allocate the VM, returning. > 2014-09-11 08:55:30,214 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor= -55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Starting to Stop= ped with event: OperationFailedvm's original host id: null new host id: n= ull host id before state transition: 7 > 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor= -55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total CPU: 36256 and CPU af= ter applying overprovisioning: 36256 > 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor= -55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total RAM: 50639785984 and = RAM after applying overprovisioning: 50639785984 > 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor= -55:ctx-b5c34ec7 ctx-3715f5de) release cpu from host: 7, old used: 26500,= reserved: 0, actual total: 36256, total with overprovisioning: 36256; new= used: 26000,reserved:0; movedfromreserved: false,moveToReserveredfalse > 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor= -55:ctx-b5c34ec7 ctx-3715f5de) release mem from host: 7, old used: 210721= 83296,reserved: 0, total: 50639785984; new used: 20535312384,reserved:0; = movedfromreserved: false,moveToReserveredfalse > 2014-09-11 08:55:30,302 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor= -55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Stopped to Start= ing with event: StartRequestedvm's original host id: null new host id: nu= ll host id before state transition: null > 2014-09-11 08:55:30,302 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Ex= ecutor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully transitioned to start s= tate for VM[User|giannitest] reservation id =3D 4b6c2f8d-a34c-4b86-a0d4-a= cd5ea87353a > 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Ex= ecutor-55:ctx-b5c34ec7 ctx-3715f5de) Trying to deploy VM, vm has dcId: 1 = and podId: 1 > 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Ex= ecutor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [], clusters: []= , hosts: [7] > 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Jo= b-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [], clusters= : [], hosts: [7] > 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Jo= b-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id =3D '1' provided i= s in avoid set, DeploymentPlanner cannot allocate the VM, returning. > 2014-09-11 08:55:30,435 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor= -55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Starting to Stop= ped with event: OperationFailedvm's original host id: null new host id: n= ull host id before state transition: null > 2014-09-11 08:55:30,477 DEBUG [c.c.v.UserVmManagerImpl] (Job-Executor-5= 5:ctx-b5c34ec7 ctx-3715f5de) Destroying vm VM[User|giannitest] as it fail= ed to create on Host with Id:null > 2014-09-11 08:55:30,609 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor= -55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Stopped to Error= with event: OperationFailedToErrorvm's original host id: null new host i= d: null host id before state transition: null > 2014-09-11 08:55:29,755 DEBUG [c.c.a.ApiServlet] (catalina-exec-16:ctx-= 58e92382 ctx-ad8ddf67) =3D=3D=3DEND=3D=3D=3D 192.168.130.89 -- GET comman= d=3DqueryAsyncJobResult&jobId=3D195bf80a-9823-4ec3-add4-8907b98fbaf0&resp= onse=3Djson&sessionkey=3DqGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=3D141041852= 8731 > 2014-09-11 08:55:29,798 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Ex= ecutor-55:ctx-b5c34ec7 ctx-3715f5de) Cleaning up resources for the vm VM[= User|giannitest] in Starting state > 2014-09-11 08:55:29,800 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5= c34ec7 ctx-3715f5de) Seq 7-564304058: Sending { Cmd , MgmtId: 7791639035= 3436, via: 7(csh1b), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopC= ommand":{"isProxy":false,"executeInSequence":false,"vmName":"i-2-86-VM","= wait":0}}] } > 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request] (AgentManager-Handler-6= :null) Seq 7-564304058: Processing: { Ans: , MgmtId: 77916390353436, via= : 7, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":tru= e,"wait":0}}] } > 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5= c34ec7 ctx-3715f5de) Seq 7-564304058: Received: { Ans: , MgmtId: 7791639= 0353436, via: 7, Ver: v1, Flags: 10, { StopAnswer } } > 2014-09-11 08:55:29,955 DEBUG [c.c.n.NetworkModelImpl] (Job-Executor-55= :ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not supported in the= network id=3D212 > 2014-09-11 08:55:29,957 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Exec= utor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of nics for net= work id=3D212 on -1 > 2014-09-11 08:55:30,051 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Exec= utor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to release NicPro= file[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19-null > 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Ex= ecutor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully released network resour= ces for the vm VM[User|giannitest] > 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Ex= ecutor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully cleanued up resources f= or the vm VM[User|giannitest] in Starting state > 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Jo= b-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [], clusters= : [], hosts: [7] > 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Jo= b-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id =3D '1' provided i= s in avoid set, DeploymentPlanner cannot allocate the VM, returning. > 2014-09-11 08:55:30,214 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor= -55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Starting to Stop= ped with event: OperationFailedvm's original host id: null new host id: n= ull host id before state transition: 7 > 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor= -55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total CPU: 36256 and CPU af= ter applying overprovisioning: 36256 > 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor= -55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total RAM: 50639785984 and = RAM after applying overprovisioning: 50639785984 > 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor= -55:ctx-b5c34ec7 ctx-3715f5de) release cpu from host: 7, old used: 26500,= reserved: 0, actual total: 36256, total with overprovisioning: 36256; new= used: 26000,reserved:0; movedfromreserved: false,moveToReserveredfalse > 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor= -55:ctx-b5c34ec7 ctx-3715f5de) release mem from host: 7, old used: 210721= 83296,reserved: 0, total: 50639785984; new used: 20535312384,reserved:0; = movedfromreserved: false,moveToReserveredfalse > 2014-09-11 08:55:30,302 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor= -55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Stopped to Start= ing with event: StartRequestedvm's original host id: null new host id: nu= ll host id before state transition: null > 2014-09-11 08:55:30,302 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Ex= ecutor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully transitioned to start s= tate for VM[User|giannitest] reservation id =3D 4b6c2f8d-a34c-4b86-a0d4-a= cd5ea87353a > 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Ex= ecutor-55:ctx-b5c34ec7 ctx-3715f5de) Trying to deploy VM, vm has dcId: 1 = and podId: 1 > 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Ex= ecutor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [], clusters: []= , hosts: [7] > 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Jo= b-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [], clusters= : [], hosts: [7] > 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Jo= b-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id =3D '1' provided i= s in avoid set, DeploymentPlanner cannot allocate the VM, returning. > 2014-09-11 08:55:30,435 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor= -55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Starting to Stop= ped with event: OperationFailedvm's original host id: null new host id: n= ull host id before state transition: null > 2014-09-11 08:55:30,477 DEBUG [c.c.v.UserVmManagerImpl] (Job-Executor-5= 5:ctx-b5c34ec7 ctx-3715f5de) Destroying vm VM[User|giannitest] as it fail= ed to create on Host with Id:null > 2014-09-11 08:55:30,609 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor= -55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Stopped to Error= with event: OperationFailedToErrorvm's original host id: null new host i= d: null host id before state transition: null > 2014-09-11 08:55:30,809 WARN [o.a.c.alerts] (Job-Executor-55:ctx-b5c34= ec7 ctx-3715f5de) alertType:: 8 // dataCenterId:: 1 // podId:: 1 // clus= terId:: null // message:: Failed to deploy Vm with Id: 86, on Host with I= d: null > 2014-09-11 08:55:30,932 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-= Handler-1:null) Ping from 6 > 2014-09-11 08:55:31,078 ERROR [c.c.a.ApiAsyncJobDispatcher] (Job-Execut= or-55:ctx-b5c34ec7) Unexpected exception while executing org.apache.cloud= stack.api.command.user.vm.DeployVMCmd > com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM d= ue to insufficient capacity > at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineM= anagerImpl.java:605) > at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManage= rImpl.deployVirtualMachine(VMEntityManagerImpl.java:237) > at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachine= EntityImpl.deploy(VirtualMachineEntityImpl.java:207) > at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmMan= agerImpl.java:3581) > at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmMan= agerImpl.java:3161) > at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmMan= agerImpl.java:3147) > at sun.reflect.GeneratedMethodAccessor587.invoke(Unknown Source= ) > ... > > > Il 01/08/2014 11:44, Geoff Higginbottom ha scritto: > Ugo, > > Login to the VR and tail the messages log then attempt to start the VM,= you should see various messages re DHCP updating etc in the VR. If you = don't see the VR update try restarting the network Iain the 'cleanup' opt= ion, this will create a new VR. > > Regards > > Geoff Higginbottom > CTO / Cloud Architect > > D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581 > > geoff.higginbottom@shapeblue.com | www.shapeblue.com | Twitter:@cloudstackguru > > ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N 4HS > > > On 1 Aug 2014, at 09:06, "Ugo Vasi" > wrote: > > Hi Geoff, > I tried restarting r-29-VM but the problem is still blocking creation o= f new VM in that isolated network. > > Creating a new VM in another isolated network, it works. Where can I lo= ok at to find the problem? > > > > Il 31/07/2014 21:53, Geoff Higginbottom ha scritto: > Ugo, > > Looks like CS is failing to update the VR with details for the new VM, = try restarting the VR. > > Regards > > Geoff Higginbottom > CTO / Cloud Architect > > > D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581 > > geoff.higginbottom@shapeblue.com | www.shapeblue.com > > ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N 4HS > > > > On 31 Jul 2014, at 15:40, "Ugo Vasi" > wrote= : > > Hi everybody, > I installed a CloudStack 4.3.0 system with a manager (in a virtual mach= ine), two NFS primary storage, one NFS secondary storare and two host age= nt on ubuntu distribution. > > The cluster have one advanced zone without security group configuration= with KVM hipervisors. > > I create some VM but now does not allow me to create more giving the er= ror message "Unable to start a VM due to insufficient capacity". > > I am sure that the resources (ip, ram, cpu and storage) are enough to c= reate new instances. In dashboard I see all ok. > > >From the management-server.log I see this errors messages (see attachm= ent for full version) when I try to deploy a new virtual machine with 1x1= GHz cpu, 1GB or RAM and 20GB disk space: > > 2014-07-31 14:59:11,983 DEBUG [c.c.a.t.Request] (AgentManager-Handler-1= 2:null) Seq 1-684594119: Processing: { Ans: , MgmtId: 77916390353436, vi= a: 1, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"= wait":0}},{"com.cloud.agent.api.Answer":{"result":false,"details":"VmData= Command failed, check agent logs","wait":0}}] } > 2014-07-31 14:59:11,983 INFO [c.c.v.VirtualMachineManagerImpl] (Job-Ex= ecutor-26:ctx-ab3aee38 ctx-d8600c16) Unable to contact resource. > com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:= 1] is unreachable: Unable to apply userdata and password entry on router > 2014-07-31 14:59:12,453 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor= -26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from :Starting to Stop= ped with event: OperationFailedvm's original host id: null new host id: n= ull host id before state transition: 7 > 2014-07-31 14:59:12,677 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor= -26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from :Starting to Stop= ped with event: OperationFailedvm's original host id: null new host id: n= ull host id before state transition: null > 2014-07-31 14:59:12,708 DEBUG [c.c.v.UserVmManagerImpl] (Job-Executor-2= 6:ctx-ab3aee38 ctx-d8600c16) Destroying vm VM[User|csweb2] as it failed t= o create on Host with Id:null > 2014-07-31 14:59:12,738 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor= -26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from :Stopped to Error= with event: OperationFailedToErrorvm's original host id: null new host i= d: null host id before state transition: null > 2014-07-31 14:59:12,929 WARN [o.a.c.alerts] (Job-Executor-26:ctx-ab3ae= e38 ctx-d8600c16) alertType:: 8 // dataCenterId:: 1 // podId:: 1 // clus= terId:: null // message:: Failed to deploy Vm with Id: 70, on Host with I= d: null > 2014-07-31 14:59:13,159 ERROR [c.c.a.ApiAsyncJobDispatcher] (Job-Execut= or-26:ctx-ab3aee38) Unexpected exception while executing org.apache.cloud= stack.api.command.user.vm.DeployVMCmd > com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM d= ue to insufficient capacity > Caused by: com.cloud.exception.InsufficientServerCapacityException: Una= ble to create a deployment for VM[User|csweb2]Scope=3Dinterface com.cloud= =2Edc.DataCenter; id=3D1 > 2014-07-31 14:59:13,161 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Job-Ex= ecutor-26:ctx-ab3aee38) Complete async job-783, jobStatus: FAILED, result= Code: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/n= ull/{"uuidList":[],"errorcode":530,"errortext":"Unable to start a VM due = to insufficient capacity"} > 2014-07-31 14:59:46,280 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Ex= ecutor-27:ctx-82be396e ctx-41f0cf24) Stopped called on VM[User|csweb2] bu= t the state is Error > 2014-07-31 14:59:46,330 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor= -27:ctx-82be396e ctx-41f0cf24) VM state transitted from :Error to Expungi= ng with event: DestroyRequestedvm's original host id: null new host id: n= ull host id before state transition: null > > I tried to search in others log file ("VmDataCommand failed, check agen= t logs"), but I don't found nothing... > > Can anyone Help me? > > -- > > U g o V a s i > > P r o c n e s.r.l >) > via Cotonificio 45 33010 Tavagnacco IT > phone: +390432486523 fax: +390432486523 > > Le informazioni contenute in questo messaggio sono riservate e > confidenziali ed ? vietata la diffusione in qualunque modo eseguita. > Qualora Lei non fosse la persona a cui il presente messaggio ? > destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene > gentilmente comunicazione. > Per qualsiasi informazione si prega di contattare support@procne.it . > Rif. D.L. 196/2003 > > > > > > Find out more about ShapeBlue and our range of CloudStack related servi= ces > > IaaS Cloud Design & Build > CSForge - rapid IaaS deployment framework > CloudStack Consulting > CloudStack Infrastructure Support > CloudStack Bootcamp Training Courses > > This email and any attachments to it may be confidential and are intend= ed solely for the use of the individual to whom it is addressed. Any view= s or opinions expressed are solely those of the author and do not necessa= rily represent those of Shape Blue Ltd or related companies. If you are n= ot the intended recipient of this email, you must neither take any action= based upon its contents, nor copy or show it to anyone. Please contact t= he sender if you believe you have received this email in error. Shape Blu= e Ltd is a company incorporated in England & Wales. ShapeBlue Services In= dia LLP is a company incorporated in India and is operated under license = from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company inco= rporated in Brasil and is operated under license from Shape Blue Ltd. Sha= peBlue SA Pty Ltd is a company registered by The Republic of South Africa= and is traded under license from Shape Blue Ltd. ShapeBlue is a register= ed trademark. > > > > > > > -- > > U g o V a s i > > P r o c n e s.r.l >) > via Cotonificio 45 33010 Tavagnacco IT > phone: +390432486523 fax: +390432486523 > > Le informazioni contenute in questo messaggio sono riservate e > confidenziali ed ? vietata la diffusione in qualunque modo eseguita. > Qualora Lei non fosse la persona a cui il presente messaggio ? > destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene > gentilmente comunicazione. > Per qualsiasi informazione si prega di contattare support@procne.it . > Rif. D.L. 196/2003 > > > > > > Find out more about ShapeBlue and our range of CloudStack related servi= ces > > IaaS Cloud Design & Build > CSForge - rapid IaaS deployment framework > CloudStack Consulting > CloudStack Infrastructure Support > CloudStack Bootcamp Training Courses > > This email and any attachments to it may be confidential and are intend= ed solely for the use of the individual to whom it is addressed. Any view= s or opinions expressed are solely those of the author and do not necessa= rily represent those of Shape Blue Ltd or related companies. If you are n= ot the intended recipient of this email, you must neither take any action= based upon its contents, nor copy or show it to anyone. Please contact t= he sender if you believe you have received this email in error. Shape Blu= e Ltd is a company incorporated in England & Wales. ShapeBlue Services In= dia LLP is a company incorporated in India and is operated under license = from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company inco= rporated in Brasil and is operated under license from Shape Blue Ltd. Sha= peBlue SA Pty Ltd is a company registered by The Republic of South Africa= and is traded under license from Shape Blue Ltd. ShapeBlue is a register= ed trademark. > > > > > > > -- > > U g o V a s i > > P r o c n e s.r.l >) > via Cotonificio 45 33010 Tavagnacco IT > phone: +390432486523 fax: +390432486523 > > Le informazioni contenute in questo messaggio sono riservate e > confidenziali ed ? vietata la diffusione in qualunque modo eseguita. > Qualora Lei non fosse la persona a cui il presente messaggio ? > destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene > gentilmente comunicazione. > Per qualsiasi informazione si prega di contattare support@procne.it . > Rif. D.L. 196/2003 > > > Find out more about ShapeBlue and our range of CloudStack related servi= ces > > IaaS Cloud Design & Build > CSForge - rapid IaaS deployment framework > CloudStack Consulting > CloudStack Infrastructure Support > CloudStack Bootcamp Training Courses > > This email and any attachments to it may be confidential and are intend= ed solely for the use of the individual to whom it is addressed. Any view= s or opinions expressed are solely those of the author and do not necessa= rily represent those of Shape Blue Ltd or related companies. If you are n= ot the intended recipient of this email, you must neither take any action= based upon its contents, nor copy or show it to anyone. Please contact t= he sender if you believe you have received this email in error. Shape Blu= e Ltd is a company incorporated in England & Wales. ShapeBlue Services In= dia LLP is a company incorporated in India and is operated under license = from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company inco= rporated in Brasil and is operated under license from Shape Blue Ltd. Sha= peBlue SA Pty Ltd is a company registered by The Republic of South Africa= and is traded under license from Shape Blue Ltd. ShapeBlue is a register= ed trademark. > > > > --=20 U g o V a s i P r o c n e s.r.l >) via Cotonificio 45 33010 Tavagnacco IT phone: +390432486523 fax: +390432486523 Le informazioni contenute in questo messaggio sono riservate e confidenziali ed =E8 vietata la diffusione in qualunque modo eseguita. Qualora Lei non fosse la persona a cui il presente messaggio =E8 destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene gentilmente comunicazione. Per qualsiasi informazione si prega di contattare support@procne.it . Rif. D.L. 196/2003