Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 6E0C0200C31 for ; Wed, 8 Mar 2017 11:47:49 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 6CB8E160B75; Wed, 8 Mar 2017 10:47:49 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 1BA4D160B83 for ; Wed, 8 Mar 2017 11:47:47 +0100 (CET) Received: (qmail 43018 invoked by uid 500); 8 Mar 2017 10:47:47 -0000 Mailing-List: contact issues-help@cloudstack.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cloudstack.apache.org Delivered-To: mailing list issues@cloudstack.apache.org Received: (qmail 43004 invoked by uid 500); 8 Mar 2017 10:47:47 -0000 Delivered-To: apmail-incubator-cloudstack-issues@incubator.apache.org Received: (qmail 43001 invoked by uid 99); 8 Mar 2017 10:47:47 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Mar 2017 10:47:47 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id B089CC0C0D for ; Wed, 8 Mar 2017 10:47:46 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.651 X-Spam-Level: X-Spam-Status: No, score=0.651 tagged_above=-999 required=6.31 tests=[RP_MATCHES_RCVD=-0.001, SPF_NEUTRAL=0.652] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id pGsYSoaefrte for ; Wed, 8 Mar 2017 10:47:41 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 5B1405FE6C for ; Wed, 8 Mar 2017 10:47:41 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 384EAE0ADD for ; Wed, 8 Mar 2017 10:47:39 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id D8A1E24359 for ; Wed, 8 Mar 2017 10:47:38 +0000 (UTC) Date: Wed, 8 Mar 2017 10:47:38 +0000 (UTC) From: "ASF GitHub Bot (JIRA)" To: cloudstack-issues@incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (CLOUDSTACK-9821) Unable to deploy user VM in Basic Zone MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Wed, 08 Mar 2017 10:47:49 -0000 [ https://issues.apache.org/jira/browse/CLOUDSTACK-9821?page=3Dcom.atla= ssian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId= =3D15901065#comment-15901065 ]=20 ASF GitHub Bot commented on CLOUDSTACK-9821: -------------------------------------------- Github user asfgit closed the pull request at: https://github.com/apache/cloudstack/pull/1991 > Unable to deploy user VM in Basic Zone > -------------------------------------- > > Key: CLOUDSTACK-9821 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-982= 1 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the defa= ult.)=20 > Components: Network Controller > Affects Versions: 4.10.0.0 > Environment: Ubuntu 12.04 for CS MS > Reporter: Mike Tutkowski > Assignee: Jayapal Reddy > Priority: Blocker > Fix For: 4.10.0.0 > > > From my e-mails on dev@ concerning this issue (messages listed oldest to = newest): > I see the following exception when trying to deploy a user VM in a Basic = Zone with two XenServer 6.5 hosts in one cluster. My system VMs have all de= ployed properly. The user template gets downloaded fine. I can see the user= VM begin to start on a XenServer host, then it goes away. We then automati= cally try on the other host. I can see the VM begin to start there for a mo= ment, then it goes away. > I am just deploying the user VM=E2=80=99s template and root disk to NFS (= same place where the template and root disks of my system VMs are). > I am using the built-in XenServer CentOS 5.6 (64 bit) template with 1 vCP= U, 500 MHz, and 256 MB memory. > WARN [c.c.a.r.v.VirtualRoutingResource] (DirectAgent-7:ctx-35aded78) (lo= gid:aab9c320) Expected 1 answers while executing VmDataCommand but received= 2 > WARN [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-14:ctx= -27fb1ac3) (logid:2c342f23) VM state was updated but update time is null?! = vm id: 6 > INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-2c7d= 2dce) (logid:a56a9a8c) Begin cleanup expired async-jobs > INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-2c7d= 2dce) (logid:a56a9a8c) End cleanup expired async-jobs > INFO [c.c.u.AccountManagerImpl] (AccountChecker-1:ctx-383a632c) (logid:5= 41e9ba5) Found 0 removed accounts to cleanup > INFO [c.c.u.AccountManagerImpl] (AccountChecker-1:ctx-383a632c) (logid:5= 41e9ba5) Found 0 disabled accounts to cleanup > INFO [c.c.u.AccountManagerImpl] (AccountChecker-1:ctx-383a632c) (logid:5= 41e9ba5) Found 0 inactive domains to cleanup > INFO [c.c.u.AccountManagerImpl] (AccountChecker-1:ctx-383a632c) (logid:5= 41e9ba5) Found 0 disabled projects to cleanup > WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-16:ctx-7c901443) (logid= :aab9c320) callHostPlugin failed for cmd: default_network_rules with args s= ecIps: 0:, vmName: i-2-6-VM, vmID: 6, vmIP: 10.117.40.53, vmMAC: 06:b2:f4:0= 0:00:22, due to There was a failure communicating with the plugin. > WARN [c.c.h.x.r.w.x.CitrixStartCommandWrapper] (DirectAgent-16:ctx-7c901= 443) (logid:aab9c320) Catch Exception: class com.cloud.utils.exception.Clou= dRuntimeException due to com.cloud.utils.exception.CloudRuntimeException: c= allHostPlugin failed for cmd: default_network_rules with args secIps: 0:, v= mName: i-2-6-VM, vmID: 6, vmIP: 10.117.40.53, vmMAC: 06:b2:f4:00:00:22, du= e to There was a failure communicating with the plugin. > com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed fo= r cmd: default_network_rules with args secIps: 0:, vmName: i-2-6-VM, vmID: = 6, vmIP: 10.117.40.53, vmMAC: 06:b2:f4:00:00:22, due to There was a failur= e communicating with the plugin. > at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.callHos= tPlugin(CitrixResourceBase.java:338) > at com.cloud.hypervisor.xenserver.resource.wrapper.xenbase.CitrixStar= tCommandWrapper.execute(CitrixStartCommandWrapper.java:188) > at com.cloud.hypervisor.xenserver.resource.wrapper.xenbase.CitrixStar= tCommandWrapper.execute(CitrixStartCommandWrapper.java:53) > at com.cloud.hypervisor.xenserver.resource.wrapper.xenbase.CitrixRequ= estWrapper.execute(CitrixRequestWrapper.java:122) > at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.execute= Request(CitrixResourceBase.java:1691) > at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(Direc= tAgentAttache.java:315) > at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run= (ManagedContextRunnable.java:49) > at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1= .call(DefaultManagedContext.java:56) > at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.c= allWithContext(DefaultManagedContext.java:103) > at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.r= unWithContext(DefaultManagedContext.java:53) > at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(M= anagedContextRunnable.java:46) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java= :511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTa= sk.access$201(ScheduledThreadPoolExecutor.java:180) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTa= sk.run(ScheduledThreadPoolExecutor.java:293) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecut= or.java:1142) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecu= tor.java:617) > at java.lang.Thread.run(Thread.java:745) > WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-16:ctx-7c901443) (logid= :aab9c320) Unable to start i-2-6-VM due to > com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed fo= r cmd: default_network_rules with args secIps: 0:, vmName: i-2-6-VM, vmID: = 6, vmIP: 10.117.40.53, vmMAC: 06:b2:f4:00:00:22, due to There was a failur= e communicating with the plugin. > at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.callHos= tPlugin(CitrixResourceBase.java:338) > at com.cloud.hypervisor.xenserver.resource.wrapper.xenbase.CitrixStar= tCommandWrapper.execute(CitrixStartCommandWrapper.java:188) > at com.cloud.hypervisor.xenserver.resource.wrapper.xenbase.CitrixStar= tCommandWrapper.execute(CitrixStartCommandWrapper.java:53) > at com.cloud.hypervisor.xenserver.resource.wrapper.xenbase.CitrixRequ= estWrapper.execute(CitrixRequestWrapper.java:122) > at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.execute= Request(CitrixResourceBase.java:1691) > at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(Direc= tAgentAttache.java:315) > at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run= (ManagedContextRunnable.java:49) > at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1= .call(DefaultManagedContext.java:56) > at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.c= allWithContext(DefaultManagedContext.java:103) > at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.r= unWithContext(DefaultManagedContext.java:53) > at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(M= anagedContextRunnable.java:46) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java= :511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTa= sk.access$201(ScheduledThreadPoolExecutor.java:180) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTa= sk.run(ScheduledThreadPoolExecutor.java:293) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecut= or.java:1142) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecu= tor.java:617) > at java.lang.Thread.run(Thread.java:745) > INFO [o.a.c.e.o.NetworkOrchestrator] (Network-Scavenger-1:ctx-2058d5ac) = (logid:bf8885a0) NetworkGarbageCollector uses '20' seconds for GC interval. > WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-16:ctx-7c901443) (logid= :aab9c320) Unable to clean up VBD due to > You gave an invalid object reference. The object may have recently been = deleted. The class parameter gives the type of reference given, and the ha= ndle parameter echoes the bad value given. > at com.xensource.xenapi.Types.checkResponse(Types.java:693) > at com.xensource.xenapi.Connection.dispatch(Connection.java:395) > at com.cloud.hypervisor.xenserver.resource.XenServerConnectionPool$Xe= nServerConnection.dispatch(XenServerConnectionPool.java:457) > at com.xensource.xenapi.VBD.unplug(VBD.java:1109) > at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.handleV= mStartFailure(CitrixResourceBase.java:3576) > at com.cloud.hypervisor.xenserver.resource.wrapper.xenbase.CitrixStar= tCommandWrapper.execute(CitrixStartCommandWrapper.java:210) > at com.cloud.hypervisor.xenserver.resource.wrapper.xenbase.CitrixStar= tCommandWrapper.execute(CitrixStartCommandWrapper.java:53) > at com.cloud.hypervisor.xenserver.resource.wrapper.xenbase.CitrixRequ= estWrapper.execute(CitrixRequestWrapper.java:122) > at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.execute= Request(CitrixResourceBase.java:1691) > at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(Direc= tAgentAttache.java:315) > at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run= (ManagedContextRunnable.java:49) > at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1= .call(DefaultManagedContext.java:56) > at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.c= allWithContext(DefaultManagedContext.java:103) > at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.r= unWithContext(DefaultManagedContext.java:53) > at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(M= anagedContextRunnable.java:46) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java= :511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTa= sk.access$201(ScheduledThreadPoolExecutor.java:180) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTa= sk.run(ScheduledThreadPoolExecutor.java:293) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecut= or.java:1142) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecu= tor.java:617) > at java.lang.Thread.run(Thread.java:745) > WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-16:ctx-7c901443) (logid= :aab9c320) Unable to clean up VBD due to > You gave an invalid object reference. The object may have recently been = deleted. The class parameter gives the type of reference given, and the ha= ndle parameter echoes the bad value given. > at com.xensource.xenapi.Types.checkResponse(Types.java:693) > at com.xensource.xenapi.Connection.dispatch(Connection.java:395) > at com.cloud.hypervisor.xenserver.resource.XenServerConnectionPool$Xe= nServerConnection.dispatch(XenServerConnectionPool.java:457) > at com.xensource.xenapi.VBD.unplug(VBD.java:1109) > at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.handleV= mStartFailure(CitrixResourceBase.java:3576) > at com.cloud.hypervisor.xenserver.resource.wrapper.xenbase.CitrixStar= tCommandWrapper.execute(CitrixStartCommandWrapper.java:210) > at com.cloud.hypervisor.xenserver.resource.wrapper.xenbase.CitrixStar= tCommandWrapper.execute(CitrixStartCommandWrapper.java:53) > at com.cloud.hypervisor.xenserver.resource.wrapper.xenbase.CitrixRequ= estWrapper.execute(CitrixRequestWrapper.java:122) > at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.execute= Request(CitrixResourceBase.java:1691) > at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(Direc= tAgentAttache.java:315) > at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run= (ManagedContextRunnable.java:49) > at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1= .call(DefaultManagedContext.java:56) > at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.c= allWithContext(DefaultManagedContext.java:103) > at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.r= unWithContext(DefaultManagedContext.java:53) > at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(M= anagedContextRunnable.java:46) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java= :511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTa= sk.access$201(ScheduledThreadPoolExecutor.java:180) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTa= sk.run(ScheduledThreadPoolExecutor.java:293) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecut= or.java:1142) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecu= tor.java:617) > at java.lang.Thread.run(Thread.java:745) > WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-16:ctx-7c901443) (logid= :aab9c320) Unable to cleanup VIF > You gave an invalid object reference. The object may have recently been = deleted. The class parameter gives the type of reference given, and the ha= ndle parameter echoes the bad value given. > at com.xensource.xenapi.Types.checkResponse(Types.java:693) > at com.xensource.xenapi.Connection.dispatch(Connection.java:395) > at com.cloud.hypervisor.xenserver.resource.XenServerConnectionPool$Xe= nServerConnection.dispatch(XenServerConnectionPool.java:457) > at com.xensource.xenapi.VIF.unplug(VIF.java:921) > at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.handleV= mStartFailure(CitrixResourceBase.java:3584) > at com.cloud.hypervisor.xenserver.resource.wrapper.xenbase.CitrixStar= tCommandWrapper.execute(CitrixStartCommandWrapper.java:210) > at com.cloud.hypervisor.xenserver.resource.wrapper.xenbase.CitrixStar= tCommandWrapper.execute(CitrixStartCommandWrapper.java:53) > at com.cloud.hypervisor.xenserver.resource.wrapper.xenbase.CitrixRequ= estWrapper.execute(CitrixRequestWrapper.java:122) > at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.execute= Request(CitrixResourceBase.java:1691) > at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(Direc= tAgentAttache.java:315) > at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run= (ManagedContextRunnable.java:49) > at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1= .call(DefaultManagedContext.java:56) > at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.c= allWithContext(DefaultManagedContext.java:103) > at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.r= unWithContext(DefaultManagedContext.java:53) > at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(M= anagedContextRunnable.java:46) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java= :511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTa= sk.access$201(ScheduledThreadPoolExecutor.java:180) > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTa= sk.run(ScheduledThreadPoolExecutor.java:293) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecut= or.java:1142) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecu= tor.java:617) > at java.lang.Thread.run(Thread.java:745) > INFO [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-2:ctx-bc104380= job-25/job-27 ctx-8c946a5b) (logid:aab9c320) Unable to start VM on Host[-2= -Routing] due to Unable to start i-2-6-VM due to > ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-2:ctx-bc104380 job= -25/job-27 ctx-8c946a5b) (logid:aab9c320) Invocation exception, caused by: = com.cloud.exception.InsufficientServerCapacityException: Unable to create a= deployment for VM[User|i-2-6-VM]Scope=3Dinterface com.cloud.dc.DataCenter;= id=3D1 > INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-2:ctx-bc104380 job= -25/job-27 ctx-8c946a5b) (logid:aab9c320) Rethrow exception com.cloud.excep= tion.InsufficientServerCapacityException: Unable to create a deployment for= VM[User|i-2-6-VM]Scope=3Dinterface com.cloud.dc.DataCenter; id=3D1 > ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-2:ctx-bc104380 job-2= 5/job-27) (logid:aab9c320) Unable to complete AsyncJobVO {id:27, userId: 2,= accountId: 2, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWo= rkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC= 0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRF= eGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJ= MAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQ= B-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhb= XN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZt= LlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJ= OYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAABnQAGVZpcnR1YWxNYWNoaW5lTWFuYW= dlckltcGwAAAAAAAAAAHBwcHBwcHBwc3IAEWphdmEudXRpbC5IYXNoTWFwBQfawcMWYNEDAAJGA= Apsb2FkRmFjdG9ySQAJdGhyZXNob2xkeHA_QAAAAAAADHcIAAAAEAAAAAF0AApWbVBhc3N3b3Jk= dAAcck8wQUJYUUFEbk5oZG1Wa1gzQmhjM04zYjNKa3hw, cmdVersion: 0, status: IN_PRO= GRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 52237617797= , completeMsid: null, lastUpdated: null, lastPolled: null, created: Wed Mar= 01 12:51:32 MST 2017}, job origin:25 > com.cloud.exception.InsufficientServerCapacityException: Unable to create= a deployment for VM[User|i-2-6-VM]Scope=3Dinterface com.cloud.dc.DataCente= r; id=3D1 > at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMac= hineManagerImpl.java:961) > at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMac= hineManagerImpl.java:4661) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorIm= pl.java:62) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAc= cessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandle= rProxy.java:107) > at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMach= ineManagerImpl.java:4822) > at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:1= 02) > at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.ru= nInContext(AsyncJobManagerImpl.java:554) > at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run= (ManagedContextRunnable.java:49) > at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1= .call(DefaultManagedContext.java:56) > at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.c= allWithContext(DefaultManagedContext.java:103) > at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.r= unWithContext(DefaultManagedContext.java:53) > at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(M= anagedContextRunnable.java:46) > at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.ru= n(AsyncJobManagerImpl.java:502) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java= :511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecut= or.java:1142) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecu= tor.java:617) > at java.lang.Thread.run(Thread.java:745) > INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-2:ctx-bc104380 job= -25/job-27) (logid:aab9c320) Remove job-27 from job monitoring > WARN [o.a.c.alerts] (API-Job-Executor-1:ctx-f787201d job-25 ctx-56356c1a= ) (logid:aab9c320) alertType:: 8 // dataCenterId:: 1 // podId:: 1 // clust= erId:: null // message:: Failed to deploy Vm with Id: 6, on Host with Id: n= ull > ERROR [c.c.a.ApiAsyncJobDispatcher] (API-Job-Executor-1:ctx-f787201d job-= 25) (logid:aab9c320) Unexpected exception while executing org.apache.clouds= tack.api.command.admin.vm.DeployVMCmdByAdmin > com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due= to insufficient capacity > at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManager= Impl.java:623) > at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.= deployVirtualMachine(VMEntityManagerImpl.java:242) > at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntity= Impl.deploy(VirtualMachineEntityImpl.java:212) > at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerIm= pl.java:4084) > at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerIm= pl.java:3682) > at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerIm= pl.java:3670) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorIm= pl.java:62) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAc= cessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at org.springframework.aop.support.AopUtils.invokeJoinpointUsingRefle= ction(AopUtils.java:333) > at org.springframework.aop.framework.ReflectiveMethodInvocation.invok= eJoinpoint(ReflectiveMethodInvocation.java:190) > at org.springframework.aop.framework.ReflectiveMethodInvocation.proce= ed(ReflectiveMethodInvocation.java:157) > at org.apache.cloudstack.network.contrail.management.EventUtils$Event= Interceptor.invoke(EventUtils.java:107) > at org.springframework.aop.framework.ReflectiveMethodInvocation.proce= ed(ReflectiveMethodInvocation.java:168) > at com.cloud.event.ActionEventInterceptor.invoke(ActionEventIntercept= or.java:51) > at org.springframework.aop.framework.ReflectiveMethodInvocation.proce= ed(ReflectiveMethodInvocation.java:168) > at org.springframework.aop.interceptor.ExposeInvocationInterceptor.in= voke(ExposeInvocationInterceptor.java:92) > at org.springframework.aop.framework.ReflectiveMethodInvocation.proce= ed(ReflectiveMethodInvocation.java:179) > at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDyn= amicAopProxy.java:213) > at com.sun.proxy.$Proxy186.startVirtualMachine(Unknown Source) > at org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin.exec= ute(DeployVMCmdByAdmin.java:50) > at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150) > at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.j= ava:108) > at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.ru= nInContext(AsyncJobManagerImpl.java:554) > at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run= (ManagedContextRunnable.java:49) > at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1= .call(DefaultManagedContext.java:56) > at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.c= allWithContext(DefaultManagedContext.java:103) > at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.r= unWithContext(DefaultManagedContext.java:53) > at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(M= anagedContextRunnable.java:46) > at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.ru= n(AsyncJobManagerImpl.java:502) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java= :511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecut= or.java:1142) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecu= tor.java:617) > at java.lang.Thread.run(Thread.java:745) > Caused by: com.cloud.exception.InsufficientServerCapacityException: Unabl= e to create a deployment for VM[User|i-2-6-VM]Scope=3Dinterface com.cloud.d= c.DataCenter; id=3D1 > at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMac= hineManagerImpl.java:961) > at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMac= hineManagerImpl.java:4661) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > ... 18 more > ********** > According to where the code fails, though, it appears to be a networking = problem. If I set a breakpoint before the failure and change a variable to = say that security groups are not being used, then the VM starts. > I think this is a recently introduced problem because I have another bran= ch based off of a slightly older version of master and it works fine here. > ********** > I rolled back to my master branch at da66b06e7d562393da2e4b52206943f8bad4= 9d10 and it works. > It appears something that went into after that commit has broken this. It= looks like this SHA is about two weeks old and that 43 commits have gone i= nto master since it. -- This message was sent by Atlassian JIRA (v6.3.15#6346)