cloudstack-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dave Garbus (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (CLOUDSTACK-6484) Unable to expunge VM
Date Tue, 16 Dec 2014 16:08:14 GMT

    [ https://issues.apache.org/jira/browse/CLOUDSTACK-6484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248412#comment-14248412
] 

Dave Garbus edited comment on CLOUDSTACK-6484 at 12/16/14 4:07 PM:
-------------------------------------------------------------------

So in my case, it looks like CloudStack created the failing VMs without hypervisor_type set
in the vm_instance table. I went in and updated the necessary rows ({{update vm_instance set
hypervisor_type='KVM' where hypervisor_type=NULL and state='Expunging';}}) and the expunge
process was able to complete.

Hope this helps!


was (Author: dgarbus):
So in my case, it looks like CloudStack created the failing VMs without hypervisor_type set
in the vm_instance table. I went in and updated the necessary rows (update vm_instance set
hypervisor_type='KVM' where hypervisor_type=NULL and state='Expunging';) and the expunge process
was able to complete.

Hope this helps!

> Unable to expunge VM
> --------------------
>
>                 Key: CLOUDSTACK-6484
>                 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-6484
>             Project: CloudStack
>          Issue Type: Bug
>      Security Level: Public(Anyone can view this level - this is the default.) 
>          Components: Management Server, XenServer
>    Affects Versions: 4.3.0
>         Environment: ACS 4.3, XenServer 6.2 SP1, NFS primary and secondary storage
>            Reporter: Erik Weber
>            Priority: Minor
>
> VM creation failed, and is now unable to expunge the stale vm.
> Log excerpt:
> 2014-04-23 12:37:38,632 DEBUG [c.c.a.ApiServlet] (catalina-exec-17:ctx-63a3ec65) ===START===
 172.30.86.24 -- GET  command=expungeVirtualMachine&id=05c7735f-43ab-4e75-b211-3791bceb77f9&response=json&sessionkey=OMJLVfWJLawkctDOi728%2B2sfpzI%3D&_=1398256658590
> 2014-04-23 12:37:38,664 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (catalina-exec-17:ctx-63a3ec65
ctx-fc4c0a3b) submit async job-827, details: AsyncJobVO {id:827, userId: 2, accountId: 2,
instanceType: VirtualMachine, instanceId: 80, cmd: org.apache.cloudstack.api.command.admin.vm.ExpungeVMCmd,
cmdInfo: {"id":"05c7735f-43ab-4e75-b211-3791bceb77f9","response":"json","sessionkey":"OMJLVfWJLawkctDOi728+2sfpzI\u003d","cmdEventType":"VM.EXPUNGE","ctxUserId":"2","httpmethod":"GET","_":"1398256658590","ctxAccountId":"2","ctxStartEventId":"3505"},
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid:
345049426471, completeMsid: null, lastUpdated: null, lastPolled: null, created: null}
> 2014-04-23 12:37:38,667 INFO  [o.a.c.f.j.i.AsyncJobMonitor] (API-Job-Executor-6:job-827)
Add job-827 into job monitoring
> 2014-04-23 12:37:38,667 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-6:job-827)
Executing AsyncJobVO {id:827, userId: 2, accountId: 2, instanceType: VirtualMachine, instanceId:
80, cmd: org.apache.cloudstack.api.command.admin.vm.ExpungeVMCmd, cmdInfo: {"id":"05c7735f-43ab-4e75-b211-3791bceb77f9","response":"json","sessionkey":"OMJLVfWJLawkctDOi728+2sfpzI\u003d","cmdEventType":"VM.EXPUNGE","ctxUserId":"2","httpmethod":"GET","_":"1398256658590","ctxAccountId":"2","ctxStartEventId":"3505"},
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid:
345049426471, completeMsid: null, lastUpdated: null, lastPolled: null, created: null}
> 2014-04-23 12:37:38,668 DEBUG [c.c.a.ApiServlet] (catalina-exec-17:ctx-63a3ec65 ctx-fc4c0a3b)
===END===  172.30.86.24 -- GET  command=expungeVirtualMachine&id=05c7735f-43ab-4e75-b211-3791bceb77f9&response=json&sessionkey=OMJLVfWJLawkctDOi728%2B2sfpzI%3D&_=1398256658590
> 2014-04-23 12:37:38,719 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-6:job-827
ctx-602236ef) Sync job-828 execution on object VmWorkJobQueue.80
> 2014-04-23 12:37:38,724 WARN  [c.c.u.d.Merovingian2] (API-Job-Executor-6:job-827 ctx-602236ef)
Was unable to find lock for the key vm_instance80 and thread id 2057517175
> 2014-04-23 12:37:41,720 DEBUG [c.c.a.ApiServlet] (catalina-exec-19:ctx-309c7bb0) ===START===
 172.30.86.24 -- GET  command=queryAsyncJobResult&jobId=849b6fb8-c20f-4362-8fc4-6877f36df874&response=json&sessionkey=OMJLVfWJLawkctDOi728%2B2sfpzI%3D&_=1398256661662
> 2014-04-23 12:37:41,753 DEBUG [c.c.a.ApiServlet] (catalina-exec-19:ctx-309c7bb0 ctx-51354ef7)
===END===  172.30.86.24 -- GET  command=queryAsyncJobResult&jobId=849b6fb8-c20f-4362-8fc4-6877f36df874&response=json&sessionkey=OMJLVfWJLawkctDOi728%2B2sfpzI%3D&_=1398256661662
> 2014-04-23 12:37:41,821 DEBUG [c.c.c.CapacityManagerImpl] (API-Job-Executor-6:job-827
ctx-602236ef) VM state transitted from :Expunging to Expunging with event: ExpungeOperationvm's
original host id: null new host id: null host id before state transition: null
> 2014-04-23 12:37:41,823 DEBUG [c.c.v.VirtualMachineManagerImpl] (API-Job-Executor-6:job-827
ctx-602236ef) Destroying vm VM[User|i-9-80-VM]
> 2014-04-23 12:37:41,824 DEBUG [c.c.v.VirtualMachineManagerImpl] (API-Job-Executor-6:job-827
ctx-602236ef) Cleaning up NICS
> 2014-04-23 12:37:41,832 ERROR [c.c.a.ApiAsyncJobDispatcher] (API-Job-Executor-6:job-827)
Unexpected exception while executing org.apache.cloudstack.api.command.admin.vm.ExpungeVMCmd
> java.lang.NullPointerException
> 	at com.cloud.vm.VirtualMachineManagerImpl.advanceExpunge(VirtualMachineManagerImpl.java:489)
> 	at com.cloud.vm.VirtualMachineManagerImpl.advanceExpunge(VirtualMachineManagerImpl.java:455)
> 	at com.cloud.vm.UserVmManagerImpl.expunge(UserVmManagerImpl.java:1739)
> 	at com.cloud.vm.UserVmManagerImpl.expungeVm(UserVmManagerImpl.java:3855)
> 	at com.cloud.vm.UserVmManagerImpl.expungeVm(UserVmManagerImpl.java:2134)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:622)
> 	at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
> 	at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
> 	at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
> 	at com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:50)
> 	at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
> 	at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
> 	at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
> 	at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
> 	at com.sun.proxy.$Proxy169.expungeVm(Unknown Source)
> 	at org.apache.cloudstack.api.command.admin.vm.ExpungeVMCmd.execute(ExpungeVMCmd.java:102)
> 	at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161)
> 	at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:97)
> 	at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:495)
> 	at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:50)
> 	at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
> 	at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
> 	at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
> 	at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:47)
> 	at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:452)
> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> 	at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> 	at java.lang.Thread.run(Thread.java:701)
> 2014-04-23 12:37:41,836 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-6:job-827)
Complete async job-827, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530}
> 2014-04-23 12:37:41,846 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-6:job-827)
Done executing org.apache.cloudstack.api.command.admin.vm.ExpungeVMCmd for job-827
> 2014-04-23 12:37:41,851 INFO  [o.a.c.f.j.i.AsyncJobMonitor] (API-Job-Executor-6:job-827)
Remove job-827 from job monitoring



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message