cloudstack-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CLOUDSTACK-8698) Attaching data disk to stopped VM results in NPE
Date Thu, 06 Aug 2015 05:10:04 GMT

    [ https://issues.apache.org/jira/browse/CLOUDSTACK-8698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14659501#comment-14659501
] 

ASF GitHub Bot commented on CLOUDSTACK-8698:
--------------------------------------------

Github user mike-tutkowski commented on the pull request:

    https://github.com/apache/cloudstack/pull/660#issuecomment-128243816
  
    I don't think there's a race condition anymore (it was fixed by my initial commit (not
this code)).
    
    The attach code is run in serial for the VM in question. For example, if multiple attaches
come in for the VM, they are serialized and so any race condition is avoided.
    
    The original problem was that the device ID was selected before passing the work to the
job queue. If multiple attach commands came in simultaneously, we could pick the same device
ID multiple times (so the second attach would fail).


> Attaching data disk to stopped VM results in NPE 
> -------------------------------------------------
>
>                 Key: CLOUDSTACK-8698
>                 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8698
>             Project: CloudStack
>          Issue Type: Bug
>      Security Level: Public(Anyone can view this level - this is the default.) 
>          Components: Volumes
>    Affects Versions: 4.6.0
>            Reporter: Pavan Kumar Bandarupally
>            Assignee: Mike Tutkowski
>            Priority: Critical
>         Attachments: MSLog.rar
>
>
> Trying to attach a data disk to a stopped VM results in null pointer exception.
> Stack Trace: 
> ===========
> 2015-07-31 16:50:02,494 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-3b3545ba)
Schedule queued job-327
> 2015-07-31 16:50:02,543 INFO  [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-50:ctx-76b7708f
job-326/job-327) Add job-327 into job monitoring
> 2015-07-31 16:50:02,547 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-50:ctx-76b7708f
job-326/job-327) Executing AsyncJobVO {id:327, userId: 2, accountId: 2, instanceType: null,
instanceId: null, cmd: com.cloud.vm.VmWorkAttachVolume, cmdInfo: rO0ABXNyAB9jb20uY2xvdWQudm0uVm1Xb3JrQXR0YWNoVm9sdW1lB62v-WGH4hwCAAJMAAhkZXZpY2VJZHQAEExqYXZhL2xhbmcvTG9uZztMAAh2b2x1bWVJZHEAfgABeHIAE2NvbS5jbG91ZC52bS5WbVdvcmufmbZW8CVnawIABEoACWFjY291bnRJZEoABnVzZXJJZEoABHZtSWRMAAtoYW5kbGVyTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO3hwAAAAAAAAAAIAAAAAAAAAAgAAAAAAAAAXdAAUVm9sdW1lQXBpU2VydmljZUltcGxwc3IADmphdmEubGFuZy5Mb25nO4vkkMyPI98CAAFKAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAAAAAAAAe,
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid:
233845177509810, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Jul
31 16:50:01 IST 2015}
> 2015-07-31 16:50:02,547 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-50:ctx-76b7708f
job-326/job-327) Run VM work job: com.cloud.vm.VmWorkAttachVolume for VM 23, job origin: 326
> 2015-07-31 16:50:02,548 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-50:ctx-76b7708f
job-326/job-327 ctx-0821179c) Execute VM work job: com.cloud.vm.VmWorkAttachVolume{"volumeId":30,"userId":2,"accountId":2,"vmId":23,"handlerName":"VolumeApiServiceImpl"}
> 2015-07-31 16:50:02,556 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-50:ctx-76b7708f
job-326/job-327 ctx-0821179c) Invocation exception, caused by: java.lang.NullPointerException
> 2015-07-31 16:50:02,556 INFO  [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-50:ctx-76b7708f
job-326/job-327 ctx-0821179c) Rethrow exception java.lang.NullPointerException
> 2015-07-31 16:50:02,556 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-50:ctx-76b7708f
job-326/job-327) Done with run of VM work job: com.cloud.vm.VmWorkAttachVolume for VM 23,
job origin: 326
> 2015-07-31 16:50:02,556 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-50:ctx-76b7708f
job-326/job-327) Unable to complete AsyncJobVO {id:327, userId: 2, accountId: 2, instanceType:
null, instanceId: null, cmd: com.cloud.vm.VmWorkAttachVolume, cmdInfo: rO0ABXNyAB9jb20uY2xvdWQudm0uVm1Xb3JrQXR0YWNoVm9sdW1lB62v-WGH4hwCAAJMAAhkZXZpY2VJZHQAEExqYXZhL2xhbmcvTG9uZztMAAh2b2x1bWVJZHEAfgABeHIAE2NvbS5jbG91ZC52bS5WbVdvcmufmbZW8CVnawIABEoACWFjY291bnRJZEoABnVzZXJJZEoABHZtSWRMAAtoYW5kbGVyTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO3hwAAAAAAAAAAIAAAAAAAAAAgAAAAAAAAAXdAAUVm9sdW1lQXBpU2VydmljZUltcGxwc3IADmphdmEubGFuZy5Mb25nO4vkkMyPI98CAAFKAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAAAAAAAAe,
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid:
233845177509810, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Jul
31 16:50:01 IST 2015}, job origin:326
> java.lang.NullPointerException
>         at com.cloud.storage.VolumeApiServiceImpl.sendAttachVolumeCommand(VolumeApiServiceImpl.java:2472)
>         at com.cloud.storage.VolumeApiServiceImpl.orchestrateAttachVolumeToVM(VolumeApiServiceImpl.java:1359)
>         at com.cloud.storage.VolumeApiServiceImpl.orchestrateAttachVolumeToVM(VolumeApiServiceImpl.java:2835)
>         at sun.reflect.GeneratedMethodAccessor483.invoke(Unknown Source)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:606)
>         at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
>         at com.cloud.storage.VolumeApiServiceImpl.handleVmWorkJob(VolumeApiServiceImpl.java:2874)
>         at sun.reflect.GeneratedMethodAccessor470.invoke(Unknown Source)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:606)
>         at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
>         at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
>         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
>         at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
>         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
>         at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
>         at com.sun.proxy.$Proxy195.handleVmWorkJob(Unknown Source)
>         at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
>         at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
>         at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>         at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>         at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>         at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>         at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>         at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
>         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:745)
> 2015-07-31 16:50:02,557 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-50:ctx-76b7708f
job-326/job-327) Complete async job-327, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyAB5qYXZhLmxhbmcuTnVsbFBvaW50ZXJFeGNlcHRpb25HpaGO_zHhuAIAAHhyABpqYXZhLmxhbmcuUnVudGltZUV4Y2VwdGlvbp5fBkcKNIPlAgAAeHIAE2phdmEubGFuZy5FeGNlcHRpb27Q_R8-GjscxAIAAHhyABNqYXZhLmxhbmcuVGhyb3dhYmxl1cY1Jzl3uMsDAARMAAVjYXVzZXQAFUxqYXZhL2xhbmcvVGhyb3dhYmxlO0wADWRldGFpbE1lc3NhZ2V0ABJMamF2YS9sYW5nL1N0cmluZztbAApzdGFja1RyYWNldAAeW0xqYXZhL2xhbmcvU3RhY2tUcmFjZUVsZW1lbnQ7TAAUc3VwcHJlc3NlZEV4Y2VwdGlvbnN0ABBMamF2YS91dGlsL0xpc3Q7eHBxAH4ACHB1cgAeW0xqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnQ7AkYqPDz9IjkCAAB4cAAAAB9zcgAbamF2YS5sYW5nLlN0YWNrVHJhY2VFbGVtZW50YQnFmiY23YUCAARJAApsaW5lTnVtYmVyTAAOZGVjbGFyaW5nQ2xhc3NxAH4ABUwACGZpbGVOYW1lcQB-AAVMAAptZXRob2ROYW1lcQB-AAV4cAAACah0ACZjb20uY2xvdWQuc3RvcmFnZS5Wb2x1bWVBcGlTZXJ2aWNlSW1wbHQAGVZvbHVtZUFwaVNlcnZpY2VJbXBsLmphdmF0ABdzZW5kQXR0YWNoVm9sdW1lQ29tbWFuZHNxAH4ACwAABU9xAH4ADXEAfgAOdAAbb3JjaGVzdHJhdGVBdHRhY2hWb2x1bWVUb1ZNc3EAfgALAAALE3EAfgANcQB-AA5xAH4AEXNxAH4AC_____90ACZzdW4ucmVmbGVjdC5HZW5lcmF0ZWRNZXRob2RBY2Nlc3NvcjQ4M3B0AAZpbnZva2VzcQB-AAsAAAArdAAoc3VuLnJlZmxlY3QuRGVsZWdhdGluZ01ldGhvZEFjY2Vzc29ySW1wbHQAIURlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGwuamF2YXEAfgAVc3EAfgALAAACXnQAGGphdmEubGFuZy5yZWZsZWN0Lk1ldGhvZHQAC01ldGhvZC5qYXZhcQB-ABVzcQB-AAsAAABrdAAiY29tLmNsb3VkLnZtLlZtV29ya0pvYkhhbmRsZXJQcm94eXQAGlZtV29ya0pvYkhhbmRsZXJQcm94eS5qYXZhdAAPaGFuZGxlVm1Xb3JrSm9ic3EAfgALAAALOnEAfgANcQB-AA5xAH4AH3NxAH4AC_____90ACZzdW4ucmVmbGVjdC5HZW5lcmF0ZWRNZXRob2RBY2Nlc3NvcjQ3MHBxAH4AFXNxAH4ACwAAACtxAH4AF3EAfgAYcQB-ABVzcQB-AAsAAAJecQB-ABpxAH4AG3EAfgAVc3EAfgALAAABPXQAKG9yZy5zcHJpbmdmcmFtZXdvcmsuYW9wLnN1cHBvcnQuQW9wVXRpbHN0AA1Bb3BVdGlscy5qYXZhdAAeaW52b2tlSm9pbnBvaW50VXNpbmdSZWZsZWN0aW9uc3EAfgALAAAAt3QAPG9yZy5zcHJpbmdmcmFtZXdvcmsuYW9wLmZyYW1ld29yay5SZWZsZWN0aXZlTWV0aG9kSW52b2NhdGlvbnQAH1JlZmxlY3RpdmVNZXRob2RJbnZvY2F0aW9uLmphdmF0AA9pbnZva2VKb2lucG9pbnRzcQB-AAsAAACWcQB-ACpxAH4AK3QAB3Byb2NlZWRzcQB-AAsAAABbdAA_b3JnLnNwcmluZ2ZyYW1ld29yay5hb3AuaW50ZXJjZXB0b3IuRXhwb3NlSW52b2NhdGlvbkludGVyY2VwdG9ydAAgRXhwb3NlSW52b2NhdGlvbkludGVyY2VwdG9yLmphdmFxAH4AFXNxAH4ACwAAAKxxAH4AKnEAfgArcQB-AC5zcQB-AAsAAADMdAA0b3JnLnNwcmluZ2ZyYW1ld29yay5hb3AuZnJhbWV3b3JrLkpka0R5bmFtaWNBb3BQcm94eXQAF0pka0R5bmFtaWNBb3BQcm94eS5qYXZhcQB-ABVzcQB-AAv_____dAAXY29tLnN1bi5wcm94eS4kUHJveHkxOTVwcQB-AB9zcQB-AAsAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-AAsAAAIZdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgALAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgALAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4ACwAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-AEZ0AA9jYWxsV2l0aENvbnRleHRzcQB-AAsAAAA1cQB-AElxAH4ARnQADnJ1bldpdGhDb250ZXh0c3EAfgALAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgBCcQB-AENzcQB-AAsAAAHucQB-AD1xAH4APnEAfgBDc3EAfgALAAAB13QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgBHc3EAfgALAAABBnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AQ3NxAH4ACwAABHl0ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4ACwAAAmd0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AFhxAH4AQ3NxAH4ACwAAAul0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AQ3NyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAHeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AGR4
> 2015-07-31 16:50:02,558 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-50:ctx-76b7708f
job-326/job-327) Publish async job-327 complete on message bus
> 2015-07-31 16:50:02,558 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-50:ctx-76b7708f
job-326/job-327) Wake up jobs related to job-327
> 2015-07-31 16:50:02,558 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-50:ctx-76b7708f
job-326/job-327) Update db status for job-327
> 2015-07-31 16:50:02,558 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-50:ctx-76b7708f
job-326/job-327) Wake up jobs joined with job-327 and disjoin all subjobs created from job-
327
> 2015-07-31 16:50:02,610 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-50:ctx-76b7708f
job-326/job-327) Done executing com.cloud.vm.VmWorkAttachVolume for job-327
> 2015-07-31 16:50:02,611 INFO  [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-50:ctx-76b7708f
job-326/job-327) Remove job-327 from job monitoring
> 2015-07-31 16:50:02,711 ERROR [c.c.a.ApiAsyncJobDispatcher] (API-Job-Executor-78:ctx-089e80bd
job-326) Unexpected exception while executing org.apache.cloudstack.api.command.admin.volume.AttachVolumeCmdByAdmin
> java.lang.NullPointerException
>         at com.cloud.storage.VolumeApiServiceImpl.sendAttachVolumeCommand(VolumeApiServiceImpl.java:2472)
>         at com.cloud.storage.VolumeApiServiceImpl.orchestrateAttachVolumeToVM(VolumeApiServiceImpl.java:1359)
>         at com.cloud.storage.VolumeApiServiceImpl.orchestrateAttachVolumeToVM(VolumeApiServiceImpl.java:2835)
>         at sun.reflect.GeneratedMethodAccessor483.invoke(Unknown Source)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:606)
>         at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
>         at com.cloud.storage.VolumeApiServiceImpl.handleVmWorkJob(VolumeApiServiceImpl.java:2874)
>         at sun.reflect.GeneratedMethodAccessor470.invoke(Unknown Source)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:606)
>         at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
>         at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
>         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
>         at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
>         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
>         at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
>         at com.sun.proxy.$Proxy195.handleVmWorkJob(Unknown Source)
>         at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
>         at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
>         at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>         at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>         at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>         at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>         at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>         at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
>         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:745)
> 2015-07-31 16:50:02,711 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-78:ctx-089e80bd
job-326) Complete async job-326, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530}
> 2015-07-31 16:50:02,712 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-78:ctx-089e80bd
job-326) Publish async job-326 complete on message bus
> 2015-07-31 16:50:02,712 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-78:ctx-089e80bd
job-326) Wake up jobs related to job-326
> 2015-07-31 16:50:02,712 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-78:ctx-089e80bd
job-326) Update db status for job-326
> 2015-07-31 16:50:02,713 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-78:ctx-089e80bd
job-326) Wake up jobs joined with job-326 and disjoin all subjobs created from job- 326
> 2015-07-31 16:50:02,761 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-78:ctx-089e80bd
job-326) Done executing org.apache.cloudstack.api.command.admin.volume.AttachVolumeCmdByAdmin
for job-326
> 2015-07-31 16:50:02,761 INFO  [o.a.c.f.j.i.AsyncJobMonitor] (API-Job-Executor-78:ctx-089e80bd
job-326) Remove job-326 from job monitoring
> 2015-07-31 16:50:03,323 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-14:null)
SeqA 2-33164: Processing Seq 2-33164:  { Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
 \"connections\": []\n}","wait":0}}] }
> 2015-07-31 16:50:03,369 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-14:null)
SeqA 2-33164: Sending Seq 2-33164:  { Ans: , MgmtId: 233845177509810, via: 2, Ver: v1, Flags:
100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
> 2015-07-31 16:50:03,878 DEBUG [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:ctx-aba3622a)
Peer scan takes too long to finish. profiler: Done. Duration: 0ms, profilerQueryActiveList:
Done. Duration: 0ms, profilerSyncClusterInfo: Done. Duration: 0ms, profilerInvalidatedNodeList:
Done. Duration: 0ms, profilerRemovedList: Done. Duration: 0ms
> 2015-07-31 16:50:03,878 DEBUG [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:ctx-aba3622a)
Management server heartbeat takes too long to finish. profiler: Done. Duration: 51ms, profilerHeartbeatUpdate:
Done. Duration: 51ms, profilerPeerScan: Done. Duration: 0ms
> 2015-07-31 16:50:04,125 DEBUG [c.c.a.ApiServlet] (catalina-exec-18:ctx-555a49b8) ===START===
 10.252.193.16 -- GET  command=queryAsyncJobResult&jobId=d56e951a-ebb3-4ee0-ace4-7e1bf84da55d&response=json&_=1438341604091
> 2015-07-31 16:50:04,189 DEBUG [c.c.a.ApiServlet] (catalina-exec-18:ctx-555a49b8 ctx-e9917261)
===END===  10.252.193.16 -- GET  command=queryAsyncJobResult&jobId=d56e951a-ebb3-4ee0-ace4-7e1bf84da55d&response=json&_=1438341604091
> 2015-07-31 16:50:04,332 INFO  [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-917eda34)
Begin cleanup expired async-jobs
> 2015-07-31 16:50:04,334 INFO  [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-917eda34)
End cleanup expired async-jobs
> 2015-07-31 16:50:05,379 DEBUG [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:ctx-756f50a3)
Peer scan takes too long to finish. profiler: Done. Duration: 0ms, profilerQueryActiveList:
Done. Duration: 0ms, profilerSyncClusterInfo: Done. Duration: 0ms, profilerInvalidatedNodeList:
Done. Duration: 0ms, profilerRemovedList: Done. Duration: 0ms
> 2015-07-31 16:50:05,379 DEBUG [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:ctx-756f50a3)
Management server heartbeat takes too long to finish. profiler: Done. Duration: 52ms, profilerHeartbeatUpdate:
Done. Duration: 51ms, profilerPeerScan: Done. Duration: 0ms
> 2015-07-31 16:50:05,490 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-bd2eff9b)
Zone 1 is ready to launch console proxy
> 2015-07-31 16:50:05,741 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-b088bec9)
Zone 1 is ready to launch secondary storage VM



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message