Return-Path: X-Original-To: apmail-cloudstack-issues-archive@www.apache.org Delivered-To: apmail-cloudstack-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 23C7518239 for ; Wed, 5 Aug 2015 22:33:10 +0000 (UTC) Received: (qmail 95689 invoked by uid 500); 5 Aug 2015 22:33:05 -0000 Delivered-To: apmail-cloudstack-issues-archive@cloudstack.apache.org Received: (qmail 95656 invoked by uid 500); 5 Aug 2015 22:33:05 -0000 Mailing-List: contact issues-help@cloudstack.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cloudstack.apache.org Delivered-To: mailing list issues@cloudstack.apache.org Received: (qmail 95646 invoked by uid 500); 5 Aug 2015 22:33:04 -0000 Delivered-To: apmail-incubator-cloudstack-issues@incubator.apache.org Received: (qmail 95643 invoked by uid 99); 5 Aug 2015 22:33:04 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Aug 2015 22:33:04 +0000 Date: Wed, 5 Aug 2015 22:33:04 +0000 (UTC) From: "ASF GitHub Bot (JIRA)" To: cloudstack-issues@incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (CLOUDSTACK-8698) Attaching data disk to stopped VM results in NPE MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CLOUDSTACK-8698?page=3Dcom.atla= ssian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId= =3D14659094#comment-14659094 ]=20 ASF GitHub Bot commented on CLOUDSTACK-8698: -------------------------------------------- GitHub user mike-tutkowski opened a pull request: https://github.com/apache/cloudstack/pull/660 CLOUDSTACK-8698: Retrieve a new device ID, if needed This PR addresses https://issues.apache.org/jira/browse/CLOUDSTACK-8698= . You can merge this pull request into a Git repository by running: $ git pull https://github.com/mike-tutkowski/cloudstack CLOUDSTACK-8698 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/cloudstack/pull/660.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #660 =20 ---- commit b1905c2040a400385ad90cbeb8b68a9cedf2fa4d Author: Mike Tutkowski Date: 2015-08-05T19:56:38Z CLOUDSTACK-8698: Retrieve a new device ID, if needed ---- > Attaching data disk to stopped VM results in NPE=20 > ------------------------------------------------- > > Key: CLOUDSTACK-8698 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-869= 8 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the defa= ult.)=20 > Components: Volumes > Affects Versions: 4.6.0 > Reporter: Pavan Kumar Bandarupally > Priority: Critical > Attachments: MSLog.rar > > > Trying to attach a data disk to a stopped VM results in null pointer exce= ption. > Stack Trace:=20 > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > 2015-07-31 16:50:02,494 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJob= Mgr-Heartbeat-1:ctx-3b3545ba) Schedule queued job-327 > 2015-07-31 16:50:02,543 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Exe= cutor-50:ctx-76b7708f job-326/job-327) Add job-327 into job monitoring > 2015-07-31 16:50:02,547 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job= -Executor-50:ctx-76b7708f job-326/job-327) Executing AsyncJobVO {id:327, us= erId: 2, accountId: 2, instanceType: null, instanceId: null, cmd: com.cloud= .vm.VmWorkAttachVolume, cmdInfo: rO0ABXNyAB9jb20uY2xvdWQudm0uVm1Xb3JrQXR0YW= NoVm9sdW1lB62v-WGH4hwCAAJMAAhkZXZpY2VJZHQAEExqYXZhL2xhbmcvTG9uZztMAAh2b2x1b= WVJZHEAfgABeHIAE2NvbS5jbG91ZC52bS5WbVdvcmufmbZW8CVnawIABEoACWFjY291bnRJZEoA= BnVzZXJJZEoABHZtSWRMAAtoYW5kbGVyTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO3hwAAAAAAA= AAAIAAAAAAAAAAgAAAAAAAAAXdAAUVm9sdW1lQXBpU2VydmljZUltcGxwc3IADmphdmEubGFuZy= 5Mb25nO4vkkMyPI98CAAFKAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4c= AAAAAAAAAAe, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCo= de: 0, result: null, initMsid: 233845177509810, completeMsid: null, lastUpd= ated: null, lastPolled: null, created: Fri Jul 31 16:50:01 IST 2015} > 2015-07-31 16:50:02,547 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Execu= tor-50:ctx-76b7708f job-326/job-327) Run VM work job: com.cloud.vm.VmWorkAt= tachVolume for VM 23, job origin: 326 > 2015-07-31 16:50:02,548 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Exe= cutor-50:ctx-76b7708f job-326/job-327 ctx-0821179c) Execute VM work job: co= m.cloud.vm.VmWorkAttachVolume{"volumeId":30,"userId":2,"accountId":2,"vmId"= :23,"handlerName":"VolumeApiServiceImpl"} > 2015-07-31 16:50:02,556 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Exe= cutor-50:ctx-76b7708f job-326/job-327 ctx-0821179c) Invocation exception, c= aused by: java.lang.NullPointerException > 2015-07-31 16:50:02,556 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Exe= cutor-50:ctx-76b7708f job-326/job-327 ctx-0821179c) Rethrow exception java.= lang.NullPointerException > 2015-07-31 16:50:02,556 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Execu= tor-50:ctx-76b7708f job-326/job-327) Done with run of VM work job: com.clou= d.vm.VmWorkAttachVolume for VM 23, job origin: 326 > 2015-07-31 16:50:02,556 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Execu= tor-50:ctx-76b7708f job-326/job-327) Unable to complete AsyncJobVO {id:327,= userId: 2, accountId: 2, instanceType: null, instanceId: null, cmd: com.cl= oud.vm.VmWorkAttachVolume, cmdInfo: rO0ABXNyAB9jb20uY2xvdWQudm0uVm1Xb3JrQXR= 0YWNoVm9sdW1lB62v-WGH4hwCAAJMAAhkZXZpY2VJZHQAEExqYXZhL2xhbmcvTG9uZztMAAh2b2= x1bWVJZHEAfgABeHIAE2NvbS5jbG91ZC52bS5WbVdvcmufmbZW8CVnawIABEoACWFjY291bnRJZ= EoABnVzZXJJZEoABHZtSWRMAAtoYW5kbGVyTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO3hwAAAA= AAAAAAIAAAAAAAAAAgAAAAAAAAAXdAAUVm9sdW1lQXBpU2VydmljZUltcGxwc3IADmphdmEubGF= uZy5Mb25nO4vkkMyPI98CAAFKAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAA= B4cAAAAAAAAAAe, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resul= tCode: 0, result: null, initMsid: 233845177509810, completeMsid: null, last= Updated: null, lastPolled: null, created: Fri Jul 31 16:50:01 IST 2015}, jo= b origin:326 > java.lang.NullPointerException > at com.cloud.storage.VolumeApiServiceImpl.sendAttachVolumeCommand= (VolumeApiServiceImpl.java:2472) > at com.cloud.storage.VolumeApiServiceImpl.orchestrateAttachVolume= ToVM(VolumeApiServiceImpl.java:1359) > at com.cloud.storage.VolumeApiServiceImpl.orchestrateAttachVolume= ToVM(VolumeApiServiceImpl.java:2835) > at sun.reflect.GeneratedMethodAccessor483.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMeth= odAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHa= ndlerProxy.java:107) > at com.cloud.storage.VolumeApiServiceImpl.handleVmWorkJob(VolumeA= piServiceImpl.java:2874) > at sun.reflect.GeneratedMethodAccessor470.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMeth= odAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.springframework.aop.support.AopUtils.invokeJoinpointUsingR= eflection(AopUtils.java:317) > at org.springframework.aop.framework.ReflectiveMethodInvocation.i= nvokeJoinpoint(ReflectiveMethodInvocation.java:183) > at org.springframework.aop.framework.ReflectiveMethodInvocation.p= roceed(ReflectiveMethodInvocation.java:150) > at org.springframework.aop.interceptor.ExposeInvocationIntercepto= r.invoke(ExposeInvocationInterceptor.java:91) > at org.springframework.aop.framework.ReflectiveMethodInvocation.p= roceed(ReflectiveMethodInvocation.java:172) > at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(Jd= kDynamicAopProxy.java:204) > at com.sun.proxy.$Proxy195.handleVmWorkJob(Unknown Source) > at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.ja= va:102) > at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$= 5.runInContext(AsyncJobManagerImpl.java:537) > at org.apache.cloudstack.managed.context.ManagedContextRunnable$1= .run(ManagedContextRunnable.java:49) > at org.apache.cloudstack.managed.context.impl.DefaultManagedConte= xt$1.call(DefaultManagedContext.java:56) > at org.apache.cloudstack.managed.context.impl.DefaultManagedConte= xt.callWithContext(DefaultManagedContext.java:103) > at org.apache.cloudstack.managed.context.impl.DefaultManagedConte= xt.runWithContext(DefaultManagedContext.java:53) > at org.apache.cloudstack.managed.context.ManagedContextRunnable.r= un(ManagedContextRunnable.java:46) > at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$= 5.run(AsyncJobManagerImpl.java:494) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.= java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolEx= ecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolE= xecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > 2015-07-31 16:50:02,557 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job= -Executor-50:ctx-76b7708f job-326/job-327) Complete async job-327, jobStatu= s: FAILED, resultCode: 0, result: rO0ABXNyAB5qYXZhLmxhbmcuTnVsbFBvaW50ZXJFe= GNlcHRpb25HpaGO_zHhuAIAAHhyABpqYXZhLmxhbmcuUnVudGltZUV4Y2VwdGlvbp5fBkcKNIPl= AgAAeHIAE2phdmEubGFuZy5FeGNlcHRpb27Q_R8-GjscxAIAAHhyABNqYXZhLmxhbmcuVGhyb3d= hYmxl1cY1Jzl3uMsDAARMAAVjYXVzZXQAFUxqYXZhL2xhbmcvVGhyb3dhYmxlO0wADWRldGFpbE= 1lc3NhZ2V0ABJMamF2YS9sYW5nL1N0cmluZztbAApzdGFja1RyYWNldAAeW0xqYXZhL2xhbmcvU= 3RhY2tUcmFjZUVsZW1lbnQ7TAAUc3VwcHJlc3NlZEV4Y2VwdGlvbnN0ABBMamF2YS91dGlsL0xp= c3Q7eHBxAH4ACHB1cgAeW0xqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnQ7AkYqPDz9IjkCAAB= 4cAAAAB9zcgAbamF2YS5sYW5nLlN0YWNrVHJhY2VFbGVtZW50YQnFmiY23YUCAARJAApsaW5lTn= VtYmVyTAAOZGVjbGFyaW5nQ2xhc3NxAH4ABUwACGZpbGVOYW1lcQB-AAVMAAptZXRob2ROYW1lc= QB-AAV4cAAACah0ACZjb20uY2xvdWQuc3RvcmFnZS5Wb2x1bWVBcGlTZXJ2aWNlSW1wbHQAGVZv= bHVtZUFwaVNlcnZpY2VJbXBsLmphdmF0ABdzZW5kQXR0YWNoVm9sdW1lQ29tbWFuZHNxAH4ACwA= ABU9xAH4ADXEAfgAOdAAbb3JjaGVzdHJhdGVBdHRhY2hWb2x1bWVUb1ZNc3EAfgALAAALE3EAfg= ANcQB-AA5xAH4AEXNxAH4AC_____90ACZzdW4ucmVmbGVjdC5HZW5lcmF0ZWRNZXRob2RBY2Nlc= 3NvcjQ4M3B0AAZpbnZva2VzcQB-AAsAAAArdAAoc3VuLnJlZmxlY3QuRGVsZWdhdGluZ01ldGhv= ZEFjY2Vzc29ySW1wbHQAIURlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGwuamF2YXEAfgAVc3E= AfgALAAACXnQAGGphdmEubGFuZy5yZWZsZWN0Lk1ldGhvZHQAC01ldGhvZC5qYXZhcQB-ABVzcQ= B-AAsAAABrdAAiY29tLmNsb3VkLnZtLlZtV29ya0pvYkhhbmRsZXJQcm94eXQAGlZtV29ya0pvY= khhbmRsZXJQcm94eS5qYXZhdAAPaGFuZGxlVm1Xb3JrSm9ic3EAfgALAAALOnEAfgANcQB-AA5x= AH4AH3NxAH4AC_____90ACZzdW4ucmVmbGVjdC5HZW5lcmF0ZWRNZXRob2RBY2Nlc3NvcjQ3MHB= xAH4AFXNxAH4ACwAAACtxAH4AF3EAfgAYcQB-ABVzcQB-AAsAAAJecQB-ABpxAH4AG3EAfgAVc3= EAfgALAAABPXQAKG9yZy5zcHJpbmdmcmFtZXdvcmsuYW9wLnN1cHBvcnQuQW9wVXRpbHN0AA1Bb= 3BVdGlscy5qYXZhdAAeaW52b2tlSm9pbnBvaW50VXNpbmdSZWZsZWN0aW9uc3EAfgALAAAAt3QA= PG9yZy5zcHJpbmdmcmFtZXdvcmsuYW9wLmZyYW1ld29yay5SZWZsZWN0aXZlTWV0aG9kSW52b2N= hdGlvbnQAH1JlZmxlY3RpdmVNZXRob2RJbnZvY2F0aW9uLmphdmF0AA9pbnZva2VKb2lucG9pbn= RzcQB-AAsAAACWcQB-ACpxAH4AK3QAB3Byb2NlZWRzcQB-AAsAAABbdAA_b3JnLnNwcmluZ2ZyY= W1ld29yay5hb3AuaW50ZXJjZXB0b3IuRXhwb3NlSW52b2NhdGlvbkludGVyY2VwdG9ydAAgRXhw= b3NlSW52b2NhdGlvbkludGVyY2VwdG9yLmphdmFxAH4AFXNxAH4ACwAAAKxxAH4AKnEAfgArcQB= -AC5zcQB-AAsAAADMdAA0b3JnLnNwcmluZ2ZyYW1ld29yay5hb3AuZnJhbWV3b3JrLkpka0R5bm= FtaWNBb3BQcm94eXQAF0pka0R5bmFtaWNBb3BQcm94eS5qYXZhcQB-ABVzcQB-AAv_____dAAXY= 29tLnN1bi5wcm94eS4kUHJveHkxOTVwcQB-AB9zcQB-AAsAAABmdAAgY29tLmNsb3VkLnZtLlZt= V29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB= -AAsAAAIZdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bm= NKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250Z= Xh0c3EAfgALAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFu= YWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnV= uc3EAfgALAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC= 5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY= 2FsbHNxAH4ACwAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lmlt= cGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-AEZ0AA9jYWxsV2l0aENvbnRleHRzcQB-AAsAAAA= 1cQB-AElxAH4ARnQADnJ1bldpdGhDb250ZXh0c3EAfgALAAAALnQAPG9yZy5hcGFjaGUuY2xvdW= RzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgBCcQB-AENzc= QB-AAsAAAHucQB-AD1xAH4APnEAfgBDc3EAfgALAAAB13QALmphdmEudXRpbC5jb25jdXJyZW50= LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgBHc3EAfgALAAA= BBnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH= 4AQ3NxAH4ACwAABHl0ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0A= BdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4ACwAAAmd0AC5qYXZhLnV0= aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AFhxAH4AQ3NxAH4ACwA= AAul0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AQ3NyACZqYXZhLnV0aWwuQ2= 9sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAHeHIALGphd= mEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFj= dAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcd= hnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AGR4 > 2015-07-31 16:50:02,558 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job= -Executor-50:ctx-76b7708f job-326/job-327) Publish async job-327 complete o= n message bus > 2015-07-31 16:50:02,558 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job= -Executor-50:ctx-76b7708f job-326/job-327) Wake up jobs related to job-327 > 2015-07-31 16:50:02,558 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job= -Executor-50:ctx-76b7708f job-326/job-327) Update db status for job-327 > 2015-07-31 16:50:02,558 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job= -Executor-50:ctx-76b7708f job-326/job-327) Wake up jobs joined with job-327= and disjoin all subjobs created from job- 327 > 2015-07-31 16:50:02,610 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job= -Executor-50:ctx-76b7708f job-326/job-327) Done executing com.cloud.vm.VmWo= rkAttachVolume for job-327 > 2015-07-31 16:50:02,611 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Exe= cutor-50:ctx-76b7708f job-326/job-327) Remove job-327 from job monitoring > 2015-07-31 16:50:02,711 ERROR [c.c.a.ApiAsyncJobDispatcher] (API-Job-Exec= utor-78:ctx-089e80bd job-326) Unexpected exception while executing org.apac= he.cloudstack.api.command.admin.volume.AttachVolumeCmdByAdmin > java.lang.NullPointerException > at com.cloud.storage.VolumeApiServiceImpl.sendAttachVolumeCommand= (VolumeApiServiceImpl.java:2472) > at com.cloud.storage.VolumeApiServiceImpl.orchestrateAttachVolume= ToVM(VolumeApiServiceImpl.java:1359) > at com.cloud.storage.VolumeApiServiceImpl.orchestrateAttachVolume= ToVM(VolumeApiServiceImpl.java:2835) > at sun.reflect.GeneratedMethodAccessor483.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMeth= odAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHa= ndlerProxy.java:107) > at com.cloud.storage.VolumeApiServiceImpl.handleVmWorkJob(VolumeA= piServiceImpl.java:2874) > at sun.reflect.GeneratedMethodAccessor470.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMeth= odAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.springframework.aop.support.AopUtils.invokeJoinpointUsingR= eflection(AopUtils.java:317) > at org.springframework.aop.framework.ReflectiveMethodInvocation.i= nvokeJoinpoint(ReflectiveMethodInvocation.java:183) > at org.springframework.aop.framework.ReflectiveMethodInvocation.p= roceed(ReflectiveMethodInvocation.java:150) > at org.springframework.aop.interceptor.ExposeInvocationIntercepto= r.invoke(ExposeInvocationInterceptor.java:91) > at org.springframework.aop.framework.ReflectiveMethodInvocation.p= roceed(ReflectiveMethodInvocation.java:172) > at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(Jd= kDynamicAopProxy.java:204) > at com.sun.proxy.$Proxy195.handleVmWorkJob(Unknown Source) > at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.ja= va:102) > at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$= 5.runInContext(AsyncJobManagerImpl.java:537) > at org.apache.cloudstack.managed.context.ManagedContextRunnable$1= .run(ManagedContextRunnable.java:49) > at org.apache.cloudstack.managed.context.impl.DefaultManagedConte= xt$1.call(DefaultManagedContext.java:56) > at org.apache.cloudstack.managed.context.impl.DefaultManagedConte= xt.callWithContext(DefaultManagedContext.java:103) > at org.apache.cloudstack.managed.context.impl.DefaultManagedConte= xt.runWithContext(DefaultManagedContext.java:53) > at org.apache.cloudstack.managed.context.ManagedContextRunnable.r= un(ManagedContextRunnable.java:46) > at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$= 5.run(AsyncJobManagerImpl.java:494) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.= java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolEx= ecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolE= xecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > 2015-07-31 16:50:02,711 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-= Executor-78:ctx-089e80bd job-326) Complete async job-326, jobStatus: FAILED= , resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResp= onse/null/{"uuidList":[],"errorcode":530} > 2015-07-31 16:50:02,712 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-= Executor-78:ctx-089e80bd job-326) Publish async job-326 complete on message= bus > 2015-07-31 16:50:02,712 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-= Executor-78:ctx-089e80bd job-326) Wake up jobs related to job-326 > 2015-07-31 16:50:02,712 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-= Executor-78:ctx-089e80bd job-326) Update db status for job-326 > 2015-07-31 16:50:02,713 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-= Executor-78:ctx-089e80bd job-326) Wake up jobs joined with job-326 and disj= oin all subjobs created from job- 326 > 2015-07-31 16:50:02,761 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-= Executor-78:ctx-089e80bd job-326) Done executing org.apache.cloudstack.api.= command.admin.volume.AttachVolumeCmdByAdmin for job-326 > 2015-07-31 16:50:02,761 INFO [o.a.c.f.j.i.AsyncJobMonitor] (API-Job-Exec= utor-78:ctx-089e80bd job-326) Remove job-326 from job monitoring > 2015-07-31 16:50:03,323 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Ha= ndler-14:null) SeqA 2-33164: Processing Seq 2-33164: { Cmd , MgmtId: -1, v= ia: 2, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCom= mand":{"_proxyVmId":1,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}]= } > 2015-07-31 16:50:03,369 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Ha= ndler-14:null) SeqA 2-33164: Sending Seq 2-33164: { Ans: , MgmtId: 2338451= 77509810, via: 2, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentContr= olAnswer":{"result":true,"wait":0}}] } > 2015-07-31 16:50:03,878 DEBUG [c.c.c.ClusterManagerImpl] (Cluster-Heartbe= at-1:ctx-aba3622a) Peer scan takes too long to finish. profiler: Done. Dura= tion: 0ms, profilerQueryActiveList: Done. Duration: 0ms, profilerSyncCluste= rInfo: Done. Duration: 0ms, profilerInvalidatedNodeList: Done. Duration: 0m= s, profilerRemovedList: Done. Duration: 0ms > 2015-07-31 16:50:03,878 DEBUG [c.c.c.ClusterManagerImpl] (Cluster-Heartbe= at-1:ctx-aba3622a) Management server heartbeat takes too long to finish. pr= ofiler: Done. Duration: 51ms, profilerHeartbeatUpdate: Done. Duration: 51ms= , profilerPeerScan: Done. Duration: 0ms > 2015-07-31 16:50:04,125 DEBUG [c.c.a.ApiServlet] (catalina-exec-18:ctx-55= 5a49b8) =3D=3D=3DSTART=3D=3D=3D 10.252.193.16 -- GET command=3DqueryAsync= JobResult&jobId=3Dd56e951a-ebb3-4ee0-ace4-7e1bf84da55d&response=3Djson&_=3D= 1438341604091 > 2015-07-31 16:50:04,189 DEBUG [c.c.a.ApiServlet] (catalina-exec-18:ctx-55= 5a49b8 ctx-e9917261) =3D=3D=3DEND=3D=3D=3D 10.252.193.16 -- GET command= =3DqueryAsyncJobResult&jobId=3Dd56e951a-ebb3-4ee0-ace4-7e1bf84da55d&respons= e=3Djson&_=3D1438341604091 > 2015-07-31 16:50:04,332 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJob= Mgr-Heartbeat-1:ctx-917eda34) Begin cleanup expired async-jobs > 2015-07-31 16:50:04,334 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJob= Mgr-Heartbeat-1:ctx-917eda34) End cleanup expired async-jobs > 2015-07-31 16:50:05,379 DEBUG [c.c.c.ClusterManagerImpl] (Cluster-Heartbe= at-1:ctx-756f50a3) Peer scan takes too long to finish. profiler: Done. Dura= tion: 0ms, profilerQueryActiveList: Done. Duration: 0ms, profilerSyncCluste= rInfo: Done. Duration: 0ms, profilerInvalidatedNodeList: Done. Duration: 0m= s, profilerRemovedList: Done. Duration: 0ms > 2015-07-31 16:50:05,379 DEBUG [c.c.c.ClusterManagerImpl] (Cluster-Heartbe= at-1:ctx-756f50a3) Management server heartbeat takes too long to finish. pr= ofiler: Done. Duration: 52ms, profilerHeartbeatUpdate: Done. Duration: 51ms= , profilerPeerScan: Done. Duration: 0ms > 2015-07-31 16:50:05,490 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consolepro= xy-1:ctx-bd2eff9b) Zone 1 is ready to launch console proxy > 2015-07-31 16:50:05,741 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secs= torage-1:ctx-b088bec9) Zone 1 is ready to launch secondary storage VM -- This message was sent by Atlassian JIRA (v6.3.4#6332)