Return-Path: X-Original-To: apmail-cloudstack-issues-archive@www.apache.org Delivered-To: apmail-cloudstack-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3D72E118B6 for ; Fri, 18 Jul 2014 08:34:05 +0000 (UTC) Received: (qmail 39992 invoked by uid 500); 18 Jul 2014 08:34:05 -0000 Delivered-To: apmail-cloudstack-issues-archive@cloudstack.apache.org Received: (qmail 39953 invoked by uid 500); 18 Jul 2014 08:34:05 -0000 Mailing-List: contact issues-help@cloudstack.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cloudstack.apache.org Delivered-To: mailing list issues@cloudstack.apache.org Received: (qmail 39942 invoked by uid 500); 18 Jul 2014 08:34:05 -0000 Delivered-To: apmail-incubator-cloudstack-issues@incubator.apache.org Received: (qmail 39939 invoked by uid 99); 18 Jul 2014 08:34:05 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 18 Jul 2014 08:34:05 +0000 Date: Fri, 18 Jul 2014 08:34:04 +0000 (UTC) From: "Likitha Shetty (JIRA)" To: cloudstack-issues@incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (CLOUDSTACK-7099) Volume snapshot is not getting backed up MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CLOUDSTACK-7099?page=3Dcom.atl= assian.jira.plugin.system.issuetabpanels:all-tabpanel ] Likitha Shetty updated CLOUDSTACK-7099: --------------------------------------- Description:=20 While trying to snapshot a volume, the volume snapshot is not backed up and= it remains in 'Allocated' state. As a result of the fix made to resolve [https://issues.apache.org/jira/brow= se/CLOUDSTACK-3272], ConfigDao is not being injected into SnapshotStateList= ener which results in an NPE. And this causes the snapshot process to fail = . =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D NullPointerException: =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D 2014-07-11 16:04:19,404 DEBUG [c.c.a.ApiServlet] (catalina-exec-6:ctx-2e149= d28) =3D=3D=3DSTART=3D=3D=3D 10.220.64.12 =E2=80=93 GET apiKey=3DrxE2hLk5MH= zoICoYNRyFf8L5PrmohVkUWNwtGE12LlZ7LF5mEsTeiSA6yAYYA3GPkX7ltSYhLOkd_h2i4GOYr= g&volumeid=3Dcc65c8a0-d7e2-499b-9ceb-673e17b243d6&command=3DcreateSnapshot&= signature=3Dzo0mi4A8VXGZ%2FmOfLDZT%2FShR%2BX8%3D&response=3Djson 2014-07-11 16:04:19,533 INFO [o.a.c.f.j.i.AsyncJobMonitor] (API-Job-Executo= r-15:ctx-a027e338 job-735) Add job-735 into job monitoring 2014-07-11 16:04:19,533 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Ex= ecutor-15:ctx-a027e338 job-735) Executing AsyncJobVO {id:735, userId: 90, a= ccountId: 87, instanceType: Snapshot, instanceId: 5, cmd: org.apache.clouds= tack.api.command.user.snapshot.CreateSnapshotCmd, cmdInfo: {"id":"5","respo= nse":"json","ctxDetails":" {\"com.cloud.storage.Snapshot\":\"7918dca2-6515-4e59-be61-df7b91d8fc56\",\"= com.cloud.storage.Volume\":\"cc65c8a0-d7e2-499b-9ceb-673e17b243d6\"} ","cmdEventType":"SNAPSHOT.CREATE","ctxUserId":"90","httpmethod":"GET","vol= umeid":"cc65c8a0-d7e2-499b-9ceb-673e17b243d6","uuid":"7918dca2-6515-4e59-be= 61-df7b91d8fc56","ctxAccountId":"87","ctxStartEventId":"1737","apiKey":"rxE= 2hLk5MHzoICoYNRyFf8L5PrmohVkUWNwtGE12LlZ7LF5mEsTeiSA6yAYYA3GPkX7ltSYhLOkd_h= 2i4GOYrg","signature":"zo0mi4A8VXGZ/mOfLDZT/ShR+X8\u003d"}, cmdVersion: 0, = status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsi= d: 161135757057464, completeMsid: null, lastUpdated: null, lastPolled: null= , created: null} 2014-07-11 16:04:19,541 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (catalina-e= xec-6:ctx-2e149d28 ctx-25fc048a ctx-cd01f6fe) submit async job-735, details= : AsyncJobVO {id:735, userId: 90, accountId: 87, instanceType: Snapshot, in= stanceId: 5, cmd: org.apache.cloudstack.api.command.user.snapshot.CreateSna= pshotCmd, cmdInfo: {"id":"5","response":"json","ctxDetails":" {\"com.cloud.storage.Snapshot\":\"7918dca2-6515-4e59-be61-df7b91d8fc56\",\"= com.cloud.storage.Volume\":\"cc65c8a0-d7e2-499b-9ceb-673e17b243d6\"} ","cmdEventType":"SNAPSHOT.CREATE","ctxUserId":"90","httpmethod":"GET","vol= umeid":"cc65c8a0-d7e2-499b-9ceb-673e17b243d6","uuid":"7918dca2-6515-4e59-be= 61-df7b91d8fc56","ctxAccountId":"87","ctxStartEventId":"1737","apiKey":"rxE= 2hLk5MHzoICoYNRyFf8L5PrmohVkUWNwtGE12LlZ7LF5mEsTeiSA6yAYYA3GPkX7ltSYhLOkd_h= 2i4GOYrg","signature":"zo0mi4A8VXGZ/mOfLDZT/ShR+X8\u003d"}, cmdVersion: 0, = status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsi= d: 161135757057464, completeMsid: null, lastUpdated: null, lastPolled: null= , created: null} 2014-07-11 16:04:19,542 DEBUG [c.c.a.ApiServlet] (catalina-exec-6:ctx-2e149= d28 ctx-25fc048a ctx-cd01f6fe) =3D=3D=3DEND=3D=3D=3D 10.220.64.12 =E2=80=93= GET apiKey=3DrxE2hLk5MHzoICoYNRyFf8L5PrmohVkUWNwtGE12LlZ7LF5mEsTeiSA6yAYYA= 3GPkX7ltSYhLOkd_h2i4GOYrg&volumeid=3Dcc65c8a0-d7e2-499b-9ceb-673e17b243d6&c= ommand=3DcreateSnapshot&signature=3Dzo0mi4A8VXGZ%2FmOfLDZT%2FShR%2BX8%3D&re= sponse=3Djson 2014-07-11 16:04:19,546 DEBUG [c.c.a.ApiServlet] (catalina-exec-9:ctx-75ac1= 3f2) =3D=3D=3DSTART=3D=3D=3D 10.220.64.12 =E2=80=93 GET signature=3Dk8LWw86= VI1dsYgKIkPKfAnItTNg%3D&apiKey=3DrxE2hLk5MHzoICoYNRyFf8L5PrmohVkUWNwtGE12Ll= Z7LF5mEsTeiSA6yAYYA3GPkX7ltSYhLOkd_h2i4GOYrg&command=3DqueryAsyncJobResult&= response=3Djson&jobid=3D5ea54c94-19ba-4dc3-956c-5df2ad886805 2014-07-11 16:04:19,556 INFO [o.a.c.a.c.u.s.CreateSnapshotCmd] (API-Job-Exe= cutor-15:ctx-a027e338 job-735 ctx-3e8bff7c) VOLSS: createSnapshotCmd starts= :1405094659556 2014-07-11 16:04:19,562 DEBUG [c.c.a.ApiServlet] (catalina-exec-9:ctx-75ac1= 3f2 ctx-6a8438cf ctx-9fe220cb) =3D=3D=3DEND=3D=3D=3D 10.220.64.12 =E2=80=93= GET signature=3Dk8LWw86VI1dsYgKIkPKfAnItTNg%3D&apiKey=3DrxE2hLk5MHzoICoYNR= yFf8L5PrmohVkUWNwtGE12LlZ7LF5mEsTeiSA6yAYYA3GPkX7ltSYhLOkd_h2i4GOYrg&comman= d=3DqueryAsyncJobResult&response=3Djson&jobid=3D5ea54c94-19ba-4dc3-956c-5df= 2ad886805 2014-07-11 16:04:19,583 DEBUG [c.c.s.s.SnapshotManagerImpl] (API-Job-Execut= or-15:ctx-a027e338 job-735 ctx-3e8bff7c) Failed to create snapshot java.lang.NullPointerException at com.cloud.storage.listener.SnapshotStateListener.pubishOnEventBus(Snapsh= otStateListener.java:71) at com.cloud.storage.listener.SnapshotStateListener.preStateTransitionEvent= (SnapshotStateListener.java:58) at com.cloud.storage.listener.SnapshotStateListener.preStateTransitionEvent= (SnapshotStateListener.java:44) at com.cloud.utils.fsm.StateMachine2.transitTo(StateMachine2.java:110) at org.apache.cloudstack.storage.snapshot.SnapshotStateMachineManagerImpl.p= rocessEvent(SnapshotStateMachineManagerImpl.java:60) at org.apache.cloudstack.storage.snapshot.SnapshotObject.processEvent(Snaps= hotObject.java:262) at org.apache.cloudstack.storage.snapshot.SnapshotServiceImpl.takeSnapshot(= SnapshotServiceImpl.java:174) at org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.takeSna= pshot(XenserverSnapshotStrategy.java:284) at com.cloud.storage.snapshot.SnapshotManagerImpl.takeSnapshot(SnapshotMana= gerImpl.java:966) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.jav= a:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessor= Impl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(= AopUtils.java:317) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinp= oint(ReflectiveMethodInvocation.java:183) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Ref= lectiveMethodInvocation.java:150) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(E= xposeInvocationInterceptor.java:91) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Ref= lectiveMethodInvocation.java:172) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAo= pProxy.java:204) at $Proxy179.takeSnapshot(Unknown Source) at org.apache.cloudstack.storage.volume.VolumeServiceImpl.takeSnapshot(Volu= meServiceImpl.java:1503) at com.cloud.storage.VolumeApiServiceImpl.takeSnapshot(VolumeApiServiceImpl= .java:1781) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.jav= a:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessor= Impl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(= AopUtils.java:317) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinp= oint(ReflectiveMethodInvocation.java:183) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Ref= lectiveMethodInvocation.java:150) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(E= xposeInvocationInterceptor.java:91) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Ref= lectiveMethodInvocation.java:172) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAo= pProxy.java:204) at $Proxy183.takeSnapshot(Unknown Source) at org.apache.cloudstack.api.command.user.snapshot.CreateSnapshotCmd.execut= e(CreateSnapshotCmd.java:187) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:141) at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:10= 8) at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInCon= text(AsyncJobManagerImpl.java:507) at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(Manag= edContextRunnable.java:49) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(= DefaultManagedContext.java:56) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWit= hContext(DefaultManagedContext.java:103) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWith= Context(DefaultManagedContext.java:53) at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(Managed= ContextRunnable.java:46) at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(Asyn= cJobManagerImpl.java:464) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.jav= a:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.ja= va:603) at java.lang.Thread.run(Thread.java:722) 2014-07-11 16:04:19,591 DEBUG [o.a.c.s.v.VolumeServiceImpl] (API-Job-Execut= or-15:ctx-a027e338 job-735 ctx-3e8bff7c) Take snapshot: 81 failed com.cloud.utils.exception.CloudRuntimeException: Failed to create snapshot at com.cloud.storage.snapshot.SnapshotManagerImpl.takeSnapshot(SnapshotMana= gerImpl.java:983) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.jav= a:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessor= Impl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(= AopUtils.java:317) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinp= oint(ReflectiveMethodInvocation.java:183) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Ref= lectiveMethodInvocation.java:150) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(E= xposeInvocationInterceptor.java:91) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Ref= lectiveMethodInvocation.java:172) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAo= pProxy.java:204) at $Proxy179.takeSnapshot(Unknown Source) at org.apache.cloudstack.storage.volume.VolumeServiceImpl.takeSnapshot(Volu= meServiceImpl.java:1503) at com.cloud.storage.VolumeApiServiceImpl.takeSnapshot(VolumeApiServiceImpl= .java:1781) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.jav= a:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessor= Impl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(= AopUtils.java:317) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinp= oint(ReflectiveMethodInvocation.java:183) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Ref= lectiveMethodInvocation.java:150) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(E= xposeInvocationInterceptor.java:91) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Ref= lectiveMethodInvocation.java:172) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAo= pProxy.java:204) at $Proxy183.takeSnapshot(Unknown Source) at org.apache.cloudstack.api.command.user.snapshot.CreateSnapshotCmd.execut= e(CreateSnapshotCmd.java:187) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:141) at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:10= 8) at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInCon= text(AsyncJobManagerImpl.java:507) at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(Manag= edContextRunnable.java:49) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(= DefaultManagedContext.java:56) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWit= hContext(DefaultManagedContext.java:103) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWith= Context(DefaultManagedContext.java:53) at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(Managed= ContextRunnable.java:46) at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(Asyn= cJobManagerImpl.java:464) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.jav= a:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.ja= va:603) at java.lang.Thread.run(Thread.java:722) Caused by: java.lang.NullPointerException at com.cloud.storage.listener.SnapshotStateListener.pubishOnEventBus(Snapsh= otStateListener.java:71) at com.cloud.storage.listener.SnapshotStateListener.preStateTransitionEvent= (SnapshotStateListener.java:58) at com.cloud.storage.listener.SnapshotStateListener.preStateTransitionEvent= (SnapshotStateListener.java:44) at com.cloud.utils.fsm.StateMachine2.transitTo(StateMachine2.java:110) at org.apache.cloudstack.storage.snapshot.SnapshotStateMachineManagerImpl.p= rocessEvent(SnapshotStateMachineManagerImpl.java:60) at org.apache.cloudstack.storage.snapshot.SnapshotObject.processEvent(Snaps= hotObject.java:262) at org.apache.cloudstack.storage.snapshot.SnapshotServiceImpl.takeSnapshot(= SnapshotServiceImpl.java:174) at org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.takeSna= pshot(XenserverSnapshotStrategy.java:284) at com.cloud.storage.snapshot.SnapshotManagerImpl.takeSnapshot(SnapshotMana= gerImpl.java:966) ... 40 more 2014-07-11 16:04:19,591 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Ex= ecutor-15:ctx-a027e338 job-735) Complete async job-735, jobStatus: FAILED, = resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionRespon= se/null/ {"uuidList":[],"errorcode":530,"errortext":"Failed to create snapshot due t= o an internal error creating snapshot for volume 81"} 2014-07-11 16:04:19,595 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Ex= ecutor-15:ctx-a027e338 job-735) Done executing org.apache.cloudstack.api.co= mmand.user.snapshot.CreateSnapshotCmd for job-735 2014-07-11 16:04:19,598 INFO [o.a.c.f.j.i.AsyncJobMonitor] (API-Job-Executo= r-15:ctx-a027e338 job-735) Remove job-735 from job monitoring 2014-07-11 16:04:21,232 DEBUG [c.c.s.StatsCollector] (StatsCollector-4:ctx-= 83f14b2b) AutoScaling Monitor is running... was: While trying to snapshot a volume, the volume snapshot is not backed up and= it remains in 'Allocated' state. As a result of the fix made to resolve [https://issues.apache.org/jira/brow= se/CLOUDSTACK-3272], ConfigDao is not being injected into SnapshotStateList= ener which results in an NPE. And this causes the snapshot process to fail = . > Volume snapshot is not getting backed up > ---------------------------------------- > > Key: CLOUDSTACK-7099 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-709= 9 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the defa= ult.)=20 > Components: Snapshot > Affects Versions: 4.5.0 > Reporter: Likitha Shetty > Assignee: Likitha Shetty > Priority: Critical > Fix For: 4.5.0 > > > While trying to snapshot a volume, the volume snapshot is not backed up a= nd it remains in 'Allocated' state. > As a result of the fix made to resolve [https://issues.apache.org/jira/br= owse/CLOUDSTACK-3272], ConfigDao is not being injected into SnapshotStateLi= stener which results in an NPE. And this causes the snapshot process to fai= l . > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > NullPointerException: > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > 2014-07-11 16:04:19,404 DEBUG [c.c.a.ApiServlet] (catalina-exec-6:ctx-2e1= 49d28) =3D=3D=3DSTART=3D=3D=3D 10.220.64.12 =E2=80=93 GET apiKey=3DrxE2hLk5= MHzoICoYNRyFf8L5PrmohVkUWNwtGE12LlZ7LF5mEsTeiSA6yAYYA3GPkX7ltSYhLOkd_h2i4GO= Yrg&volumeid=3Dcc65c8a0-d7e2-499b-9ceb-673e17b243d6&command=3DcreateSnapsho= t&signature=3Dzo0mi4A8VXGZ%2FmOfLDZT%2FShR%2BX8%3D&response=3Djson > 2014-07-11 16:04:19,533 INFO [o.a.c.f.j.i.AsyncJobMonitor] (API-Job-Execu= tor-15:ctx-a027e338 job-735) Add job-735 into job monitoring > 2014-07-11 16:04:19,533 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-= Executor-15:ctx-a027e338 job-735) Executing AsyncJobVO {id:735, userId: 90,= accountId: 87, instanceType: Snapshot, instanceId: 5, cmd: org.apache.clou= dstack.api.command.user.snapshot.CreateSnapshotCmd, cmdInfo: {"id":"5","res= ponse":"json","ctxDetails":" > {\"com.cloud.storage.Snapshot\":\"7918dca2-6515-4e59-be61-df7b91d8fc56\",= \"com.cloud.storage.Volume\":\"cc65c8a0-d7e2-499b-9ceb-673e17b243d6\"} > ","cmdEventType":"SNAPSHOT.CREATE","ctxUserId":"90","httpmethod":"GET","v= olumeid":"cc65c8a0-d7e2-499b-9ceb-673e17b243d6","uuid":"7918dca2-6515-4e59-= be61-df7b91d8fc56","ctxAccountId":"87","ctxStartEventId":"1737","apiKey":"r= xE2hLk5MHzoICoYNRyFf8L5PrmohVkUWNwtGE12LlZ7LF5mEsTeiSA6yAYYA3GPkX7ltSYhLOkd= _h2i4GOYrg","signature":"zo0mi4A8VXGZ/mOfLDZT/ShR+X8\u003d"}, cmdVersion: 0= , status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initM= sid: 161135757057464, completeMsid: null, lastUpdated: null, lastPolled: nu= ll, created: null} > 2014-07-11 16:04:19,541 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (catalina= -exec-6:ctx-2e149d28 ctx-25fc048a ctx-cd01f6fe) submit async job-735, detai= ls: AsyncJobVO {id:735, userId: 90, accountId: 87, instanceType: Snapshot, = instanceId: 5, cmd: org.apache.cloudstack.api.command.user.snapshot.CreateS= napshotCmd, cmdInfo: {"id":"5","response":"json","ctxDetails":" > {\"com.cloud.storage.Snapshot\":\"7918dca2-6515-4e59-be61-df7b91d8fc56\",= \"com.cloud.storage.Volume\":\"cc65c8a0-d7e2-499b-9ceb-673e17b243d6\"} > ","cmdEventType":"SNAPSHOT.CREATE","ctxUserId":"90","httpmethod":"GET","v= olumeid":"cc65c8a0-d7e2-499b-9ceb-673e17b243d6","uuid":"7918dca2-6515-4e59-= be61-df7b91d8fc56","ctxAccountId":"87","ctxStartEventId":"1737","apiKey":"r= xE2hLk5MHzoICoYNRyFf8L5PrmohVkUWNwtGE12LlZ7LF5mEsTeiSA6yAYYA3GPkX7ltSYhLOkd= _h2i4GOYrg","signature":"zo0mi4A8VXGZ/mOfLDZT/ShR+X8\u003d"}, cmdVersion: 0= , status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initM= sid: 161135757057464, completeMsid: null, lastUpdated: null, lastPolled: nu= ll, created: null} > 2014-07-11 16:04:19,542 DEBUG [c.c.a.ApiServlet] (catalina-exec-6:ctx-2e1= 49d28 ctx-25fc048a ctx-cd01f6fe) =3D=3D=3DEND=3D=3D=3D 10.220.64.12 =E2=80= =93 GET apiKey=3DrxE2hLk5MHzoICoYNRyFf8L5PrmohVkUWNwtGE12LlZ7LF5mEsTeiSA6yA= YYA3GPkX7ltSYhLOkd_h2i4GOYrg&volumeid=3Dcc65c8a0-d7e2-499b-9ceb-673e17b243d= 6&command=3DcreateSnapshot&signature=3Dzo0mi4A8VXGZ%2FmOfLDZT%2FShR%2BX8%3D= &response=3Djson > 2014-07-11 16:04:19,546 DEBUG [c.c.a.ApiServlet] (catalina-exec-9:ctx-75a= c13f2) =3D=3D=3DSTART=3D=3D=3D 10.220.64.12 =E2=80=93 GET signature=3Dk8LWw= 86VI1dsYgKIkPKfAnItTNg%3D&apiKey=3DrxE2hLk5MHzoICoYNRyFf8L5PrmohVkUWNwtGE12= LlZ7LF5mEsTeiSA6yAYYA3GPkX7ltSYhLOkd_h2i4GOYrg&command=3DqueryAsyncJobResul= t&response=3Djson&jobid=3D5ea54c94-19ba-4dc3-956c-5df2ad886805 > 2014-07-11 16:04:19,556 INFO [o.a.c.a.c.u.s.CreateSnapshotCmd] (API-Job-E= xecutor-15:ctx-a027e338 job-735 ctx-3e8bff7c) VOLSS: createSnapshotCmd star= ts:1405094659556 > 2014-07-11 16:04:19,562 DEBUG [c.c.a.ApiServlet] (catalina-exec-9:ctx-75a= c13f2 ctx-6a8438cf ctx-9fe220cb) =3D=3D=3DEND=3D=3D=3D 10.220.64.12 =E2=80= =93 GET signature=3Dk8LWw86VI1dsYgKIkPKfAnItTNg%3D&apiKey=3DrxE2hLk5MHzoICo= YNRyFf8L5PrmohVkUWNwtGE12LlZ7LF5mEsTeiSA6yAYYA3GPkX7ltSYhLOkd_h2i4GOYrg&com= mand=3DqueryAsyncJobResult&response=3Djson&jobid=3D5ea54c94-19ba-4dc3-956c-= 5df2ad886805 > 2014-07-11 16:04:19,583 DEBUG [c.c.s.s.SnapshotManagerImpl] (API-Job-Exec= utor-15:ctx-a027e338 job-735 ctx-3e8bff7c) Failed to create snapshot > java.lang.NullPointerException > at com.cloud.storage.listener.SnapshotStateListener.pubishOnEventBus(Snap= shotStateListener.java:71) > at com.cloud.storage.listener.SnapshotStateListener.preStateTransitionEve= nt(SnapshotStateListener.java:58) > at com.cloud.storage.listener.SnapshotStateListener.preStateTransitionEve= nt(SnapshotStateListener.java:44) > at com.cloud.utils.fsm.StateMachine2.transitTo(StateMachine2.java:110) > at org.apache.cloudstack.storage.snapshot.SnapshotStateMachineManagerImpl= .processEvent(SnapshotStateMachineManagerImpl.java:60) > at org.apache.cloudstack.storage.snapshot.SnapshotObject.processEvent(Sna= pshotObject.java:262) > at org.apache.cloudstack.storage.snapshot.SnapshotServiceImpl.takeSnapsho= t(SnapshotServiceImpl.java:174) > at org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.takeS= napshot(XenserverSnapshotStrategy.java:284) > at com.cloud.storage.snapshot.SnapshotManagerImpl.takeSnapshot(SnapshotMa= nagerImpl.java:966) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j= ava:57) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccess= orImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:601) > at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflectio= n(AopUtils.java:317) > at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoi= npoint(ReflectiveMethodInvocation.java:183) > at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(R= eflectiveMethodInvocation.java:150) > at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke= (ExposeInvocationInterceptor.java:91) > at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(R= eflectiveMethodInvocation.java:172) > at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamic= AopProxy.java:204) > at $Proxy179.takeSnapshot(Unknown Source) > at org.apache.cloudstack.storage.volume.VolumeServiceImpl.takeSnapshot(Vo= lumeServiceImpl.java:1503) > at com.cloud.storage.VolumeApiServiceImpl.takeSnapshot(VolumeApiServiceIm= pl.java:1781) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j= ava:57) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccess= orImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:601) > at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflectio= n(AopUtils.java:317) > at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoi= npoint(ReflectiveMethodInvocation.java:183) > at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(R= eflectiveMethodInvocation.java:150) > at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke= (ExposeInvocationInterceptor.java:91) > at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(R= eflectiveMethodInvocation.java:172) > at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamic= AopProxy.java:204) > at $Proxy183.takeSnapshot(Unknown Source) > at org.apache.cloudstack.api.command.user.snapshot.CreateSnapshotCmd.exec= ute(CreateSnapshotCmd.java:187) > at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:141) > at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:= 108) > at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInC= ontext(AsyncJobManagerImpl.java:507) > at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(Man= agedContextRunnable.java:49) > at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.cal= l(DefaultManagedContext.java:56) > at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callW= ithContext(DefaultManagedContext.java:103) > at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWi= thContext(DefaultManagedContext.java:53) > at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(Manag= edContextRunnable.java:46) > at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(As= yncJobManagerImpl.java:464) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471= ) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.j= ava:1110) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.= java:603) > at java.lang.Thread.run(Thread.java:722) > 2014-07-11 16:04:19,591 DEBUG [o.a.c.s.v.VolumeServiceImpl] (API-Job-Exec= utor-15:ctx-a027e338 job-735 ctx-3e8bff7c) Take snapshot: 81 failed > com.cloud.utils.exception.CloudRuntimeException: Failed to create snapsho= t > at com.cloud.storage.snapshot.SnapshotManagerImpl.takeSnapshot(SnapshotMa= nagerImpl.java:983) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j= ava:57) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccess= orImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:601) > at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflectio= n(AopUtils.java:317) > at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoi= npoint(ReflectiveMethodInvocation.java:183) > at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(R= eflectiveMethodInvocation.java:150) > at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke= (ExposeInvocationInterceptor.java:91) > at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(R= eflectiveMethodInvocation.java:172) > at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamic= AopProxy.java:204) > at $Proxy179.takeSnapshot(Unknown Source) > at org.apache.cloudstack.storage.volume.VolumeServiceImpl.takeSnapshot(Vo= lumeServiceImpl.java:1503) > at com.cloud.storage.VolumeApiServiceImpl.takeSnapshot(VolumeApiServiceIm= pl.java:1781) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j= ava:57) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccess= orImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:601) > at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflectio= n(AopUtils.java:317) > at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoi= npoint(ReflectiveMethodInvocation.java:183) > at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(R= eflectiveMethodInvocation.java:150) > at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke= (ExposeInvocationInterceptor.java:91) > at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(R= eflectiveMethodInvocation.java:172) > at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamic= AopProxy.java:204) > at $Proxy183.takeSnapshot(Unknown Source) > at org.apache.cloudstack.api.command.user.snapshot.CreateSnapshotCmd.exec= ute(CreateSnapshotCmd.java:187) > at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:141) > at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:= 108) > at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInC= ontext(AsyncJobManagerImpl.java:507) > at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(Man= agedContextRunnable.java:49) > at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.cal= l(DefaultManagedContext.java:56) > at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callW= ithContext(DefaultManagedContext.java:103) > at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWi= thContext(DefaultManagedContext.java:53) > at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(Manag= edContextRunnable.java:46) > at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(As= yncJobManagerImpl.java:464) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471= ) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.j= ava:1110) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.= java:603) > at java.lang.Thread.run(Thread.java:722) > Caused by: java.lang.NullPointerException > at com.cloud.storage.listener.SnapshotStateListener.pubishOnEventBus(Snap= shotStateListener.java:71) > at com.cloud.storage.listener.SnapshotStateListener.preStateTransitionEve= nt(SnapshotStateListener.java:58) > at com.cloud.storage.listener.SnapshotStateListener.preStateTransitionEve= nt(SnapshotStateListener.java:44) > at com.cloud.utils.fsm.StateMachine2.transitTo(StateMachine2.java:110) > at org.apache.cloudstack.storage.snapshot.SnapshotStateMachineManagerImpl= .processEvent(SnapshotStateMachineManagerImpl.java:60) > at org.apache.cloudstack.storage.snapshot.SnapshotObject.processEvent(Sna= pshotObject.java:262) > at org.apache.cloudstack.storage.snapshot.SnapshotServiceImpl.takeSnapsho= t(SnapshotServiceImpl.java:174) > at org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.takeS= napshot(XenserverSnapshotStrategy.java:284) > at com.cloud.storage.snapshot.SnapshotManagerImpl.takeSnapshot(SnapshotMa= nagerImpl.java:966) > ... 40 more > 2014-07-11 16:04:19,591 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-= Executor-15:ctx-a027e338 job-735) Complete async job-735, jobStatus: FAILED= , resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResp= onse/null/ > {"uuidList":[],"errorcode":530,"errortext":"Failed to create snapshot due= to an internal error creating snapshot for volume 81"} > 2014-07-11 16:04:19,595 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-= Executor-15:ctx-a027e338 job-735) Done executing org.apache.cloudstack.api.= command.user.snapshot.CreateSnapshotCmd for job-735 > 2014-07-11 16:04:19,598 INFO [o.a.c.f.j.i.AsyncJobMonitor] (API-Job-Execu= tor-15:ctx-a027e338 job-735) Remove job-735 from job monitoring > 2014-07-11 16:04:21,232 DEBUG [c.c.s.StatsCollector] (StatsCollector-4:ct= x-83f14b2b) AutoScaling Monitor is running... -- This message was sent by Atlassian JIRA (v6.2#6252)