cloudstack-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Abhinav Roy (JIRA)" <j...@apache.org>
Subject [jira] [Created] (CLOUDSTACK-5788) [Hyper-V] Attaching an uploaded volume to a VM is failing because copyCommand fails
Date Mon, 06 Jan 2014 08:21:50 GMT
Abhinav Roy created CLOUDSTACK-5788:
---------------------------------------

             Summary: [Hyper-V] Attaching an uploaded volume to a VM is failing because copyCommand fails
                 Key: CLOUDSTACK-5788
                 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-5788
             Project: CloudStack
          Issue Type: Bug
      Security Level: Public (Anyone can view this level - this is the default.)
          Components: Hypervisor Controller, Management Server
    Affects Versions: 4.3.0
         Environment: hyperv,4.3
            Reporter: Abhinav Roy
            Priority: Critical
             Fix For: 4.3.0


Steps : 
===================== 
1. Deploy an advanced zone setup with hyperv. 
2. Create a VM. 
3. upload a volume. 
4. Attach the volume uploaded in step 3 to the VM created in step 2. 


Expected behaviour: 
===================== 
Attach volume should succeed. 

Observed behaviour: 
===================== 
Attach volume fails with : 

MS logs : 
---------------------- 

2014-01-06 11:53:37,402 DEBUG [c.c.h.h.r.HypervDirectConnectResource] (DirectAgent-380:ctx-674d76cf) POST response is[{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"org.apache.cloudstack.storage.command.CopyCommand failed on exception, Error getting value from 'FullFileName' on 'HypervResource.VolumeObjectTO'.","newData":null,"contextMap":{}}}]
2014-01-06 11:53:37,403 DEBUG [c.c.h.h.r.HypervDirectConnectResource] (DirectAgent-380:ctx-674d76cf) executeRequest received response [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"org.apache.cloudstack.storage.command.CopyCommand failed on exception, Error getting value from \u0027FullFileName\u0027 on \u0027HypervResource.VolumeObjectTO\u0027.","contextMap":{},"wait":0}}]
2014-01-06 11:53:37,403 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-380:ctx-674d76cf) Seq 1-849871246: Response Received:
2014-01-06 11:53:37,403 DEBUG [c.c.a.t.Request] (DirectAgent-380:ctx-674d76cf) Seq 1-849871246: Processing:  { Ans: , MgmtId: 280320865129348, via: 1, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"org.apache.cloudstack.storage.command.CopyCommand failed on exception, Error getting value from 'FullFileName' on 'HypervResource.VolumeObjectTO'.","wait":0}}] }
2014-01-06 11:53:37,403 DEBUG [c.c.a.t.Request] (Job-Executor-115:ctx-46b175df ctx-9f2ec3a6) Seq 1-849871246: Received:  { Ans: , MgmtId: 280320865129348, via: 1, Ver: v1, Flags: 10, { CopyCmdAnswer } }
2014-01-06 11:53:37,421 DEBUG [o.a.c.e.o.VolumeOrchestrator] (Job-Executor-115:ctx-46b175df ctx-9f2ec3a6) copy volume failed: java.lang.NullPointerException
2014-01-06 11:53:37,421 ERROR [c.c.v.VmWorkJobHandlerProxy] (Job-Executor-115:ctx-46b175df ctx-9f2ec3a6) Invocation exception, caused by: com.cloud.utils.exception.CloudRuntimeException: copy volume failed: java.lang.NullPointerException
2014-01-06 11:53:37,421 ERROR [c.c.v.VmWorkJobDispatcher] (Job-Executor-115:ctx-46b175df ctx-9f2ec3a6) Unable to complete AsyncJobVO {id:142, userId: 2, accountId: 2, instanceType: null, instanceId: null, cmd: com.cloud.storage.VmWorkAttachVolume, cmdInfo: rO0ABXNyACRjb20uY2xvdWQuc3RvcmFnZS5WbVdvcmtBdHRhY2hWb2x1bWUHra_5YYfiHAIAAkwACGRldmljZUlkdAAQTGphdmEvbGFuZy9Mb25nO0wACHZvbHVtZUlkcQB-AAF4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1ldAASTGphdmEvbGFuZy9TdHJpbmc7eHAAAAAAAAAAAgAAAAAAAAACAAAAAAAAAAp0ABRWb2x1bWVBcGlTZXJ2aWNlSW1wbHBzcgAOamF2YS5sYW5nLkxvbmc7i-SQzI8j3wIAAUoABXZhbHVleHIAEGphdmEubGFuZy5OdW1iZXKGrJUdC5TgiwIAAHhwAAAAAAAAABM, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 280320865129348, completeMsid: null, lastUpdated: null, lastPolled: null, created: Mon Jan 06 11:53:27 IST 2014}
com.cloud.utils.exception.CloudRuntimeException: copy volume failed: java.lang.NullPointerException
        at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.copyVolumeFromSecToPrimary(VolumeOrchestrator.java:412)
        at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.copyVolume(VolumeOrchestrator.java:718)
        at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.createVolumeOnPrimaryStorage(VolumeOrchestrator.java:747)
        at com.cloud.storage.VolumeApiServiceImpl.attachVolumeToVM(VolumeApiServiceImpl.java:1249)
        at com.cloud.storage.VolumeApiServiceImpl.orchestrateAttachVolumeToVM(VolumeApiServiceImpl.java:1127)
        at com.cloud.storage.VolumeApiServiceImpl.orchestrateAttachVolumeToVM(VolumeApiServiceImpl.java:2406)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:616)
        at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
        at com.cloud.storage.VolumeApiServiceImpl.handleVmWorkJob(VolumeApiServiceImpl.java:2437)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:616)
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
        at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
        at $Proxy195.handleVmWorkJob(Unknown Source)
        at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:99)
        at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:524)
        at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
        at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
        at java.lang.Thread.run(Thread.java:679)
2014-01-06 11:53:37,430 INFO  [c.c.v.VmWorkJobDispatcher] (Job-Executor-115:ctx-46b175df ctx-9f2ec3a6) Serialize exception object into json: com.cloud.utils.exception.CloudRuntimeException/{"idList":[],"uuidList":[],"csErrorCode":4250,"detailMessage":"copy volume failed: java.lang.NullPointerException","cause":{"class":"com.cloud.utils.exception.CloudRuntimeException","msg":"copy volume failed: java.lang.NullPointerException"},"stackTrace":[{"declaringClass":"org.apache.cloudstack.engine.orchestration.VolumeOrchestrator","methodName":"copyVolumeFromSecToPrimary","fileName":"VolumeOrchestrator.java","lineNumber":412},{"declaringClass":"org.apache.cloudstack.engine.orchestration.VolumeOrchestrator","methodName":"copyVolume","fileName":"VolumeOrchestrator.java","lineNumber":718},{"declaringClass":"org.apache.cloudstack.engine.orchestration.VolumeOrchestrator","methodName":"createVolumeOnPrimaryStorage","fileName":"VolumeOrchestrator.java","lineNumber":747},{"declaringClass":"com.cloud.storage.VolumeApiServiceImpl","methodName":"attachVolumeToVM","fileName":"VolumeApiServiceImpl.java","lineNumber":1249},{"declaringClass":"com.cloud.storage.VolumeApiServiceImpl","methodName":"orchestrateAttachVolumeToVM","fileName":"VolumeApiServiceImpl.java","lineNumber":1127},{"declaringClass":"com.cloud.storage.VolumeApiServiceImpl","methodName":"orchestrateAttachVolumeToVM","fileName":"VolumeApiServiceImpl.java","lineNumber":2406},{"declaringClass":"sun.reflect.NativeMethodAccessorImpl","methodName":"invoke0","fileName":"NativeMethodAccessorImpl.java","lineNumber":-2},{"declaringClass":"sun.reflect.NativeMethodAccessorImpl","methodName":"invoke","fileName":"NativeMethodAccessorImpl.java","lineNumber":57},{"declaringClass":"sun.reflect.DelegatingMethodAccessorImpl","methodName":"invoke","fileName":"DelegatingMethodAccessorImpl.java","lineNumber":43},{"declaringClass":"java.lang.reflect.Method","methodName":"invoke","fileName":"Method.java","lineNumber":616},{"declaringClass":"com.cloud.vm.VmWorkJobHandlerProxy","methodName":"handleVmWorkJob","fileName":"VmWorkJobHandlerProxy.java","lineNumber":107},{"declaringClass":"com.cloud.storage.VolumeApiServiceImpl","methodName":"handleVmWorkJob","fileName":"VolumeApiServiceImpl.java","lineNumber":2437},{"declaringClass":"sun.reflect.NativeMethodAccessorImpl","methodName":"invoke0","fileName":"NativeMethodAccessorImpl.java","lineNumber":-2},{"declaringClass":"sun.reflect.NativeMethodAccessorImpl","methodName":"invoke","fileName":"NativeMethodAccessorImpl.java","lineNumber":57},{"declaringClass":"sun.reflect.DelegatingMethodAccessorImpl","methodName":"invoke","fileName":"DelegatingMethodAccessorImpl.java","lineNumber":43},{"declaringClass":"java.lang.reflect.Method","methodName":"invoke","fileName":"Method.java","lineNumber":616},{"declaringClass":"org.springframework.aop.support.AopUtils","methodName":"invokeJoinpointUsingReflection","fileName":"AopUtils.java","lineNumber":317},{"declaringClass":"org.springframework.aop.framework.ReflectiveMethodInvocation","methodName":"invokeJoinpoint","fileName":"ReflectiveMethodInvocation.java","lineNumber":183},{"declaringClass":"org.springframework.aop.framework.ReflectiveMethodInvocation","methodName":"proceed","fileName":"ReflectiveMethodInvocation.java","lineNumber":150},{"declaringClass":"org.springframework.aop.interceptor.ExposeInvocationInterceptor","methodName":"invoke","fileName":"ExposeInvocationInterceptor.java","lineNumber":91},{"declaringClass":"org.springframework.aop.framework.ReflectiveMethodInvocation","methodName":"proceed","fileName":"ReflectiveMethodInvocation.java","lineNumber":172},{"declaringClass":"org.springframework.aop.framework.JdkDynamicAopProxy","methodName":"invoke","fileName":"JdkDynamicAopProxy.java","lineNumber":204},{"declaringClass":"$Proxy195","methodName":"handleVmWorkJob","lineNumber":-1},{"declaringClass":"com.cloud.vm.VmWorkJobDispatcher","methodName":"runJob","fileName":"VmWorkJobDispatcher.java","lineNumber":99},{"declaringClass":"org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5","methodName":"runInContext","fileName":"AsyncJobManagerImpl.java","lineNumber":524},{"declaringClass":"org.apache.cloudstack.managed.context.ManagedContextRunnable$1","methodName":"run","fileName":"ManagedContextRunnable.java","lineNumber":49},{"declaringClass":"org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1","methodName":"call","fileName":"DefaultManagedContext.java","lineNumber":56},{"declaringClass":"org.apache.cloudstack.managed.context.impl.DefaultManagedContext","methodName":"callWithContext","fileName":"DefaultManagedContext.java","lineNumber":103},{"declaringClass":"org.apache.cloudstack.managed.context.impl.DefaultManagedContext","methodName":"runWithContext","fileName":"DefaultManagedContext.java","lineNumber":53},{"declaringClass":"org.apache.cloudstack.managed.context.ManagedContextRunnable","methodName":"run","fileName":"ManagedContextRunnable.java","lineNumber":46},{"declaringClass":"java.util.concurrent.Executors$RunnableAdapter","methodName":"call","fileName":"Executors.java","lineNumber":471},{"declaringClass":"java.util.concurrent.FutureTask$Sync","methodName":"innerRun","fileName":"FutureTask.java","lineNumber":334},{"declaringClass":"java.util.concurrent.FutureTask","methodName":"run","fileName":"FutureTask.java","lineNumber":166},{"declaringClass":"java.util.concurrent.ThreadPoolExecutor","methodName":"runWorker","fileName":"ThreadPoolExecutor.java","lineNumber":1110},{"declaringClass":"java.util.concurrent.ThreadPoolExecutor$Worker","methodName":"run","fileName":"ThreadPoolExecutor.java","lineNumber":603},{"declaringClass":"java.lang.Thread","methodName":"run","fileName":"Thread.java","lineNumber":679}]}
2014-01-06 11:53:37,430 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Job-Executor-115:ctx-46b175df ctx-9f2ec3a6) Complete async job-142, jobStatus: FAILED, resultCode: 0, result: com.cloud.utils.exception.CloudRuntimeException/{"idList":[],"uuidList":[],"csErrorCode":4250,"detailMessage":"copy volume failed: java.lang.NullPointerException","cause":{"class":"com.cloud.utils.exception.CloudRuntimeException","msg":"copy volume failed: java.lang.NullPointerException"},"stackTrace":[{"declaringClass":"org.apache.cloudstack.engine.orchestration.VolumeOrchestrator","methodName":"copyVolumeFromSecToPrimary","fileName":"VolumeOrchestrator.java","lineNumber":412},{"declaringClass":"org.apache.cloudstack.engine.orchestration.VolumeOrchestrator","methodName":"copyVolume","fileName":"VolumeOrchestrator.java","lineNumber":718},{"declaringClass":"org.apache.cloudstack.engine.orchestration.VolumeOrchestrator","methodName":"createVolumeOnPrimaryStorage","fileName":"VolumeOrchestrator.java","lineNumber":747},{"declaringClass":"com.cloud.storage.VolumeApiServiceImpl","methodName":"attachVolumeToVM","fileName":"VolumeApiServiceImpl.java","lineNumber":1249},{"declaringClass":"com.cloud.storage.VolumeApiServiceImpl","methodName":"orchestrateAttachVolumeToVM","fileName":"VolumeApiServiceImpl.java","lineNumber":1127},{"declaringClass":"com.cloud.storage.VolumeApiServiceImpl","methodName":"orchestrateAttachVolumeToVM","fileName":"VolumeApiServiceImpl.java","lineNumber":2406},{"declaringClass":"sun.reflect.NativeMethodAccessorImpl","methodName":"invoke0","fileName":"NativeMethodAccessorImpl.java","lineNumber":-2},{"declaringClass":"sun.reflect.NativeMethodAccessorImpl","methodName":"invoke","fileName":"NativeMethodAccessorImpl.java","lineNumber":57},{"declaringClass":"sun.reflect.DelegatingMethodAccessorImpl","methodName":"invoke","fileName":"DelegatingMethodAccessorImpl.java","lineNumber":43},{"declaringClass":"java.lang.reflect.Method","methodName":"invoke","fileName":"Method.java","lineNumber":616},{"declaringClass":"com.cloud.vm.VmWorkJobHandlerProxy","methodName":"handleVmWorkJob","fileName":"VmWorkJobHandlerProxy.java","lineNumber":107},{"declaringClass":"com.cloud.storage.VolumeApiServiceImpl","methodName":"handleVmWorkJob","fileName":"VolumeApiServiceImpl.java","lineNumber":2437},{"declaringClass":"sun.reflect.NativeMethodAccessorImpl","methodName":"invoke0","fileName":"NativeMethodAccessorImpl.java","lineNumber":-2},{"declaringClass":"sun.reflect.NativeMethodAccessorImpl","methodName":"invoke","fileName":"NativeMethodAccessorImpl.java","lineNumber":57},{"declaringClass":"sun.reflect.DelegatingMethodAccessorImpl","methodName":"invoke","fileName":"DelegatingMethodAccessorImpl.java","lineNumber":43},{"declaringClass":"java.lang.reflect.Method","methodName":"invoke","fileName":"Method.java","lineNumber":616},{"declaringClass":"org.springframework.aop.support.AopUtils","methodName":"invokeJoinpointUsingReflection","fileName":"AopUtils.java","lineNumber":317},{"declaringClass":"org.springframework.aop.framework.ReflectiveMethodInvocation","methodName":"invokeJoinpoint","fileName":"ReflectiveMethodInvocation.java","lineNumber":183},{"declaringClass":"org.springframework.aop.framework.ReflectiveMethodInvocation","methodName":"proceed","fileName":"ReflectiveMethodInvocation.java","lineNumber":150},{"declaringClass":"org.springframework.aop.interceptor.ExposeInvocationInterceptor","methodName":"invoke","fileName":"ExposeInvocationInterceptor.java","lineNumber":91},{"declaringClass":"org.springframework.aop.framework.ReflectiveMethodInvocation","methodName":"proceed","fileName":"ReflectiveMethodInvocation.java","lineNumber":172},{"declaringClass":"org.springframework.aop.framework.JdkDynamicAopProxy","methodName":"invoke","fileName":"JdkDynamicAopProxy.java","lineNumber":204},{"declaringClass":"$Proxy195","methodName":"handleVmWorkJob","lineNumber":-1},{"declaringClass":"com.cloud.vm.VmWorkJobDispatcher","methodName":"runJob","fileName":"VmWorkJobDispatcher.java","lineNumber":99},{"declaringClass":"org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5","methodName":"runInContext","fileName":"AsyncJobManagerImpl.java","lineNumber":524},{"declaringClass":"org.apache.cloudstack.managed.context.ManagedContextRunnable$1","methodName":"run","fileName":"ManagedContextRunnable.java","lineNumber":49},{"declaringClass":"org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1","methodName":"call","fileName":"DefaultManagedContext.java","lineNumber":56},{"declaringClass":"org.apache.cloudstack.managed.context.impl.DefaultManagedContext","methodName":"callWithContext","fileName":"DefaultManagedContext.java","lineNumber":103},{"declaringClass":"org.apache.cloudstack.managed.context.impl.DefaultManagedContext","methodName":"runWithContext","fileName":"DefaultManagedContext.java","lineNumber":53},{"declaringClass":"org.apache.cloudstack.managed.context.ManagedContextRunnable","methodName":"run","fileName":"ManagedContextRunnable.java","lineNumber":46},{"declaringClass":"java.util.concurrent.Executors$RunnableAdapter","methodName":"call","fileName":"Executors.java","lineNumber":471},{"declaringClass":"java.util.concurrent.FutureTask$Sync","methodName":"innerRun","fileName":"FutureTask.java","lineNumber":334},{"declaringClass":"java.util.concurrent.FutureTask","methodName":"run","fileName":"FutureTask.java","lineNumber":166},{"declaringClass":"java.util.concurrent.ThreadPoolExecutor","methodName":"runWorker","fileName":"ThreadPoolExecutor.java","lineNumber":1110},{"declaringClass":"java.util.concurrent.ThreadPoolExecutor$Worker","methodName":"run","fileName":"ThreadPoolExecutor.java","lineNumber":603},{"declaringClass":"java.lang.Thread","methodName":"run","fileName":"Thread.java","lineNumber":679}]}
2014-01-06 11:53:37,437 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Job-Executor-115:ctx-46b175df) Done executing com.cloud.storage.VmWorkAttachVolume for job-142
2014-01-06 11:53:37,441 INFO  [o.a.c.f.j.i.AsyncJobMonitor] (Job-Executor-116:ctx-9f6a5f51) Add job-141 into job monitoring
2014-01-06 11:53:37,441 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Job-Executor-116:ctx-9f6a5f51) Executing AsyncJobVO {id:141, userId: 2, accountId: 2, instanceType: Volume, instanceId: 19, cmd: org.apache.cloudstack.api.command.user.volume.AttachVolumeCmd, cmdInfo: {"response":"json","id":"4d5e35e3-2a67-4d1e-8758-7c6b283866cd","sessionkey":"5ODiLDmKehMbGznMVT9sutQQg7U\u003d","cmdEventType":"VOLUME.ATTACH","ctxUserId":"2","virtualMachineId":"62064ead-e49e-4bb7-86e7-7422f33e3f75","httpmethod":"GET","_":"1388989738235","ctxAccountId":"2","ctxStartEventId":"332"}, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 280320865129348, completeMsid: null, lastUpdated: null, lastPolled: Mon Jan 06 11:53:36 IST 2014, created: Mon Jan 06 11:53:27 IST 2014}
2014-01-06 11:53:37,447 DEBUG [o.a.c.f.j.i.SyncQueueManagerImpl] (Job-Executor-115:ctx-46b175df) Sync queue (21) is currently empty
2014-01-06 11:53:37,448 INFO  [o.a.c.f.j.i.AsyncJobMonitor] (Job-Executor-115:ctx-46b175df) Remove job-142 from job monitoring
2014-01-06 11:53:37,447 ERROR [c.c.a.ApiAsyncJobDispatcher] (Job-Executor-114:ctx-035abfcd) Unexpected exception while executing org.apache.cloudstack.api.command.user.volume.AttachVolumeCmd
com.cloud.utils.exception.CloudRuntimeException: Unable to serialize: com.cloud.utils.exception.CloudRuntimeException/{"idList":[],"uuidList":[],"csErrorCode":4250,"detailMessage":"copy volume failed: java.lang.NullPointerException","cause":{"class":"com.cloud.utils.exception.CloudRuntimeException","msg":"copy volume failed: java.lang.NullPointerException"},"stackTrace":[{"declaringClass":"org.apache.cloudstack.engine.orchestration.VolumeOrchestrator","methodName":"copyVolumeFromSecToPrimary","fileName":"VolumeOrchestrator.java","lineNumber":412},{"declaringClass":"org.apache.cloudstack.engine.orchestration.VolumeOrchestrator","methodName":"copyVolume","fileName":"VolumeOrchestrator.java","lineNumber":718},{"declaringClass":"org.apache.cloudstack.engine.orchestration.VolumeOrchestrator","methodName":"createVolumeOnPrimaryStorage","fileName":"VolumeOrchestrator.java","lineNumber":747},{"declaringClass":"com.cloud.storage.VolumeApiServiceImpl","methodName":"attachVolumeToVM","fileName":"VolumeApiServiceImpl.java","lineNumber":1249},{"declaringClass":"com.cloud.storage.VolumeApiServiceImpl","methodName":"orchestrateAttachVolumeToVM","fileName":"VolumeApiServiceImpl.java","lineNumber":1127},{"declaringClass":"com.cloud.storage.VolumeApiServiceImpl","methodName":"orchestrateAttachVolumeToVM","fileName":"VolumeApiServiceImpl.java","lineNumber":2406},{"declaringClass":"sun.reflect.NativeMethodAccessorImpl","methodName":"invoke0","fileName":"NativeMethodAccessorImpl.java","lineNumber":-2},{"declaringClass":"sun.reflect.NativeMethodAccessorImpl","methodName":"invoke","fileName":"NativeMethodAccessorImpl.java","lineNumber":57},{"declaringClass":"sun.reflect.DelegatingMethodAccessorImpl","methodName":"invoke","fileName":"DelegatingMethodAccessorImpl.java","lineNumber":43},{"declaringClass":"java.lang.reflect.Method","methodName":"invoke","fileName":"Method.java","lineNumber":616},{"declaringClass":"com.cloud.vm.VmWorkJobHandlerProxy","methodName":"handleVmWorkJob","fileName":"VmWorkJobHandlerProxy.java","lineNumber":107},{"declaringClass":"com.cloud.storage.VolumeApiServiceImpl","methodName":"handleVmWorkJob","fileName":"VolumeApiServiceImpl.java","lineNumber":2437},{"declaringClass":"sun.reflect.NativeMethodAccessorImpl","methodName":"invoke0","fileName":"NativeMethodAccessorImpl.java","lineNumber":-2},{"declaringClass":"sun.reflect.NativeMethodAccessorImpl","methodName":"invoke","fileName":"NativeMethodAccessorImpl.java","lineNumber":57},{"declaringClass":"sun.reflect.DelegatingMethodAccessorImpl","methodName":"invoke","fileName":"DelegatingMethodAccessorImpl.java","lineNumber":43},{"declaringClass":"java.lang.reflect.Method","methodName":"invoke","fileName":"Method.java","lineNumber":616},{"declaringClass":"org.springframework.aop.support.AopUtils","methodName":"invokeJoinpointUsingReflection","fileName":"AopUtils.java","lineNumber":317},{"declaringClass":"org.springframework.aop.framework.ReflectiveMethodInvocation","methodName":"invokeJoinpoint","fileName":"ReflectiveMethodInvocation.java","lineNumber":183},{"declaringClass":"org.springframework.aop.framework.ReflectiveMethodInvocation","methodName":"proceed","fileName":"ReflectiveMethodInvocation.java","lineNumber":150},{"declaringClass":"org.springframework.aop.interceptor.ExposeInvocationInterceptor","methodName":"invoke","fileName":"ExposeInvocationInterceptor.java","lineNumber":91},{"declaringClass":"org.springframework.aop.framework.ReflectiveMethodInvocation","methodName":"proceed","fileName":"ReflectiveMethodInvocation.java","lineNumber":172},{"declaringClass":"org.springframework.aop.framework.JdkDynamicAopProxy","methodName":"invoke","fileName":"JdkDynamicAopProxy.java","lineNumber":204},{"declaringClass":"$Proxy195","methodName":"handleVmWorkJob","lineNumber":-1},{"declaringClass":"com.cloud.vm.VmWorkJobDispatcher","methodName":"runJob","fileName":"VmWorkJobDispatcher.java","lineNumber":99},{"declaringClass":"org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5","methodName":"runInContext","fileName":"AsyncJobManagerImpl.java","lineNumber":524},{"declaringClass":"org.apache.cloudstack.managed.context.ManagedContextRunnable$1","methodName":"run","fileName":"ManagedContextRunnable.java","lineNumber":49},{"declaringClass":"org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1","methodName":"call","fileName":"DefaultManagedContext.java","lineNumber":56},{"declaringClass":"org.apache.cloudstack.managed.context.impl.DefaultManagedContext","methodName":"callWithContext","fileName":"DefaultManagedContext.java","lineNumber":103},{"declaringClass":"org.apache.cloudstack.managed.context.impl.DefaultManagedContext","methodName":"runWithContext","fileName":"DefaultManagedContext.java","lineNumber":53},{"declaringClass":"org.apache.cloudstack.managed.context.ManagedContextRunnable","methodName":"run","fileName":"ManagedContextRunnable.java","lineNumber":46},{"declaringClass":"java.util.concurrent.Executors$RunnableAdapter","methodName":"call","fileName":"Executors.java","lineNumber":471},{"declaringClass":"java.util.concurrent.FutureTask$Sync","methodName":"innerRun","fileName":"FutureTask.java","lineNumber":334},{"declaringClass":"java.util.concurrent.FutureTask","methodName":"run","fileName":"FutureTask.java","lineNumber":166},{"declaringClass":"java.util.concurrent.ThreadPoolExecutor","methodName":"runWorker","fileName":"ThreadPoolExecutor.java","lineNumber":1110},{"declaringClass":"java.util.concurrent.ThreadPoolExecutor$Worker","methodName":"run","fileName":"ThreadPoolExecutor.java","lineNumber":603},{"declaringClass":"java.lang.Thread","methodName":"run","fileName":"Thread.java","lineNumber":679}]}
        at org.apache.cloudstack.framework.jobs.impl.JobSerializerHelper.fromObjectSerializedString(JobSerializerHelper.java:135)
        at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl.unmarshallResultObject(AsyncJobManagerImpl.java:669)
        at com.cloud.storage.VolumeApiServiceImpl.attachVolumeToVM(VolumeApiServiceImpl.java:1115)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:616)
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
        at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
        at $Proxy195.attachVolumeToVM(Unknown Source)
        at org.apache.cloudstack.api.command.user.volume.AttachVolumeCmd.execute(AttachVolumeCmd.java:123)
        at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161)
        at com.cloud.api.ApiAsyncJobDispatcher.runJobInContext(ApiAsyncJobDispatcher.java:109)
        at com.cloud.api.ApiAsyncJobDispatcher$1.run(ApiAsyncJobDispatcher.java:66)
        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
        at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:63)
        at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:524)
        at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
        at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
        at java.lang.Thread.run(Thread.java:679)
Caused by: java.io.StreamCorruptedException: invalid stream header: 72899C96
        at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:800)
        at java.io.ObjectInputStream.<init>(ObjectInputStream.java:297)
        at org.apache.cloudstack.framework.jobs.impl.JobSerializerHelper.fromObjectSerializedString(JobSerializerHelper.java:129)
        ... 33 more
2014-01-06 11:53:37,457 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Job-Executor-114:ctx-035abfcd) Complete async job-141, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable to serialize: com.cloud.utils.exception.CloudRuntimeException/{\"idList\":[],\"uuidList\":[],\"csErrorCode\":4250,\"detailMessage\":\"copy volume failed: java.lang.NullPointerException\",\"cause\":{\"class\":\"com.cloud.utils.exception.CloudRuntimeException\",\"msg\":\"copy volume failed: java.lang.NullPointerException\"},\"stackTrace\":[{\"declaringClass\":\"org.apache.cloudstack.engine.orchestration.VolumeOrchestrator\",\"methodName\":\"copyVolumeFromSecToPrimary\",\"fileName\":\"VolumeOrchestrator.java\",\"lineNumber\":412},{\"declaringClass\":\"org.apache.cloudstack.engine.orchestration.VolumeOrchestrator\",\"methodName\":\"copyVolume\",\"fileName\":\"VolumeOrchestrator.java\",\"lineNumber\":718},{\"declaringClass\":\"org.apache.cloudstack.engine.orchestration.VolumeOrchestrator\",\"methodName\":\"createVolumeOnPrimaryStorage\",\"fileName\":\"VolumeOrchestrator.java\",\"lineNumber\":747},{\"declaringClass\":\"com.cloud.storage.VolumeApiServiceImpl\",\"methodName\":\"attachVolumeToVM\",\"fileName\":\"VolumeApiServiceImpl.java\",\"lineNumber\":1249},{\"declaringClass\":\"com.cloud.storage.VolumeApiServiceImpl\",\"methodName\":\"orchestrateAttachVolumeToVM\",\"fileName\":\"VolumeApiServiceImpl.java\",\"lineNumber\":1127},{\"declaringClass\":\"com.cloud.storage.VolumeApiServiceImpl\",\"methodName\":\"orchestrateAttachVolumeToVM\",\"fileName\":\"VolumeApiServiceImpl.java\",\"lineNumber\":2406},{\"declaringClass\":\"sun.reflect.NativeMethodAccessorImpl\",\"methodName\":\"invoke0\",\"fileName\":\"NativeMethodAccessorImpl.java\",\"lineNumber\":-2},{\"declaringClass\":\"sun.reflect.NativeMethodAccessorImpl\",\"methodName\":\"invoke\",\"fileName\":\"NativeMethodAccessorImpl.java\",\"lineNumber\":57},{\"declaringClass\":\"sun.reflect.DelegatingMethodAccessorImpl\",\"methodName\":\"invoke\",\"fileName\":\"DelegatingMethodAccessorImpl.java\",\"lineNumber\":43},{\"declaringClass\":\"java.lang.reflect.Method\",\"methodName\":\"invoke\",\"fileName\":\"Method.java\",\"lineNumber\":616},{\"declaringClass\":\"com.cloud.vm.VmWorkJobHandlerProxy\",\"methodName\":\"handleVmWorkJob\",\"fileName\":\"VmWorkJobHandlerProxy.java\",\"lineNumber\":107},{\"declaringClass\":\"com.cloud.storage.VolumeApiServiceImpl\",\"methodName\":\"handleVmWorkJob\",\"fileName\":\"VolumeApiServiceImpl.java\",\"lineNumber\":2437},{\"declaringClass\":\"sun.reflect.NativeMethodAccessorImpl\",\"methodName\":\"invoke0\",\"fileName\":\"NativeMethodAccessorImpl.java\",\"lineNumber\":-2},{\"declaringClass\":\"sun.reflect.NativeMethodAccessorImpl\",\"methodName\":\"invoke\",\"fileName\":\"NativeMethodAccessorImpl.java\",\"lineNumber\":57},{\"declaringClass\":\"sun.reflect.DelegatingMethodAccessorImpl\",\"methodName\":\"invoke\",\"fileName\":\"DelegatingMethodAccessorImpl.java\",\"lineNumber\":43},{\"declaringClass\":\"java.lang.reflect.Method\",\"methodName\":\"invoke\",\"fileName\":\"Method.java\",\"lineNumber\":616},{\"declaringClass\":\"org.springframework.aop.support.AopUtils\",\"methodName\":\"invokeJoinpointUsingReflection\",\"fileName\":\"AopUtils.java\",\"lineNumber\":317},{\"declaringClass\":\"org.springframework.aop.framework.ReflectiveMethodInvocation\",\"methodName\":\"invokeJoinpoint\",\"fileName\":\"ReflectiveMethodInvocation.java\",\"lineNumber\":183},{\"declaringClass\":\"org.springframework.aop.framework.ReflectiveMethodInvocation\",\"methodName\":\"proceed\",\"fileName\":\"ReflectiveMethodInvocation.java\",\"lineNumber\":150},{\"declaringClass\":\"org.springframework.aop.interceptor.ExposeInvocationInterceptor\",\"methodName\":\"invoke\",\"fileName\":\"ExposeInvocationInterceptor.java\",\"lineNumber\":91},{\"declaringClass\":\"org.springframework.aop.framework.ReflectiveMethodInvocation\",\"methodName\":\"proceed\",\"fileName\":\"ReflectiveMethodInvocation.java\",\"lineNumber\":172},{\"declaringClass\":\"org.springframework.aop.framework.JdkDynamicAopProxy\",\"methodName\":\"invoke\",\"fileName\":\"JdkDynamicAopProxy.java\",\"lineNumber\":204},{\"declaringClass\":\"$Proxy195\",\"methodName\":\"handleVmWorkJob\",\"lineNumber\":-1},{\"declaringClass\":\"com.cloud.vm.VmWorkJobDispatcher\",\"methodName\":\"runJob\",\"fileName\":\"VmWorkJobDispatcher.java\",\"lineNumber\":99},{\"declaringClass\":\"org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5\",\"methodName\":\"runInContext\",\"fileName\":\"AsyncJobManagerImpl.java\",\"lineNumber\":524},{\"declaringClass\":\"org.apache.cloudstack.managed.context.ManagedContextRunnable$1\",\"methodName\":\"run\",\"fileName\":\"ManagedContextRunnable.java\",\"lineNumber\":49},{\"declaringClass\":\"org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1\",\"methodName\":\"call\",\"fileName\":\"DefaultManagedContext.java\",\"lineNumber\":56},{\"declaringClass\":\"org.apache.cloudstack.managed.context.impl.DefaultManagedContext\",\"methodName\":\"callWithContext\",\"fileName\":\"DefaultManagedContext.java\",\"lineNumber\":103},{\"declaringClass\":\"org.apache.cloudstack.managed.context.impl.DefaultManagedContext\",\"methodName\":\"runWithContext\",\"fileName\":\"DefaultManagedContext.java\",\"lineNumber\":53},{\"declaringClass\":\"org.apache.cloudstack.managed.context.ManagedContextRunnable\",\"methodName\":\"run\",\"fileName\":\"ManagedContextRunnable.java\",\"lineNumber\":46},{\"declaringClass\":\"java.util.concurrent.Executors$RunnableAdapter\",\"methodName\":\"call\",\"fileName\":\"Executors.java\",\"lineNumber\":471},{\"declaringClass\":\"java.util.concurrent.FutureTask$Sync\",\"methodName\":\"innerRun\",\"fileName\":\"FutureTask.java\",\"lineNumber\":334},{\"declaringClass\":\"java.util.concurrent.FutureTask\",\"methodName\":\"run\",\"fileName\":\"FutureTask.java\",\"lineNumber\":166},{\"declaringClass\":\"java.util.concurrent.ThreadPoolExecutor\",\"methodName\":\"runWorker\",\"fileName\":\"ThreadPoolExecutor.java\",\"lineNumber\":1110},{\"declaringClass\":\"java.util.concurrent.ThreadPoolExecutor$Worker\",\"methodName\":\"run\",\"fileName\":\"ThreadPoolExecutor.java\",\"lineNumber\":603},{\"declaringClass\":\"java.lang.Thread\",\"methodName\":\"run\",\"fileName\":\"Thread.java\",\"lineNumber\":679}]}"}
nagedContext$1.call(DefaultManagedContext.java:56)
        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
        at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
        at java.lang.Thread.run(Thread.java:679)
Caused by: java.io.StreamCorruptedException: invalid stream header: 72899C96
        at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:800)
        at java.io.ObjectInputStream.<init>(ObjectInputStream.java:297)
        at org.apache.cloudstack.framework.jobs.impl.JobSerializerHelper.fromObjectSerializedString(JobSerializerHelper.java:129)
        ... 33 more
2014-01-06 11:53:37,457 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Job-Executor-114:ctx-035abfcd) Complete async job-141, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable to serialize: com.cloud.utils.exception.CloudRuntimeException/{\"idList\":[],\"uuidList\":[],\"csErrorCode\":4250,\"detailMessage\":\"copy volume failed: java.lang.NullPointerException\",\"cause\":{\"class\":\"com.cloud.utils.exception.CloudRuntimeException\",\"msg\":\"copy volume failed: java.lang.NullPointerException\"},\"stackTrace\":[{\"declaringClass\":\"org.apache.cloudstack.engine.orchestration.VolumeOrchestrator\",\"methodName\":\"copyVolumeFromSecToPrimary\",\"fileName\":\"VolumeOrchestrator.java\",\"lineNumber\":412},{\"declaringClass\":\"org.apache.cloudstack.engine.orchestration.VolumeOrchestrator\",\"methodName\":\"copyVolume\",\"fileName\":\"VolumeOrchestrator.java\",\"lineNumber\":718},{\"declaringClass\":\"org.apache.cloudstack.engine.orchestration.VolumeOrchestrator\",\"methodName\":\"createVolumeOnPrimaryStorage\",\"fileName\":\"VolumeOrchestrator.java\",\"lineNumber\":747},{\"declaringClass\":\"com.cloud.storage.VolumeApiServiceImpl\",\"methodName\":\"attachVolumeToVM\",\"fileName\":\"VolumeApiServiceImpl.java\",\"lineNumber\":1249},{\"declaringClass\":\"com.cloud.storage.VolumeApiServiceImpl\",\"methodName\":\"orchestrateAttachVolumeToVM\",\"fileName\":\"VolumeApiServiceImpl.java\",\"lineNumber\":1127},{\"declaringClass\":\"com.cloud.storage.VolumeApiServiceImpl\",\"methodName\":\"orchestrateAttachVolumeToVM\",\"fileName\":\"VolumeApiServiceImpl.java\",\"lineNumber\":2406},{\"declaringClass\":\"sun.reflect.NativeMethodAccessorImpl\",\"methodName\":\"invoke0\",\"fileName\":\"NativeMethodAccessorImpl.java\",\"lineNumber\":-2},{\"declaringClass\":\"sun.reflect.NativeMethodAccessorImpl\",\"methodName\":\"invoke\",\"fileName\":\"NativeMethodAccessorImpl.java\",\"lineNumber\":57},{\"declaringClass\":\"sun.reflect.DelegatingMethodAccessorImpl\",\"methodName\":\"invoke\",\"fileName\":\"DelegatingMethodAccessorImpl.java\",\"lineNumber\":43},{\"declaringClass\":\"java.lang.reflect.Method\",\"methodName\":\"invoke\",\"fileName\":\"Method.java\",\"lineNumber\":616},{\"declaringClass\":\"com.cloud.vm.VmWorkJobHandlerProxy\",\"methodName\":\"handleVmWorkJob\",\"fileName\":\"VmWorkJobHandlerProxy.java\",\"lineNumber\":107},{\"declaringClass\":\"com.cloud.storage.VolumeApiServiceImpl\",\"methodName\":\"handleVmWorkJob\",\"fileName\":\"VolumeApiServiceImpl.java\",\"lineNumber\":2437},{\"declaringClass\":\"sun.reflect.NativeMethodAccessorImpl\",\"methodName\":\"invoke0\",\"fileName\":\"NativeMethodAccessorImpl.java\",\"lineNumber\":-2},{\"declaringClass\":\"sun.reflect.NativeMethodAccessorImpl\",\"methodName\":\"invoke\",\"fileName\":\"NativeMethodAccessorImpl.java\",\"lineNumber\":57},{\"declaringClass\":\"sun.reflect.DelegatingMethodAccessorImpl\",\"methodName\":\"invoke\",\"fileName\":\"DelegatingMethodAccessorImpl.java\",\"lineNumber\":43},{\"declaringClass\":\"java.lang.reflect.Method\",\"methodName\":\"invoke\",\"fileName\":\"Method.java\",\"lineNumber\":616},{\"declaringClass\":\"org.springframework.aop.support.AopUtils\",\"methodName\":\"invokeJoinpointUsingReflection\",\"fileName\":\"AopUtils.java\",\"lineNumber\":317},{\"declaringClass\":\"org.springframework.aop.framework.ReflectiveMethodInvocation\",\"methodName\":\"invokeJoinpoint\",\"fileName\":\"ReflectiveMethodInvocation.java\",\"lineNumber\":183},{\"declaringClass\":\"org.springframework.aop.framework.ReflectiveMethodInvocation\",\"methodName\":\"proceed\",\"fileName\":\"ReflectiveMethodInvocation.java\",\"lineNumber\":150},{\"declaringClass\":\"org.springframework.aop.interceptor.ExposeInvocationInterceptor\",\"methodName\":\"invoke\",\"fileName\":\"ExposeInvocationInterceptor.java\",\"lineNumber\":91},{\"declaringClass\":\"org.springframework.aop.framework.ReflectiveMethodInvocation\",\"methodName\":\"proceed\",\"fileName\":\"ReflectiveMethodInvocation.java\",\"lineNumber\":172},{\"declaringClass\":\"org.springframework.aop.framework.JdkDynamicAopProxy\",\"methodName\":\"invoke\",\"fileName\":\"JdkDynamicAopProxy.java\",\"lineNumber\":204},{\"declaringClass\":\"$Proxy195\",\"methodName\":\"handleVmWorkJob\",\"lineNumber\":-1},{\"declaringClass\":\"com.cloud.vm.VmWorkJobDispatcher\",\"methodName\":\"runJob\",\"fileName\":\"VmWorkJobDispatcher.java\",\"lineNumber\":99},{\"declaringClass\":\"org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5\",\"methodName\":\"runInContext\",\"fileName\":\"AsyncJobManagerImpl.java\",\"lineNumber\":524},{\"declaringClass\":\"org.apache.cloudstack.managed.context.ManagedContextRunnable$1\",\"methodName\":\"run\",\"fileName\":\"ManagedContextRunnable.java\",\"lineNumber\":49},{\"declaringClass\":\"org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1\",\"methodName\":\"call\",\"fileName\":\"DefaultManagedContext.java\",\"lineNumber\":56},{\"declaringClass\":\"org.apache.cloudstack.managed.context.impl.DefaultManagedContext\",\"methodName\":\"callWithContext\",\"fileName\":\"DefaultManagedContext.java\",\"lineNumber\":103},{\"declaringClass\":\"org.apache.cloudstack.managed.context.impl.DefaultManagedContext\",\"methodName\":\"runWithContext\",\"fileName\":\"DefaultManagedContext.java\",\"lineNumber\":53},{\"declaringClass\":\"org.apache.cloudstack.managed.context.ManagedContextRunnable\",\"methodName\":\"run\",\"fileName\":\"ManagedContextRunnable.java\",\"lineNumber\":46},{\"declaringClass\":\"java.util.concurrent.Executors$RunnableAdapter\",\"methodName\":\"call\",\"fileName\":\"Executors.java\",\"lineNumber\":471},{\"declaringClass\":\"java.util.concurrent.FutureTask$Sync\",\"methodName\":\"innerRun\",\"fileName\":\"FutureTask.java\",\"lineNumber\":334},{\"declaringClass\":\"java.util.concurrent.FutureTask\",\"methodName\":\"run\",\"fileName\":\"FutureTask.java\",\"lineNumber\":166},{\"declaringClass\":\"java.util.concurrent.ThreadPoolExecutor\",\"methodName\":\"runWorker\",\"fileName\":\"ThreadPoolExecutor.java\",\"lineNumber\":1110},{\"declaringClass\":\"java.util.concurrent.ThreadPoolExecutor$Worker\",\"methodName\":\"run\",\"fileName\":\"ThreadPoolExecutor.java\",\"lineNumber\":603},{\"declaringClass\":\"java.lang.Thread\",\"methodName\":\"run\",\"fileName\":\"Thread.java\",\"lineNumber\":679}]}"}
2014-01-06 11:53:37,454 WARN  [o.a.c.f.j.i.AsyncJobManagerImpl] (Job-Executor-116:ctx-9f6a5f51) job-141 is scheduled for wakeup run, but there is no joining info anymore
2014-01-06 11:53:37,461 ERROR [o.a.c.f.j.i.AsyncJobManagerImpl] (Job-Executor-116:ctx-9f6a5f51) Unable to find a wakeup dispatcher from the joined job: AsyncJobVO {id:141, userId: 2, accountId: 2, instanceType: Volume, instanceId: 19, cmd: org.apache.cloudstack.api.command.user.volume.AttachVolumeCmd, cmdInfo: {"response":"json","id":"4d5e35e3-2a67-4d1e-8758-7c6b283866cd","sessionkey":"5ODiLDmKehMbGznMVT9sutQQg7U\u003d","cmdEventType":"VOLUME.ATTACH","ctxUserId":"2","virtualMachineId":"62064ead-e49e-4bb7-86e7-7422f33e3f75","httpmethod":"GET","_":"1388989738235","ctxAccountId":"2","ctxStartEventId":"332"}, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 280320865129348, completeMsid: null, lastUpdated: null, lastPolled: Mon Jan 06 11:53:36 IST 2014, created: Mon Jan 06 11:53:27 IST 2014}
2014-01-06 11:53:37,461 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Job-Executor-116:ctx-9f6a5f51) Done executing org.apache.cloudstack.api.command.user.volume.AttachVolumeCmd for job-141
2014-01-06 11:53:37,465 INFO  [o.a.c.f.j.i.AsyncJobMonitor] (Job-Executor-116:ctx-9f6a5f51) Remove job-141 from job monitoring
2014-01-06 11:53:37,468 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Job-Executor-114:ctx-035abfcd) Done executing org.apache.cloudstack.api.command.user.volume.AttachVolumeCmd for job-141


Agent logs :
------------------------------------

2014-01-06 07:06:11,293 [24] INFO  HypervResource.HypervResourceController [ee43f27c-cfea-4abc-b715-4114af3bc691] - org.apache.cloudstack.storage.command.CopyCommand{
  "srcTO": {
    "org.apache.cloudstack.storage.to.VolumeObjectTO": {
      "uuid": "88a1e01c-105b-4c6a-a443-513ad65d0447",
      "volumeType": "DATADISK",
      "dataStore": {
        "com.cloud.agent.api.to.NfsTO": {
          "_url": "cifs://10.102.192.19/hyperv-share/abhinav-hyperv-ss1?user=abhinavroy&password=freebsd@123&domain=BLR",
          "_role": "Image"
        }
      },
      "name": "av-upload2",
      "size": 5368709120,
      "path": "volumes/2/26/93f17813-1e10-324e-b276-47ec9ed813c0.vhd",
      "volumeId": 26,
      "accountId": 2,
      "format": "VHD",
      "id": 26,
      "hypervisorType": "Hyperv"
    }
  },
  "destTO": {
    "org.apache.cloudstack.storage.to.VolumeObjectTO": {
      "uuid": "88a1e01c-105b-4c6a-a443-513ad65d0447",
      "volumeType": "DATADISK",
      "dataStore": {
        "org.apache.cloudstack.storage.to.PrimaryDataStoreTO": {
          "uuid": "088db467-32e3-3d0a-bca0-20e3382fe902",
          "id": 1,
          "poolType": "NetworkFilesystem",
          "host": "SMB19",
          "path": "/hyperv-share/abhinav-hyperv-ps1?user=abhinavroy&password=freebsd@123&domain=BLR",
          "port": 445,
          "url": "NetworkFilesystem://SMB19//hyperv-share/abhinav-hyperv-ps1?user=abhinavroy&password=freebsd@123&domain=BLR/?ROLE=Primary&STOREUUID=088db467-32e3-3d0a-bca0-20e3382fe902"
        }
      },
      "name": "av-upload2",
      "size": 5368709120,
      "volumeId": 26,
      "accountId": 2,
      "format": "VHD",
      "id": 26,
      "hypervisorType": "Hyperv"
    }
  },
  "executeInSequence": false,
  "options": {},
  "contextMap": {},
  "wait": 10800
}
2014-01-06 07:06:31,215 [22] INFO  HypervResource.HypervResourceController [fb446b9b-fe66-41e6-a652-fa149475526e] - com.cloud.agent.api.GetHostStatsCommand{
  "hostGuid": "23ca5fe2-a504-3bac-83a5-519315d0bc3d-HypervResource",
  "hostName": "10.102.192.14",
  "hostId": 5,
  "contextMap": {},
  "wait": 0
}
2014-01-06 07:06:31,574 [22] INFO  HypervResource.HypervResourceController [fb446b9b-fe66-41e6-a652-fa149475526e] - {
  "com.cloud.agent.api.GetHostStatsAnswer": {
    "result": true,
    "hostStats": {
      "hostId": 5,
      "entityType": "host",
      "cpuUtilization": 5.0,
      "networkReadKBs": 0.0,
      "networkWriteKBs": 0.0,
      "totalMemoryKBs": 16763980.0,
      "freeMemoryKBs": 13853540.0
    },
    "details": null,
    "contextMap": {}
  }
}
2014-01-06 07:06:33,871 [24] ERROR HypervResource.VolumeObjectTO [ee43f27c-cfea-4abc-b715-4114af3bc691] - Invalid dataStore in VolumeObjectTO spec
2014-01-06 07:06:33,871 [24] ERROR HypervResource.HypervResourceController [ee43f27c-cfea-4abc-b715-4114af3bc691] - org.apache.cloudstack.storage.command.CopyCommand failed on exception, Error getting value from 'FullFileName' on 'HypervResource.VolumeObjectTO'.
Newtonsoft.Json.JsonSerializationException: Error getting value from 'FullFileName' on 'HypervResource.VolumeObjectTO'. ---> System.IO.InvalidDataException: Invalid dataStore in VolumeObjectTO spec
   at HypervResource.VolumeObjectTO.get_FullFileName()
   at GetFullFileName(Object )
   at Newtonsoft.Json.Serialization.DynamicValueProvider.GetValue(Object target)
   --- End of inner exception stack trace ---
   at Newtonsoft.Json.Serialization.DynamicValueProvider.GetValue(Object target)
   at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.CalculatePropertyValues(JsonWriter writer, Object value, JsonContainerContract contract, JsonProperty member, JsonProperty property, JsonContract& memberContract, Object& memberValue)
   at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.SerializeObject(JsonWriter writer, Object value, JsonObjectContract contract, JsonProperty member, JsonContainerContract collectionContract, JsonProperty containerProperty)
   at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.SerializeValue(JsonWriter writer, Object value, JsonContract valueContract, JsonProperty member, JsonContainerContract containerContract, JsonProperty containerProperty)
   at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.Serialize(JsonWriter jsonWriter, Object value)
   at Newtonsoft.Json.JsonSerializer.SerializeInternal(JsonWriter jsonWriter, Object value)
   at Newtonsoft.Json.Linq.JToken.FromObjectInternal(Object o, JsonSerializer jsonSerializer)
   at Newtonsoft.Json.Linq.JToken.FromObject(Object o)
   at HypervResource.Utils.CreateCloudStackObject(String objType, Object objValue)
   at HypervResource.HypervResourceController.CopyCommand(Object cmd)
2014-01-06 07:06:33,871 [24] INFO  HypervResource.HypervResourceController [ee43f27c-cfea-4abc-b715-4114af3bc691] - {
  "org.apache.cloudstack.storage.command.CopyCmdAnswer": {
    "result": false,
    "details": "org.apache.cloudstack.storage.command.CopyCommand failed on exception, Error getting value from 'FullFileName' on 'HypervResource.VolumeObjectTO'.",
    "newData": null,
    "contextMap": {}
  }
}



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message