cloudstack-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "youngsikyun (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (CLOUDSTACK-10063) Cloudstack proceeded after volume migration failed and failed, but failed
Date Mon, 04 Sep 2017 01:56:02 GMT

     [ https://issues.apache.org/jira/browse/CLOUDSTACK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

youngsikyun updated CLOUDSTACK-10063:
-------------------------------------
    Description: 
The volume migration from Cloudstack has been unsuccessful.
When I try again, the following log fails and fails.
I do not know how to solve it.

2017-09-04 09:33:09,886 ERROR [c.c.a.ApiAsyncJobDispatcher] (API-Job-Executor-29:ctx-22ba811c
job-4558169) (logid:e0d7183d) Unexpected exception while executing org.apache.cloudstack.api.command.admin.volume.MigrateVolumeCmdByAdmin
com.cloud.utils.exception.CloudRuntimeException: Resource [StoragePool:2688] is unreachable:
Migrate volume failed: com.cloud.utils.exception.CloudRuntimeException: Failed to update state:com.cloud.utils.fsm.NoTransitionException:
*Unable to transition to a new state from Creating via CreateOnlyRequested*
	at com.cloud.storage.VolumeApiServiceImpl.orchestrateMigrateVolume(VolumeApiServiceImpl.java:2030)
	at com.cloud.storage.VolumeApiServiceImpl.migrateVolume(VolumeApiServiceImpl.java:2012)
	at sun.reflect.GeneratedMethodAccessor953.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
	at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
	at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
	at org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:106)
	at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
	at com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
	at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
	at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
	at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)

  was:
The volume migration from Cloudstack has been unsuccessful.
When I try again, the following log fails and fails.
I do not know how to solve it.

2017-09-04 09:33:09,744 INFO  [o.a.c.f.j.i.AsyncJobMonitor] (API-Job-Executor-29:ctx-22ba811c
job-4558169) (logid:0f25981e) Add job-4558169 into job monitoring
2017-09-04 09:33:09,748 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (catalina-exec-15:ctx-6ed21df6
ctx-50260cc7) (logid:4d42b821) submit async job-4558169, details: AsyncJobVO {id:4558169,
userId: 6227, accountId: 6188, instanceType: None, instanceId: null, cmd: org.apache.cloudstack.api.command.admin.volume.MigrateVolumeCmdByAdmin,
cmdInfo: {"response":"json","sessionkey":"wf6FeFTvYvChL8kARL54Na/LdrI\u003d","ctxDetails":"{\"com.cloud.storage.Volume\":\"a2d110f9-6033-4160-b958-93d132355a7d\",\"com.cloud.storage.StoragePool\":\"93784b55-d8e4-3f37-8ef7-ba7357f0b8da\"}","cmdEventType":"VOLUME.MIGRATE","ctxUserId":"6227","storageid":"93784b55-d8e4-3f37-8ef7-ba7357f0b8da","httpmethod":"GET","volumeid":"a2d110f9-6033-4160-b958-93d132355a7d","_":"1504485025736","ctxAccountId":"6188","ctxStartEventId":"15164623"},
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid:
147945607443714, completeMsid: null, lastUpdated: null, lastPolled: null, created: null}
2017-09-04 09:33:09,749 DEBUG [c.c.a.ApiServlet] (catalina-exec-15:ctx-6ed21df6 ctx-50260cc7)
(logid:4d42b821) ===END===  10.222.111.13 -- GET  command=migrateVolume&storageid=93784b55-d8e4-3f37-8ef7-ba7357f0b8da&volumeid=a2d110f9-6033-4160-b958-93d132355a7d&response=json&sessionkey=wf6FeFTvYvChL8kARL54Na%2FLdrI%3D&_=1504485025736
2017-09-04 09:33:09,753 DEBUG [c.c.c.CapacityManagerImpl] (CapacityChecker:ctx-0f70cf12) (logid:cabbd82c)
No need to calibrate cpu capacity, host:2555 usedCpu: 11750 reservedCpu: 0
2017-09-04 09:33:09,753 DEBUG [c.c.c.CapacityManagerImpl] (CapacityChecker:ctx-0f70cf12) (logid:cabbd82c)
No need to calibrate memory capacity, host:2555 usedMem: 23085449216 reservedMem: 0
2017-09-04 09:33:09,753 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-29:ctx-22ba811c
job-4558169) (logid:e0d7183d) Executing AsyncJobVO {id:4558169, userId: 6227, accountId: 6188,
instanceType: None, instanceId: null, cmd: org.apache.cloudstack.api.command.admin.volume.MigrateVolumeCmdByAdmin,
cmdInfo: {"response":"json","sessionkey":"wf6FeFTvYvChL8kARL54Na/LdrI\u003d","ctxDetails":"{\"com.cloud.storage.Volume\":\"a2d110f9-6033-4160-b958-93d132355a7d\",\"com.cloud.storage.StoragePool\":\"93784b55-d8e4-3f37-8ef7-ba7357f0b8da\"}","cmdEventType":"VOLUME.MIGRATE","ctxUserId":"6227","storageid":"93784b55-d8e4-3f37-8ef7-ba7357f0b8da","httpmethod":"GET","volumeid":"a2d110f9-6033-4160-b958-93d132355a7d","_":"1504485025736","ctxAccountId":"6188","ctxStartEventId":"15164623"},
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid:
147945607443714, completeMsid: null, lastUpdated: null, lastPolled: null, created: null}
2017-09-04 09:33:09,806 DEBUG [o.a.c.s.m.AncientDataMotionStrategy] (API-Job-Executor-29:ctx-22ba811c
job-4558169 ctx-e6c2227b) (logid:e0d7183d) copyAsync inspecting src type VOLUME copyAsync
inspecting dest type VOLUME
2017-09-04 09:33:09,809 DEBUG [o.a.c.s.c.a.StorageCacheRandomAllocator] (API-Job-Executor-29:ctx-22ba811c
job-4558169 ctx-e6c2227b) (logid:e0d7183d) Can't find staging storage in zone: 2
2017-09-04 09:33:09,820 DEBUG [o.a.c.s.v.VolumeObject] (API-Job-Executor-29:ctx-22ba811c job-4558169
ctx-e6c2227b) (logid:e0d7183d) Failed to update state
com.cloud.utils.fsm.NoTransitionException: Unable to transition to a new state from Creating
via CreateOnlyRequested
	at com.cloud.utils.fsm.StateMachine2.getTransition(StateMachine2.java:98)
	at com.cloud.utils.fsm.StateMachine2.getNextState(StateMachine2.java:84)
	at com.cloud.utils.fsm.StateMachine2.transitTo(StateMachine2.java:114)
	at org.apache.cloudstack.storage.datastore.ObjectInDataStoreManagerImpl.update(ObjectInDataStoreManagerImpl.java:314)
	at org.apache.cloudstack.storage.volume.VolumeObject.processEvent(VolumeObject.java:296)
	at org.apache.cloudstack.storage.motion.AncientDataMotionStrategy.copyVolumeBetweenPools(AncientDataMotionStrategy.java:327)
	at org.apache.cloudstack.storage.motion.AncientDataMotionStrategy.copyAsync(AncientDataMotionStrategy.java:450)
	at org.apache.cloudstack.storage.motion.DataMotionServiceImpl.copyAsync(DataMotionServiceImpl.java:68)
	at org.apache.cloudstack.storage.motion.DataMotionServiceImpl.copyAsync(DataMotionServiceImpl.java:73)
	at org.apache.cloudstack.storage.volume.VolumeServiceImpl.copyVolume(VolumeServiceImpl.java:996)
	at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.migrateVolume(VolumeOrchestrator.java:923)
	at com.cloud.storage.VolumeApiServiceImpl.orchestrateMigrateVolume(VolumeApiServiceImpl.java:2026)
	at com.cloud.storage.VolumeApiServiceImpl.migrateVolume(VolumeApiServiceImpl.java:2012)
	at sun.reflect.GeneratedMethodAccessor953.invoke(Unknown Source)
--
2017-09-04 09:33:09,820 DEBUG [o.a.c.s.m.AncientDataMotionStrategy] (API-Job-Executor-29:ctx-22ba811c
job-4558169 ctx-e6c2227b) (logid:e0d7183d) copy failed
com.cloud.utils.exception.CloudRuntimeException: Failed to update state:com.cloud.utils.fsm.NoTransitionException:
Unable to transition to a new state from Creating via CreateOnlyRequested
	at org.apache.cloudstack.storage.volume.VolumeObject.processEvent(VolumeObject.java:336)
	at org.apache.cloudstack.storage.motion.AncientDataMotionStrategy.copyVolumeBetweenPools(AncientDataMotionStrategy.java:327)
	at org.apache.cloudstack.storage.motion.AncientDataMotionStrategy.copyAsync(AncientDataMotionStrategy.java:450)
	at org.apache.cloudstack.storage.motion.DataMotionServiceImpl.copyAsync(DataMotionServiceImpl.java:68)
	at org.apache.cloudstack.storage.motion.DataMotionServiceImpl.copyAsync(DataMotionServiceImpl.java:73)
	at org.apache.cloudstack.storage.volume.VolumeServiceImpl.copyVolume(VolumeServiceImpl.java:996)
	at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.migrateVolume(VolumeOrchestrator.java:923)
	at com.cloud.storage.VolumeApiServiceImpl.orchestrateMigrateVolume(VolumeApiServiceImpl.java:2026)
	at com.cloud.storage.VolumeApiServiceImpl.migrateVolume(VolumeApiServiceImpl.java:2012)
	at sun.reflect.GeneratedMethodAccessor953.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
	at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
--
2017-09-04 09:33:09,837 WARN  [o.a.c.s.d.ObjectInDataStoreManagerImpl] (API-Job-Executor-29:ctx-22ba811c
job-4558169 ctx-e6c2227b) (logid:e0d7183d) Unsupported data object (VOLUME, org.apache.cloudstack.storage.datastore.PrimaryDataStoreImpl@d302de4),
no need to delete from object in store ref table
2017-09-04 09:33:09,874 DEBUG [o.a.c.s.v.VolumeServiceImpl] (API-Job-Executor-29:ctx-22ba811c
job-4558169 ctx-e6c2227b) (logid:e0d7183d) Marking volume that was never created as destroyed:
Vol[541782|vm=null|DATADISK]
2017-09-04 09:33:09,878 ERROR [o.a.c.e.o.VolumeOrchestrator] (API-Job-Executor-29:ctx-22ba811c
job-4558169 ctx-e6c2227b) (logid:e0d7183d) Migrate volume failed:com.cloud.utils.exception.CloudRuntimeException:
Failed to update state:com.cloud.utils.fsm.NoTransitionException: Unable to transition to
a new state from Creating via CreateOnlyRequested
2017-09-04 09:33:09,878 DEBUG [c.c.s.VolumeApiServiceImpl] (API-Job-Executor-29:ctx-22ba811c
job-4558169 ctx-e6c2227b) (logid:e0d7183d) Failed to migrate volume
com.cloud.exception.StorageUnavailableException: Resource [StoragePool:2688] is unreachable:
Migrate volume failed: com.cloud.utils.exception.CloudRuntimeException: Failed to update state:com.cloud.utils.fsm.NoTransitionException:
Unable to transition to a new state from Creating via CreateOnlyRequested
	at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.migrateVolume(VolumeOrchestrator.java:928)
	at com.cloud.storage.VolumeApiServiceImpl.orchestrateMigrateVolume(VolumeApiServiceImpl.java:2026)
	at com.cloud.storage.VolumeApiServiceImpl.migrateVolume(VolumeApiServiceImpl.java:2012)
	at sun.reflect.GeneratedMethodAccessor953.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
	at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
	at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
	at org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:106)
	at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
	at com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
	at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
	at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
--
2017-09-04 09:33:09,886 ERROR [c.c.a.ApiAsyncJobDispatcher] (API-Job-Executor-29:ctx-22ba811c
job-4558169) (logid:e0d7183d) Unexpected exception while executing org.apache.cloudstack.api.command.admin.volume.MigrateVolumeCmdByAdmin
com.cloud.utils.exception.CloudRuntimeException: Resource [StoragePool:2688] is unreachable:
Migrate volume failed: com.cloud.utils.exception.CloudRuntimeException: Failed to update state:com.cloud.utils.fsm.NoTransitionException:
Unable to transition to a new state from Creating via CreateOnlyRequested
	at com.cloud.storage.VolumeApiServiceImpl.orchestrateMigrateVolume(VolumeApiServiceImpl.java:2030)
	at com.cloud.storage.VolumeApiServiceImpl.migrateVolume(VolumeApiServiceImpl.java:2012)
	at sun.reflect.GeneratedMethodAccessor953.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
	at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
	at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
	at org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:106)
	at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
	at com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
	at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
	at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
	at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)


> Cloudstack proceeded after volume migration failed and failed, but failed
> -------------------------------------------------------------------------
>
>                 Key: CLOUDSTACK-10063
>                 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-10063
>             Project: CloudStack
>          Issue Type: Bug
>      Security Level: Public(Anyone can view this level - this is the default.) 
>          Components: API, cloudstack-agent, Secondary Storage, XenServer
>    Affects Versions: 4.5.1
>         Environment: XenServer 6.2.0 
>            Reporter: youngsikyun
>             Fix For: 4.5.1
>
>
> The volume migration from Cloudstack has been unsuccessful.
> When I try again, the following log fails and fails.
> I do not know how to solve it.
> 2017-09-04 09:33:09,886 ERROR [c.c.a.ApiAsyncJobDispatcher] (API-Job-Executor-29:ctx-22ba811c
job-4558169) (logid:e0d7183d) Unexpected exception while executing org.apache.cloudstack.api.command.admin.volume.MigrateVolumeCmdByAdmin
> com.cloud.utils.exception.CloudRuntimeException: Resource [StoragePool:2688] is unreachable:
Migrate volume failed: com.cloud.utils.exception.CloudRuntimeException: Failed to update state:com.cloud.utils.fsm.NoTransitionException:
*Unable to transition to a new state from Creating via CreateOnlyRequested*
> 	at com.cloud.storage.VolumeApiServiceImpl.orchestrateMigrateVolume(VolumeApiServiceImpl.java:2030)
> 	at com.cloud.storage.VolumeApiServiceImpl.migrateVolume(VolumeApiServiceImpl.java:2012)
> 	at sun.reflect.GeneratedMethodAccessor953.invoke(Unknown Source)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:606)
> 	at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
> 	at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
> 	at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
> 	at org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:106)
> 	at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
> 	at com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
> 	at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
> 	at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
> 	at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message