cloudstack-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sanjeev N (JIRA)" <j...@apache.org>
Subject [jira] [Reopened] (CLOUDSTACK-3665) Failed to create volume from snapshot
Date Mon, 29 Jul 2013 12:55:48 GMT

     [ https://issues.apache.org/jira/browse/CLOUDSTACK-3665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Sanjeev N reopened CLOUDSTACK-3665:
-----------------------------------


Tested this with Todays's build with VMWare using NFS as secondary and primary storage with
scope as Cluster lever. Observed same exception as mentioned in description:

2013-07-29 08:48:54,594 DEBUG [cloud.api.ApiServlet] (catalina-exec-23:null) ===START=== 
10.146.0.20 -- GET  command=createVolume&response=json&sessionkey=%2BFPenbp5rPeS7NG2g1sVBwdG7DM%3D&snapshotid=4186ec6b-81f0-495f-ab04-19e661947280&name=vm1-esx&_=1375102134737
2013-07-29 08:48:54,781 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-23:null) submit
async job-17 = [ 7a393090-bc47-4179-afe5-2b1f1cd37b4b ], details: AsyncJobVO {id:17, userId:
2, accountId: 2, sessionKey: null, instanceType: Volume, instanceId: 6, cmd: org.apache.cloudstack.api.command.user.volume.CreateVolumeCmd,
cmdOriginator: null, cmdInfo: {"id":"6","response":"json","sessionkey":"+FPenbp5rPeS7NG2g1sVBwdG7DM\u003d","cmdEventType":"VOLUME.CREATE","ctxUserId":"2","snapshotid":"4186ec6b-81f0-495f-ab04-19e661947280","name":"vm1-esx","httpmethod":"GET","_":"1375102134737","ctxAccountId":"2","ctxStartEventId":"64"},
cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0, processStatus: 0, resultCode:
0, result: null, initMsid: 6615759585382, completeMsid: null, lastUpdated: null, lastPolled:
null, created: null}
2013-07-29 08:48:54,784 DEBUG [cloud.api.ApiServlet] (catalina-exec-23:null) ===END===  10.146.0.20
-- GET  command=createVolume&response=json&sessionkey=%2BFPenbp5rPeS7NG2g1sVBwdG7DM%3D&snapshotid=4186ec6b-81f0-495f-ab04-19e661947280&name=vm1-esx&_=1375102134737
2013-07-29 08:48:54,786 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-17:job-17 =
[ 7a393090-bc47-4179-afe5-2b1f1cd37b4b ]) Executing org.apache.cloudstack.api.command.user.volume.CreateVolumeCmd
for job-17 = [ 7a393090-bc47-4179-afe5-2b1f1cd37b4b ]
2013-07-29 08:48:54,832 DEBUG [storage.allocator.LocalStoragePoolAllocator] (Job-Executor-17:job-17
= [ 7a393090-bc47-4179-afe5-2b1f1cd37b4b ]) LocalStoragePoolAllocator trying to find storage
pool to fit the vm
2013-07-29 08:48:54,836 DEBUG [storage.allocator.ClusterScopeStoragePoolAllocator] (Job-Executor-17:job-17
= [ 7a393090-bc47-4179-afe5-2b1f1cd37b4b ]) ClusterScopeStoragePoolAllocator looking for storage
pool
2013-07-29 08:48:54,836 DEBUG [storage.allocator.ClusterScopeStoragePoolAllocator] (Job-Executor-17:job-17
= [ 7a393090-bc47-4179-afe5-2b1f1cd37b4b ]) Looking for pools in dc: 1  pod:1  cluster:null
2013-07-29 08:48:54,846 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (Job-Executor-17:job-17
= [ 7a393090-bc47-4179-afe5-2b1f1cd37b4b ]) Checking if storage pool is suitable, name: null
,poolId: 1
2013-07-29 08:48:54,850 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (Job-Executor-17:job-17
= [ 7a393090-bc47-4179-afe5-2b1f1cd37b4b ]) StoragePool's Cluster does not have required hypervisorType,
skipping this pool
2013-07-29 08:48:54,850 DEBUG [storage.allocator.ClusterScopeStoragePoolAllocator] (Job-Executor-17:job-17
= [ 7a393090-bc47-4179-afe5-2b1f1cd37b4b ]) FirstFitStoragePoolAllocator returning 0 suitable
storage pools
2013-07-29 08:48:54,850 DEBUG [storage.allocator.ZoneWideStoragePoolAllocator] (Job-Executor-17:job-17
= [ 7a393090-bc47-4179-afe5-2b1f1cd37b4b ]) ZoneWideStoragePoolAllocator to find storage pool
2013-07-29 08:48:54,859 DEBUG [storage.allocator.GarbageCollectingStoragePoolAllocator] (Job-Executor-17:job-17
= [ 7a393090-bc47-4179-afe5-2b1f1cd37b4b ]) GarbageCollectingStoragePoolAllocator looking
for storage pool
2013-07-29 08:48:54,878 DEBUG [cloud.storage.StorageManagerImpl] (Job-Executor-17:job-17 =
[ 7a393090-bc47-4179-afe5-2b1f1cd37b4b ]) Storage pool garbage collector found 0 templates
to clean up in storage pool: pri_esx_os
2013-07-29 08:48:54,887 DEBUG [cloud.storage.StorageManagerImpl] (Job-Executor-17:job-17 =
[ 7a393090-bc47-4179-afe5-2b1f1cd37b4b ]) Secondary storage garbage collector found 0 templates
to cleanup on template_store_ref for store: sec_esx_os
2013-07-29 08:48:54,889 DEBUG [cloud.storage.StorageManagerImpl] (Job-Executor-17:job-17 =
[ 7a393090-bc47-4179-afe5-2b1f1cd37b4b ]) Secondary storage garbage collector found 0 snapshots
to cleanup on snapshot_store_ref for store: sec_esx_os
2013-07-29 08:48:54,893 DEBUG [cloud.storage.StorageManagerImpl] (Job-Executor-17:job-17 =
[ 7a393090-bc47-4179-afe5-2b1f1cd37b4b ]) Secondary storage garbage collector found 0 volumes
to cleanup on volume_store_ref for store: sec_esx_os
2013-07-29 08:48:54,897 DEBUG [storage.allocator.ClusterScopeStoragePoolAllocator] (Job-Executor-17:job-17
= [ 7a393090-bc47-4179-afe5-2b1f1cd37b4b ]) ClusterScopeStoragePoolAllocator looking for storage
pool
2013-07-29 08:48:54,898 DEBUG [storage.allocator.ClusterScopeStoragePoolAllocator] (Job-Executor-17:job-17
= [ 7a393090-bc47-4179-afe5-2b1f1cd37b4b ]) Looking for pools in dc: 1  pod:1  cluster:null
2013-07-29 08:48:54,909 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (Job-Executor-17:job-17
= [ 7a393090-bc47-4179-afe5-2b1f1cd37b4b ]) Checking if storage pool is suitable, name: null
,poolId: 1
2013-07-29 08:48:54,913 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (Job-Executor-17:job-17
= [ 7a393090-bc47-4179-afe5-2b1f1cd37b4b ]) StoragePool's Cluster does not have required hypervisorType,
skipping this pool
2013-07-29 08:48:54,913 DEBUG [storage.allocator.ClusterScopeStoragePoolAllocator] (Job-Executor-17:job-17
= [ 7a393090-bc47-4179-afe5-2b1f1cd37b4b ]) FirstFitStoragePoolAllocator returning 0 suitable
storage pools
2013-07-29 08:48:54,919 DEBUG [allocator.impl.UserConcentratedAllocator] (Job-Executor-17:job-17
= [ 7a393090-bc47-4179-afe5-2b1f1cd37b4b ]) There are no pods with enough memory/CPU capacity
in zone Adv-vmware
2013-07-29 08:48:54,920 INFO  [cloud.storage.VolumeManagerImpl] (Job-Executor-17:job-17 =
[ 7a393090-bc47-4179-afe5-2b1f1cd37b4b ]) There are no available storage pools to store the
volume in
2013-07-29 08:48:54,921 DEBUG [cloud.storage.VolumeManagerImpl] (Job-Executor-17:job-17 =
[ 7a393090-bc47-4179-afe5-2b1f1cd37b4b ]) Failed to create volume: 6
com.cloud.exception.StorageUnavailableException: Resource [StoragePool:-1] is unreachable:
There are no available storage pools to store the volume in
        at com.cloud.storage.VolumeManagerImpl.createVolumeFromSnapshot(VolumeManagerImpl.java:556)
        at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
        at com.cloud.storage.VolumeManagerImpl.createVolumeFromSnapshot(VolumeManagerImpl.java:612)
        at com.cloud.storage.VolumeManagerImpl.createVolume(VolumeManagerImpl.java:1061)
        at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
        at com.cloud.storage.VolumeManagerImpl.createVolume(VolumeManagerImpl.java:186)
        at org.apache.cloudstack.api.command.user.volume.CreateVolumeCmd.execute(CreateVolumeCmd.java:189)
        at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
        at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
        at java.lang.Thread.run(Thread.java:679)
2013-07-29 08:48:54,962 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-17:job-17 =
[ 7a393090-bc47-4179-afe5-2b1f1cd37b4b ]) Complete async job-17 = [ 7a393090-bc47-4179-afe5-2b1f1cd37b4b
], jobStatus: 2, resultCode: 530, result: Error Code: 530 Error text: Failed to create a volume

mysql> select * from snapshots where id=2\G;
*************************** 1. row ***************************
              id: 2
  data_center_id: 1
      account_id: 2
       domain_id: 1
       volume_id: 4
disk_offering_id: 1
          status: BackedUp
            path: NULL
            name: vm1-esx_ROOT-4_20130729124015
            uuid: 4186ec6b-81f0-495f-ab04-19e661947280
   snapshot_type: 0
type_description: MANUAL
            size: 0
         created: 2013-07-29 12:40:15
         removed: NULL
  backup_snap_id: NULL
        swift_id: NULL
      sechost_id: NULL
    prev_snap_id: NULL
 hypervisor_type: None
         version: 2.2
           s3_id: NULL
1 row in set (0.00 sec)

ERROR:
No query specified
mysql> select * from snapshot_store_ref where snapshot_id=2\G
*************************** 1. row ***************************
                id: 3
          store_id: 1
       snapshot_id: 2
           created: 2013-07-29 12:40:15
      last_updated: NULL
            job_id: NULL
        store_role: Primary
              size: 0
     physical_size: 0
parent_snapshot_id: 0
      install_path: ac9a2607-d07b-4434-abcb-2f54001f28d2
             state: Ready
      update_count: 2
           ref_cnt: 0
           updated: 2013-07-29 12:40:15
         volume_id: 4
*************************** 2. row ***************************
                id: 4
          store_id: 1
       snapshot_id: 2
           created: 2013-07-29 12:40:15
      last_updated: NULL
            job_id: NULL
        store_role: Image
              size: 0
     physical_size: 0
parent_snapshot_id: 0
      install_path: snapshots/2/4/9014dc0f-fada-4a35-adb5-50872299cdb7/9014dc0f-fada-4a35-adb5-50872299cdb7
             state: Ready
      update_count: 2
           ref_cnt: 0
           updated: 2013-07-29 12:43:29
         volume_id: 4
2 rows in set (0.00 sec)

                
> Failed to create volume from snapshot
> -------------------------------------
>
>                 Key: CLOUDSTACK-3665
>                 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-3665
>             Project: CloudStack
>          Issue Type: Bug
>      Security Level: Public(Anyone can view this level - this is the default.) 
>          Components: KVM, Storage Controller, VMware, XenServer
>    Affects Versions: 4.2.0
>            Reporter: Sailaja Mada
>            Assignee: Min Chen
>            Priority: Critical
>             Fix For: 4.2.0
>
>         Attachments: apilog.log, cloud-backup.dmp, management-server.log
>
>
> Steps:
> 1. Configure Adv zone with VMWARE with Zone wide primary storage
> 2. Deploy VM using default template 
> 3. Create Snapshot from ROOT volume
> 4. Tried to create volume from thos snapshot .
> Observation:
> It failed to create volume from snapshot saying Storage is unavailable. But storage is
available and i was able to create and attach DATA volumes to the instance. Only while creating
volume from snapshot this failure is observed (Attached logs and DB) 
> 2013-07-19 16:20:15,918 INFO  [cloud.storage.VolumeManagerImpl] (Job-Executor-30:job-46
= [ 8d88b415-e4e5-453e-865d-48c37a640e7b ]) There are no available storage pools to store
the volume in
> 2013-07-19 16:20:15,919 DEBUG [cloud.storage.VolumeManagerImpl] (Job-Executor-30:job-46
= [ 8d88b415-e4e5-453e-865d-48c37a640e7b ]) Failed to create volume: 14
> com.cloud.exception.StorageUnavailableException: Resource [StoragePool:-1] is unreachable:
There are no available storage pools to store the volume in
>         at com.cloud.storage.VolumeManagerImpl.createVolumeFromSnapshot(VolumeManagerImpl.java:558)
>         at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>         at com.cloud.storage.VolumeManagerImpl.createVolumeFromSnapshot(VolumeManagerImpl.java:614)
>         at com.cloud.storage.VolumeManagerImpl.createVolume(VolumeManagerImpl.java:1072)
>         at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>         at com.cloud.storage.VolumeManagerImpl.createVolume(VolumeManagerImpl.java:188)
>         at org.apache.cloudstack.api.command.user.volume.CreateVolumeCmd.execute(CreateVolumeCmd.java:189)
>         at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
>         at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
>         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>         at java.lang.Thread.run(Thread.java:679)
> 2013-07-19 16:20:15,983 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-30:job-46
= [ 8d88b415-e4e5-453e-865d-48c37a640e7b ]) Complete async job-46 = [ 8d88b415-e4e5-453e-865d-48c37a640e7b
], jobStatus: 2, resultCode: 530, result: Error Code: 530 Error text: Failed to create a volume
> 2013-07-19 16:20:17,115 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null)
Zone 1 is ready to launch secondary storage VM

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message