Return-Path: X-Original-To: apmail-cloudstack-issues-archive@www.apache.org Delivered-To: apmail-cloudstack-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5EE3010696 for ; Fri, 9 Aug 2013 23:30:49 +0000 (UTC) Received: (qmail 73085 invoked by uid 500); 9 Aug 2013 23:30:49 -0000 Delivered-To: apmail-cloudstack-issues-archive@cloudstack.apache.org Received: (qmail 73055 invoked by uid 500); 9 Aug 2013 23:30:49 -0000 Mailing-List: contact issues-help@cloudstack.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cloudstack.apache.org Delivered-To: mailing list issues@cloudstack.apache.org Received: (qmail 73016 invoked by uid 500); 9 Aug 2013 23:30:49 -0000 Delivered-To: apmail-incubator-cloudstack-issues@incubator.apache.org Received: (qmail 73001 invoked by uid 99); 9 Aug 2013 23:30:49 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 09 Aug 2013 23:30:49 +0000 Date: Fri, 9 Aug 2013 23:30:49 +0000 (UTC) From: "edison su (JIRA)" To: cloudstack-issues@incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Resolved] (CLOUDSTACK-4106) [Object_Store_Refactor] Volume creation from the snapshot fails with error Unable to find snapshot OVA file MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CLOUDSTACK-4106?page=3Dcom.atl= assian.jira.plugin.system.issuetabpanels:all-tabpanel ] edison su resolved CLOUDSTACK-4106. ----------------------------------- Resolution: Cannot Reproduce Can you test it on a fresh setup? If you met this issue, means there are ex= siting db entries in the snapshot_store_ref =20 > [Object_Store_Refactor] Volume creation from the snapshot fails with erro= r Unable to find snapshot OVA file > -------------------------------------------------------------------------= ---------------------------------- > > Key: CLOUDSTACK-4106 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-410= 6 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the defa= ult.)=20 > Components: Storage Controller, VMware, Volumes > Affects Versions: 4.2.0 > Environment: Latest build from ACS 4.2 branch > Storage: S3 for secondary storage and ISCSI for primary > Reporter: Sanjeev N > Assignee: edison su > Priority: Blocker > Fix For: 4.2.0 > > Attachments: cloud.dmp, cloud.dmp, management-server.rar, managem= ent-server.rar > > > Volume creation from the snapshot fails with error Unable to find snapsho= t OVA file > Steps to Reproduce: > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > 1.Bring up CS with VMWare cluster using S3 for the secondary storage, ISC= SI for primary and NFS for staging starge. > 2.Deploy guest vm with default cent os template > 3.Take snapshot from the root disk of the vm > 4.Try to create volume from the snapshot > Result: > =3D=3D=3D=3D=3D=3D > 1.Failed to create volume from the snapshot. > 2.An entry was made in volumes table with state Allocated. Upon failure e= ntry should also be deleted from volumes table. > Following is the log snippet during volume creation: > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > 2013-08-06 06:05:03,445 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina= -exec-11:null) submit async job-17 =3D [ 79ca534e-19b6-4a05-8fc6-537611a0cb= 1b ], details: AsyncJobVO {id:17, userId: 2, accountId: 2, sessionKey: null= , instanceType: Volume, instanceId: 9, cmd: org.apache.cloudstack.api.comma= nd.user.volume.CreateVolumeCmd, cmdOriginator: null, cmdInfo: {"id":"9","re= sponse":"json","sessionkey":"foQa9K4dPmYo8uEiAcolaTVR6yI\u003d","cmdEventTy= pe":"VOLUME.CREATE","ctxUserId":"2","snapshotid":"621251e4-3d40-4f86-b35c-b= 6b4008f3639","name":"fromSnap","httpmethod":"GET","_":"1375783491630","ctxA= ccountId":"2","ctxStartEventId":"68"}, cmdVersion: 0, callbackType: 0, call= backAddress: null, status: 0, processStatus: 0, resultCode: 0, result: null= , initMsid: 6615759585382, completeMsid: null, lastUpdated: null, lastPolle= d: null, created: null} > 2013-08-06 06:05:03,448 DEBUG [cloud.api.ApiServlet] (catalina-exec-11:nu= ll) =3D=3D=3DEND=3D=3D=3D 10.146.0.20 -- GET command=3DcreateVolume&respo= nse=3Djson&sessionkey=3DfoQa9K4dPmYo8uEiAcolaTVR6yI%3D&snapshotid=3D621251e= 4-3d40-4f86-b35c-b6b4008f3639&name=3DfromSnap&_=3D1375783491630 > 2013-08-06 06:05:03,450 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Exec= utor-18:job-17 =3D [ 79ca534e-19b6-4a05-8fc6-537611a0cb1b ]) Executing org.= apache.cloudstack.api.command.user.volume.CreateVolumeCmd for job-17 =3D [ = 79ca534e-19b6-4a05-8fc6-537611a0cb1b ] > 2013-08-06 06:05:03,480 DEBUG [storage.allocator.LocalStoragePoolAllocato= r] (Job-Executor-18:job-17 =3D [ 79ca534e-19b6-4a05-8fc6-537611a0cb1b ]) Lo= calStoragePoolAllocator trying to find storage pool to fit the vm > 2013-08-06 06:05:03,480 DEBUG [storage.allocator.ClusterScopeStoragePoolA= llocator] (Job-Executor-18:job-17 =3D [ 79ca534e-19b6-4a05-8fc6-537611a0cb1= b ]) ClusterScopeStoragePoolAllocator looking for storage pool > 2013-08-06 06:05:03,480 DEBUG [storage.allocator.ClusterScopeStoragePoolA= llocator] (Job-Executor-18:job-17 =3D [ 79ca534e-19b6-4a05-8fc6-537611a0cb1= b ]) Looking for pools in dc: 1 pod:1 cluster:null > 2013-08-06 06:05:03,486 DEBUG [storage.allocator.AbstractStoragePoolAlloc= ator] (Job-Executor-18:job-17 =3D [ 79ca534e-19b6-4a05-8fc6-537611a0cb1b ])= Checking if storage pool is suitable, name: null ,poolId: 1 > 2013-08-06 06:05:03,493 DEBUG [cloud.storage.StorageManagerImpl] (Job-Exe= cutor-18:job-17 =3D [ 79ca534e-19b6-4a05-8fc6-537611a0cb1b ]) Checking pool= 1 for storage, totalSize: 93952409600, usedBytes: 4602200064, usedPct: 0.0= 48984375, disable threshold: 0.85 > 2013-08-06 06:05:03,513 DEBUG [cloud.storage.StorageManagerImpl] (Job-Exe= cutor-18:job-17 =3D [ 79ca534e-19b6-4a05-8fc6-537611a0cb1b ]) Checking pool= : 1 for volume allocation [Vol[9|vm=3Dnull|DATADISK]], maxSize : 9395240960= 0, totalAllocatedSize : 1769926656, askingSize : 459320832, allocated disab= le threshold: 0.85 > 2013-08-06 06:05:03,513 DEBUG [storage.allocator.ClusterScopeStoragePoolA= llocator] (Job-Executor-18:job-17 =3D [ 79ca534e-19b6-4a05-8fc6-537611a0cb1= b ]) FirstFitStoragePoolAllocator returning 1 suitable storage pools > 2013-08-06 06:05:03,517 DEBUG [allocator.impl.UserConcentratedAllocator] = (Job-Executor-18:job-17 =3D [ 79ca534e-19b6-4a05-8fc6-537611a0cb1b ]) There= are no pods with enough memory/CPU capacity in zone Adv-vmware > 2013-08-06 06:05:03,556 DEBUG [storage.motion.AncientDataMotionStrategy] = (Job-Executor-18:job-17 =3D [ 79ca534e-19b6-4a05-8fc6-537611a0cb1b ]) copyA= sync inspecting src type SNAPSHOT copyAsync inspecting dest type VOLUME > 2013-08-06 06:05:03,585 DEBUG [storage.motion.AncientDataMotionStrategy] = (Job-Executor-18:job-17 =3D [ 79ca534e-19b6-4a05-8fc6-537611a0cb1b ]) copyA= sync inspecting src type SNAPSHOT copyAsync inspecting dest type SNAPSHOT > 2013-08-06 06:05:03,677 DEBUG [agent.transport.Request] (Job-Executor-18:= job-17 =3D [ 79ca534e-19b6-4a05-8fc6-537611a0cb1b ]) Seq 3-1317535761: Send= ing { Cmd , MgmtId: 6615759585382, via: 3, Ver: v1, Flags: 100011, [{"org.= apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.clouds= tack.storage.to.SnapshotObjectTO":{"path":"snapshots/2/6/a11be62f-4879-494d= -85b3-9bf93ba7fee0.ova","volume":{"uuid":"1a9b0706-cab8-4fb8-9b9b-330efe44c= 18c","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.Pri= maryDataStoreTO":{"uuid":"b845e7d4-562a-3b2d-8e59-b1df565f99e5","id":1,"poo= lType":"VMFS","host":"VMFS datastore: /sanjeev/openFiler","path":"/sanjeev/= openFiler","port":0}},"name":"ROOT-6","size":459320832,"path":"ROOT-6","vol= umeId":6,"vmName":"i-2-6-VM","accountId":2,"format":"OVA","id":6,"hyperviso= rType":"VMware"},"dataStore":{"com.cloud.agent.api.to.S3TO":{"id":7,"uuid":= "575684ac-a5df-4eab-821a-2b7dd214fb86","endPoint":"10.147.29.57:8080","buck= etName":"imagestore","httpsFlag":false,"connectionTimeout":500000,"maxError= Retry":2,"socketTimeout":500000,"created":"Aug 6, 2013 4:56:09 AM","enableR= RS":false}},"vmName":"i-2-6-VM","name":"vm1_ROOT-6_20130806095732","hypervi= sorType":"VMware","id":1}},"destTO":{"org.apache.cloudstack.storage.to.Snap= shotObjectTO":{"path":"snapshots/2/6","volume":{"uuid":"1a9b0706-cab8-4fb8-= 9b9b-330efe44c18c","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.= storage.to.PrimaryDataStoreTO":{"uuid":"b845e7d4-562a-3b2d-8e59-b1df565f99e= 5","id":1,"poolType":"VMFS","host":"VMFS datastore: /sanjeev/openFiler","pa= th":"/sanjeev/openFiler","port":0}},"name":"ROOT-6","size":459320832,"path"= :"ROOT-6","volumeId":6,"vmName":"i-2-6-VM","accountId":2,"format":"OVA","id= ":6,"hypervisorType":"VMware"},"dataStore":{"com.cloud.agent.api.to.NfsTO":= {"_url":"nfs://10.147.28.7/export/home/sanjeev/sec_esx_os","_role":"ImageCa= che"}},"vmName":"i-2-6-VM","name":"vm1_ROOT-6_20130806095732","hypervisorTy= pe":"VMware","id":1}},"executeInSequence":false,"wait":21600}}] } > 2013-08-06 06:05:43,912 DEBUG [agent.transport.Request] (AgentManager-Han= dler-7:null) Seq 3-1317535761: Processing: { Ans: , MgmtId: 6615759585382,= via: 3, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyC= mdAnswer":{"newData":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{= "path":"snapshots/2/6/a11be62f-4879-494d-85b3-9bf93ba7fee0.ova","id":0}},"r= esult":true,"wait":0}}] } > 2013-08-06 06:05:43,912 DEBUG [agent.transport.Request] (Job-Executor-18:= job-17 =3D [ 79ca534e-19b6-4a05-8fc6-537611a0cb1b ]) Seq 3-1317535761: Rece= ived: { Ans: , MgmtId: 6615759585382, via: 3, Ver: v1, Flags: 10, { CopyCm= dAnswer } } > 2013-08-06 06:05:44,082 DEBUG [agent.transport.Request] (Job-Executor-18:= job-17 =3D [ 79ca534e-19b6-4a05-8fc6-537611a0cb1b ]) Seq 3-1317535762: Send= ing { Cmd , MgmtId: 6615759585382, via: 3, Ver: v1, Flags: 100011, [{"org.= apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.clouds= tack.storage.to.SnapshotObjectTO":{"path":"snapshots/2/6/a11be62f-4879-494d= -85b3-9bf93ba7fee0.ova","volume":{"uuid":"1a9b0706-cab8-4fb8-9b9b-330efe44c= 18c","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.Pri= maryDataStoreTO":{"uuid":"b845e7d4-562a-3b2d-8e59-b1df565f99e5","id":1,"poo= lType":"VMFS","host":"VMFS datastore: /sanjeev/openFiler","path":"/sanjeev/= openFiler","port":0}},"name":"ROOT-6","size":459320832,"path":"ROOT-6","vol= umeId":6,"vmName":"i-2-6-VM","accountId":2,"format":"OVA","id":6,"hyperviso= rType":"VMware"},"dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs:/= /10.147.28.7/export/home/sanjeev/sec_esx_os","_role":"ImageCache"}},"vmName= ":"i-2-6-VM","name":"vm1_ROOT-6_20130806095732","hypervisorType":"VMware","= id":1}},"destTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid"= :"5ccce35d-c8fa-4ad8-8884-1adc12f58e28","volumeType":"DATADISK","dataStore"= :{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"b845e7d4-5= 62a-3b2d-8e59-b1df565f99e5","id":1,"poolType":"VMFS","host":"VMFS datastore= : /sanjeev/openFiler","path":"/sanjeev/openFiler","port":0}},"name":"fromSn= ap","size":459320832,"volumeId":9,"accountId":2,"format":"OVA","id":9,"hype= rvisorType":"None"}},"executeInSequence":false,"wait":10800}}] } > 2013-08-06 06:05:44,579 DEBUG [agent.transport.Request] (AgentManager-Han= dler-8:null) Seq 3-1317535762: Processing: { Ans: , MgmtId: 6615759585382,= via: 3, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyC= mdAnswer":{"result":false,"details":"CreateVolumeFromSnapshotCommand except= ion: java.lang.Exception: Unable to find snapshot OVA file at: /mnt/SecStor= age/21ac712e-6690-39a2-9c7b-cc3d5108db5f/snapshots/2/6/a11be62f-4879-494d-8= 5b3-9bf93ba7fee0.ova.ova","wait":0}}] } > 2013-08-06 06:05:44,581 DEBUG [agent.transport.Request] (Job-Executor-18:= job-17 =3D [ 79ca534e-19b6-4a05-8fc6-537611a0cb1b ]) Seq 3-1317535762: Rece= ived: { Ans: , MgmtId: 6615759585382, via: 3, Ver: v1, Flags: 10, { CopyCm= dAnswer } } > 2013-08-06 06:05:44,600 DEBUG [storage.image.BaseImageStoreDriverImpl] (J= ob-Executor-18:job-17 =3D [ 79ca534e-19b6-4a05-8fc6-537611a0cb1b ]) Unable = to destoy SNAPSHOT: 1 > com.cloud.utils.exception.CloudRuntimeException: not implemented yet > at org.apache.cloudstack.storage.endpoint.DefaultEndPointSelector= .select(DefaultEndPointSelector.java:231) > at org.apache.cloudstack.storage.endpoint.DefaultEndPointSelector= .select(DefaultEndPointSelector.java:217) > at org.apache.cloudstack.storage.image.BaseImageStoreDriverImpl.d= eleteAsync(BaseImageStoreDriverImpl.java:238) > at org.apache.cloudstack.storage.image.store.ImageStoreImpl.delet= e(ImageStoreImpl.java:148) > at org.apache.cloudstack.storage.cache.manager.StorageCacheManage= rImpl.deleteCacheObject(StorageCacheManagerImpl.java:258) > at org.apache.cloudstack.storage.motion.AncientDataMotionStrategy= .deleteSnapshotCacheChain(AncientDataMotionStrategy.java:229) > at org.apache.cloudstack.storage.motion.AncientDataMotionStrategy= .copyVolumeFromSnapshot(AncientDataMotionStrategy.java:261) > at org.apache.cloudstack.storage.motion.AncientDataMotionStrategy= .copyAsync(AncientDataMotionStrategy.java:369) > at org.apache.cloudstack.storage.motion.DataMotionServiceImpl.cop= yAsync(DataMotionServiceImpl.java:55) > at org.apache.cloudstack.storage.volume.VolumeServiceImpl.createV= olumeFromSnapshot(VolumeServiceImpl.java:572) > at com.cloud.storage.VolumeManagerImpl.createVolumeFromSnapshot(V= olumeManagerImpl.java:553) > at com.cloud.utils.component.ComponentInstantiationPostProcessor$= InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:12= 5) > at com.cloud.storage.VolumeManagerImpl.createVolumeFromSnapshot(V= olumeManagerImpl.java:603) > at com.cloud.storage.VolumeManagerImpl.createVolume(VolumeManager= Impl.java:1047) > at com.cloud.utils.component.ComponentInstantiationPostProcessor$= InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:12= 5) > at com.cloud.storage.VolumeManagerImpl.createVolume(VolumeManager= Impl.java:183) > at org.apache.cloudstack.api.command.user.volume.CreateVolumeCmd.= execute(CreateVolumeCmd.java:189) > at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158) > at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.= java:531) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.= java:471) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:= 334) > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolEx= ecutor.java:1110) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolE= xecutor.java:603) > at java.lang.Thread.run(Thread.java:679) > 2013-08-06 06:05:44,620 WARN [storage.datastore.ObjectInDataStoreManager= Impl] (Job-Executor-18:job-17 =3D [ 79ca534e-19b6-4a05-8fc6-537611a0cb1b ])= Unsupported data object (VOLUME, org.apache.cloudstack.storage.datastore.P= rimaryDataStoreImpl@3c8f4b49) > 2013-08-06 06:05:44,633 DEBUG [cloud.storage.VolumeManagerImpl] (Job-Exec= utor-18:job-17 =3D [ 79ca534e-19b6-4a05-8fc6-537611a0cb1b ]) Failed to crea= te volume from snapshot:CreateVolumeFromSnapshotCommand exception: java.lan= g.Exception: Unable to find snapshot OVA file at: /mnt/SecStorage/21ac712e-= 6690-39a2-9c7b-cc3d5108db5f/snapshots/2/6/a11be62f-4879-494d-85b3-9bf93ba7f= ee0.ova.ova > 2013-08-06 06:05:44,633 DEBUG [cloud.storage.VolumeManagerImpl] (Job-Exec= utor-18:job-17 =3D [ 79ca534e-19b6-4a05-8fc6-537611a0cb1b ]) Failed to crea= te volume: 9 > com.cloud.utils.exception.CloudRuntimeException: Failed to create volume = from snapshot:CreateVolumeFromSnapshotCommand exception: java.lang.Exceptio= n: Unable to find snapshot OVA file at: /mnt/SecStorage/21ac712e-6690-39a2-= 9c7b-cc3d5108db5f/snapshots/2/6/a11be62f-4879-494d-85b3-9bf93ba7fee0.ova.ov= a > at com.cloud.storage.VolumeManagerImpl.createVolumeFromSnapshot(V= olumeManagerImpl.java:558) > at com.cloud.utils.component.ComponentInstantiationPostProcessor$= InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:12= 5) > at com.cloud.storage.VolumeManagerImpl.createVolumeFromSnapshot(V= olumeManagerImpl.java:603) > at com.cloud.storage.VolumeManagerImpl.createVolume(VolumeManager= Impl.java:1047) > at com.cloud.utils.component.ComponentInstantiationPostProcessor$= InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:12= 5) > at com.cloud.storage.VolumeManagerImpl.createVolume(VolumeManager= Impl.java:183) > at org.apache.cloudstack.api.command.user.volume.CreateVolumeCmd.= execute(CreateVolumeCmd.java:189) > at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158) > at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.= java:531) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.= java:471) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:= 334) > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolEx= ecutor.java:1110) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolE= xecutor.java:603) > at java.lang.Thread.run(Thread.java:679) > 2013-08-06 06:05:44,661 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Exec= utor-18:job-17 =3D [ 79ca534e-19b6-4a05-8fc6-537611a0cb1b ]) Complete async= job-17 =3D [ 79ca534e-19b6-4a05-8fc6-537611a0cb1b ], jobStatus: 2, resultC= ode: 530, result: Error Code: 530 Error text: Failed to create a volume -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrato= rs For more information on JIRA, see: http://www.atlassian.com/software/jira