Return-Path: X-Original-To: apmail-cloudstack-issues-archive@www.apache.org Delivered-To: apmail-cloudstack-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id DB06F100F3 for ; Fri, 30 Aug 2013 22:04:51 +0000 (UTC) Received: (qmail 96939 invoked by uid 500); 30 Aug 2013 22:04:51 -0000 Delivered-To: apmail-cloudstack-issues-archive@cloudstack.apache.org Received: (qmail 96922 invoked by uid 500); 30 Aug 2013 22:04:51 -0000 Mailing-List: contact issues-help@cloudstack.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cloudstack.apache.org Delivered-To: mailing list issues@cloudstack.apache.org Received: (qmail 96907 invoked by uid 500); 30 Aug 2013 22:04:51 -0000 Delivered-To: apmail-incubator-cloudstack-issues@incubator.apache.org Received: (qmail 96898 invoked by uid 99); 30 Aug 2013 22:04:51 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 30 Aug 2013 22:04:51 +0000 Date: Fri, 30 Aug 2013 22:04:51 +0000 (UTC) From: "Parth Jagirdar (JIRA)" To: cloudstack-issues@incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (CLOUDSTACK-4190) [Object_store_refactor] volume should be deleted from staging storage after successfule volume migration MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CLOUDSTACK-4190?page=3Dcom.atla= ssian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId= =3D13755185#comment-13755185 ]=20 Parth Jagirdar commented on CLOUDSTACK-4190: -------------------------------------------- For Vmware, we have several places that didn't thoroughly clean up object i= n NFS staging area, which needs a generic approach to clean up staging area= object. Can be done in post 4.2.0. =20 > [Object_store_refactor] volume should be deleted from staging storage aft= er successfule volume migration > -------------------------------------------------------------------------= ------------------------------- > > Key: CLOUDSTACK-4190 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-419= 0 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the defa= ult.)=20 > Components: Storage Controller, Volumes > Affects Versions: 4.2.0 > Environment: Latest build from ACS 4.2 branch > Storage: S3 for image store, NFS for secondary staging and primary storag= e > Reporter: Sanjeev N > Assignee: Min Chen > Priority: Critical > Fix For: 4.2.0 > > Attachments: cloud.dmp, cloud.dmp, cloud.rar, management-server.r= ar, management-server.rar > > > volume copied to secondary staging storage during volume migration should= be deleted after migration. > Steps to Reproduce: > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > 1.Bring up CS with xen cluster using S3 from image store, NFS for seconda= ry staging and primary storage > 2.Deploy guest vm using default cent os template with both Root and Data = disks. > 3.Add another NFS based primary storage to the cluster=20 > 4.Detach data disk from the vm > 5.Migrate the data disk to the primary storage created at step3 > Result: > =3D=3D=3D=3D=3D=3D > Volume migration was successful. But the volume copied to secondary stagi= ng storage during migration process did not get deleted. > Only volume from source primary storage got deleted. > Observations: > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > Following is the log snippet during volume migration: > 2013-08-08 08:34:49,766 DEBUG [cloud.api.ApiServlet] (catalina-exec-13:nu= ll) =3D=3D=3DSTART=3D=3D=3D 10.146.0.20 -- GET command=3DmigrateVolume&st= orageid=3D29a0c990-7100-3a8d-b570-ba9f84ca78bc&volumeid=3De1eb0b93-3fba-443= 7-ad50-b12bf1d6f1ef&response=3Djson&sessionkey=3DqXfe5TLEOA5koD0qobFirCKKbO= Y%3D&_=3D1375965252817 > 2013-08-08 08:34:49,954 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina= -exec-13:null) submit async job-44 =3D [ 3c1fd226-af63-47fe-9a5c-fc4770f1a6= f5 ], details: AsyncJobVO {id:44, userId: 2, accountId: 2, sessionKey: null= , instanceType: None, instanceId: null, cmd: org.apache.cloudstack.api.comm= and.user.volume.MigrateVolumeCmd, cmdOriginator: null, cmdInfo: {"response"= :"json","sessionkey":"qXfe5TLEOA5koD0qobFirCKKbOY\u003d","cmdEventType":"VO= LUME.MIGRATE","ctxUserId":"2","storageid":"29a0c990-7100-3a8d-b570-ba9f84ca= 78bc","httpmethod":"GET","volumeid":"e1eb0b93-3fba-4437-ad50-b12bf1d6f1ef",= "_":"1375965252817","ctxAccountId":"2","ctxStartEventId":"194"}, cmdVersion= : 0, callbackType: 0, callbackAddress: null, status: 0, processStatus: 0, r= esultCode: 0, result: null, initMsid: 6615759585382, completeMsid: null, la= stUpdated: null, lastPolled: null, created: null} > 2013-08-08 08:34:49,957 DEBUG [cloud.api.ApiServlet] (catalina-exec-13:nu= ll) =3D=3D=3DEND=3D=3D=3D 10.146.0.20 -- GET command=3DmigrateVolume&stor= ageid=3D29a0c990-7100-3a8d-b570-ba9f84ca78bc&volumeid=3De1eb0b93-3fba-4437-= ad50-b12bf1d6f1ef&response=3Djson&sessionkey=3DqXfe5TLEOA5koD0qobFirCKKbOY%= 3D&_=3D1375965252817 > 2013-08-08 08:34:49,961 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Exec= utor-45:job-44 =3D [ 3c1fd226-af63-47fe-9a5c-fc4770f1a6f5 ]) Executing org.= apache.cloudstack.api.command.user.volume.MigrateVolumeCmd for job-44 =3D [= 3c1fd226-af63-47fe-9a5c-fc4770f1a6f5 ] > 2013-08-08 08:34:50,032 DEBUG [storage.motion.AncientDataMotionStrategy] = (Job-Executor-45:job-44 =3D [ 3c1fd226-af63-47fe-9a5c-fc4770f1a6f5 ]) copyA= sync inspecting src type VOLUME copyAsync inspecting dest type VOLUME > 2013-08-08 08:34:50,061 DEBUG [storage.motion.AncientDataMotionStrategy] = (Job-Executor-45:job-44 =3D [ 3c1fd226-af63-47fe-9a5c-fc4770f1a6f5 ]) copyA= sync inspecting src type VOLUME copyAsync inspecting dest type VOLUME > 2013-08-08 08:34:50,083 DEBUG [agent.transport.Request] (Job-Executor-45:= job-44 =3D [ 3c1fd226-af63-47fe-9a5c-fc4770f1a6f5 ]) Seq 2-1303576995: Send= ing { Cmd , MgmtId: 6615759585382, via: 2, Ver: v1, Flags: 100011, [{"org.= apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.clouds= tack.storage.to.VolumeObjectTO":{"uuid":"e1eb0b93-3fba-4437-ad50-b12bf1d6f1= ef","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.= PrimaryDataStoreTO":{"uuid":"c65a038a-750c-3b4f-bf26-7ce3b74e1c85","id":3,"= poolType":"NetworkFilesystem","host":"10.147.28.7","path":"/export/home/san= jeev/pri_xen_os","port":2049}},"name":"cs-3416","size":5368709120,"path":"5= a436a4d-5758-4699-b4d1-7276e1ceb4e5","volumeId":14,"accountId":2,"format":"= VHD","id":14,"hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstac= k.storage.to.VolumeObjectTO":{"uuid":"e1eb0b93-3fba-4437-ad50-b12bf1d6f1ef"= ,"volumeType":"DATADISK","dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url= ":"nfs://10.147.28.7/export/home/sanjeev/sec_xen_os","_role":"ImageCache"}}= ,"name":"cs-3416","size":5368709120,"path":"volumes/2/14","volumeId":14,"ac= countId":2,"format":"VHD","id":14,"hypervisorType":"XenServer"}},"executeIn= Sequence":false,"wait":10800}}] } > 2013-08-08 08:34:50,085 DEBUG [agent.transport.Request] (Job-Executor-45:= job-44 =3D [ 3c1fd226-af63-47fe-9a5c-fc4770f1a6f5 ]) Seq 2-1303576995: Exec= uting: { Cmd , MgmtId: 6615759585382, via: 2, Ver: v1, Flags: 100011, [{"o= rg.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.clo= udstack.storage.to.VolumeObjectTO":{"uuid":"e1eb0b93-3fba-4437-ad50-b12bf1d= 6f1ef","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.= to.PrimaryDataStoreTO":{"uuid":"c65a038a-750c-3b4f-bf26-7ce3b74e1c85","id":= 3,"poolType":"NetworkFilesystem","host":"10.147.28.7","path":"/export/home/= sanjeev/pri_xen_os","port":2049}},"name":"cs-3416","size":5368709120,"path"= :"5a436a4d-5758-4699-b4d1-7276e1ceb4e5","volumeId":14,"accountId":2,"format= ":"VHD","id":14,"hypervisorType":"XenServer"}},"destTO":{"org.apache.clouds= tack.storage.to.VolumeObjectTO":{"uuid":"e1eb0b93-3fba-4437-ad50-b12bf1d6f1= ef","volumeType":"DATADISK","dataStore":{"com.cloud.agent.api.to.NfsTO":{"_= url":"nfs://10.147.28.7/export/home/sanjeev/sec_xen_os","_role":"ImageCache= "}},"name":"cs-3416","size":5368709120,"path":"volumes/2/14","volumeId":14,= "accountId":2,"format":"VHD","id":14,"hypervisorType":"XenServer"}},"execut= eInSequence":false,"wait":10800}}] } > 2013-08-08 08:35:20,118 DEBUG [cloud.api.ApiServlet] (catalina-exec-10:nu= ll) =3D=3D=3DSTART=3D=3D=3D 10.146.0.20 -- GET command=3DqueryAsyncJobRes= ult&jobId=3D3c1fd226-af63-47fe-9a5c-fc4770f1a6f5&response=3Djson&sessionkey= =3DqXfe5TLEOA5koD0qobFirCKKbOY%3D&_=3D1375965283221 > 2013-08-08 08:35:20,246 DEBUG [cloud.api.ApiServlet] (catalina-exec-10:nu= ll) =3D=3D=3DEND=3D=3D=3D 10.146.0.20 -- GET command=3DqueryAsyncJobResul= t&jobId=3D3c1fd226-af63-47fe-9a5c-fc4770f1a6f5&response=3Djson&sessionkey= =3DqXfe5TLEOA5koD0qobFirCKKbOY%3D&_=3D1375965283221 > 2013-08-08 08:35:20,676 DEBUG [agent.manager.DirectAgentAttache] (DirectA= gent-79:null) Seq 2-1303576999: Response Received: > 2013-08-08 08:35:20,676 DEBUG [agent.transport.Request] (DirectAgent-79:n= ull) Seq 2-1303576999: Processing: { Ans: , MgmtId: 6615759585382, via: 2,= Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer= ":{"newData":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"size":536= 8709120,"path":"5a6f328e-cb37-447d-90e9-eb3efaa4e0db","accountId":0,"id":0}= },"result":true,"wait":0}}] } > 2013-08-08 08:35:20,677 DEBUG [agent.transport.Request] (Job-Executor-45:= job-44 =3D [ 3c1fd226-af63-47fe-9a5c-fc4770f1a6f5 ]) Seq 2-1303576999: Rece= ived: { Ans: , MgmtId: 6615759585382, via: 2, Ver: v1, Flags: 10, { CopyCm= dAnswer } } > 2013-08-08 08:35:20,778 DEBUG [agent.transport.Request] (Job-Executor-45:= job-44 =3D [ 3c1fd226-af63-47fe-9a5c-fc4770f1a6f5 ]) Seq 2-1303577000: Send= ing { Cmd , MgmtId: 6615759585382, via: 2, Ver: v1, Flags: 100011, [{"org.= apache.cloudstack.storage.command.DeleteCommand":{"data":{"org.apache.cloud= stack.storage.to.VolumeObjectTO":{"uuid":"e1eb0b93-3fba-4437-ad50-b12bf1d6f= 1ef","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to= .PrimaryDataStoreTO":{"uuid":"c65a038a-750c-3b4f-bf26-7ce3b74e1c85","id":3,= "poolType":"NetworkFilesystem","host":"10.147.28.7","path":"/export/home/sa= njeev/pri_xen_os","port":2049}},"name":"cs-3416","size":5368709120,"path":"= 5a436a4d-5758-4699-b4d1-7276e1ceb4e5","volumeId":14,"accountId":2,"format":= "VHD","id":14,"hypervisorType":"XenServer"}},"wait":0}}] } > 2013-08-08 08:35:20,779 DEBUG [agent.transport.Request] (Job-Executor-45:= job-44 =3D [ 3c1fd226-af63-47fe-9a5c-fc4770f1a6f5 ]) Seq 2-1303577000: Exec= uting: { Cmd , MgmtId: 6615759585382, via: 2, Ver: v1, Flags: 100011, [{"o= rg.apache.cloudstack.storage.command.DeleteCommand":{"data":{"org.apache.cl= oudstack.storage.to.VolumeObjectTO":{"uuid":"e1eb0b93-3fba-4437-ad50-b12bf1= d6f1ef","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage= .to.PrimaryDataStoreTO":{"uuid":"c65a038a-750c-3b4f-bf26-7ce3b74e1c85","id"= :3,"poolType":"NetworkFilesystem","host":"10.147.28.7","path":"/export/home= /sanjeev/pri_xen_os","port":2049}},"name":"cs-3416","size":5368709120,"path= ":"5a436a4d-5758-4699-b4d1-7276e1ceb4e5","volumeId":14,"accountId":2,"forma= t":"VHD","id":14,"hypervisorType":"XenServer"}},"wait":0}}] } > 2013-08-08 08:35:20,780 DEBUG [agent.manager.DirectAgentAttache] (DirectA= gent-90:null) Seq 2-1303577000: Executing request > 2013-08-08 08:35:21,440 DEBUG [agent.manager.DirectAgentAttache] (DirectA= gent-90:null) Seq 2-1303577000: Response Received: > 2013-08-08 08:35:21,441 DEBUG [agent.transport.Request] (DirectAgent-90:n= ull) Seq 2-1303577000: Processing: { Ans: , MgmtId: 6615759585382, via: 2,= Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0= }}] } > 2013-08-08 08:35:21,441 DEBUG [agent.transport.Request] (Job-Executor-45:= job-44 =3D [ 3c1fd226-af63-47fe-9a5c-fc4770f1a6f5 ]) Seq 2-1303577000: Rece= ived: { Ans: , MgmtId: 6615759585382, via: 2, Ver: v1, Flags: 10, { Answer= } } > 2013-08-08 08:35:21,562 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Exec= utor-45:job-44 =3D [ 3c1fd226-af63-47fe-9a5c-fc4770f1a6f5 ]) Complete async= job-44 =3D [ 3c1fd226-af63-47fe-9a5c-fc4770f1a6f5 ], jobStatus: 1, resultC= ode: 0, result: org.apache.cloudstack.api.response.VolumeResponse@388699b5 > 2013-08-08 08:35:21,578 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Exec= utor-45:job-44 =3D [ 3c1fd226-af63-47fe-9a5c-fc4770f1a6f5 ]) Done executing= org.apache.cloudstack.api.command.user.volume.MigrateVolumeCmd for job-44 = =3D [ 3c1fd226-af63-47fe-9a5c-fc4770f1a6f5 ] > 2013-08-08 08:35:23,171 DEBUG [cloud.api.ApiServlet] (catalina-exec-14:nu= ll) =3D=3D=3DSTART=3D=3D=3D 10.146.0.20 -- GET command=3DqueryAsyncJobRes= ult&jobId=3D3c1fd226-af63-47fe-9a5c-fc4770f1a6f5&response=3Djson&sessionkey= =3DqXfe5TLEOA5koD0qobFirCKKbOY%3D&_=3D1375965286243 > 2013-08-08 08:35:23,199 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina= -exec-14:null) Async job-44 =3D [ 3c1fd226-af63-47fe-9a5c-fc4770f1a6f5 ] co= mpleted > During volume migration process, an entry will be made in volume_store_re= f table with install_path points to the volume location in the secondary st= aging storage. > Attaching management server log file and cloud DB. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrato= rs For more information on JIRA, see: http://www.atlassian.com/software/jira