Return-Path: X-Original-To: apmail-cloudstack-issues-archive@www.apache.org Delivered-To: apmail-cloudstack-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 54F94108ED for ; Thu, 20 Feb 2014 08:24:26 +0000 (UTC) Received: (qmail 75700 invoked by uid 500); 20 Feb 2014 08:24:23 -0000 Delivered-To: apmail-cloudstack-issues-archive@cloudstack.apache.org Received: (qmail 75588 invoked by uid 500); 20 Feb 2014 08:24:22 -0000 Mailing-List: contact issues-help@cloudstack.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cloudstack.apache.org Delivered-To: mailing list issues@cloudstack.apache.org Received: (qmail 75556 invoked by uid 500); 20 Feb 2014 08:24:20 -0000 Delivered-To: apmail-incubator-cloudstack-issues@incubator.apache.org Received: (qmail 75540 invoked by uid 99); 20 Feb 2014 08:24:19 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 20 Feb 2014 08:24:19 +0000 Date: Thu, 20 Feb 2014 08:24:19 +0000 (UTC) From: "praveena palaniswamy (JIRA)" To: cloudstack-issues@incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (CLOUDSTACK-6146) subsequent migration fails as cloud stack renames files after 1st migration MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 praveena palaniswamy created CLOUDSTACK-6146: ------------------------------------------------ Summary: subsequent migration fails as cloud stack renames fil= es after 1st migration Key: CLOUDSTACK-6146 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-6146 Project: CloudStack Issue Type: Bug Security Level: Public (Anyone can view this level - this is the defa= ult.) Affects Versions: 4.3.0 Environment: ESXi 5.5 Reporter: praveena palaniswamy Fix For: 4.3.0 CLoudplatform/Cloudstack, renames the files after first successful migratio= n and therefore, subsequent migration fails. This happens with=20 CloudPlatform 4.3 Hypervisor: ESXi5.5 1.=09File name gets renamed after migration, which inturn fails subsequent = migrations (CLOUDSTACK issue) a.=09Before migration of data disk the contents of VM folder can be seen be= low [root@host148 i-2-3-VM]# ls -l total 40060 -rw-------. 1 root root 3221225472 Feb 13 2014 7868703c4e8345a58d568ece092= baa0e-flat.vmdk -rw-------. 1 root root 518 Feb 13 06:05 7868703c4e8345a58d568ece092= baa0e.vmdk [root@host148 i-2-3-VM]# b.=09After migration, cloudstack renames the file name 7868703c4e8345a58d56= 8ece092baa0e.vmdk to i-2-3-VM_2.vmdk [root@host148 i-2-3-VM]# ls -l total 19072 -rw-------. 1 root root 3221225472 Feb 13 2014 i-2-3-VM_2-flat.vmdk -rw-------. 1 root root 519 Feb 13 2014 i-2-3-VM_2.vmdk [root@host148 i-2-3-VM]# c.=09So when we call the migration for the second time, cloudstack looks fo= r the file =E2=80=9C7868703c4e8345a58d568ece092baa0e.vmdk=E2=80=9D and it d= oes not find it and migration fails. d.=09Be it from netapp to non-netapp, or netapp to netapp, all the subseque= nt migration fails with the following message 2014-02-13 06:17:57,399 ERROR [c.c.h.v.r.VmwareResource] (DirectAgent-415:c= tx-33da787a 10.61.166.68) Catch Exception java.lang.Exception due to java.l= ang.Exception: No such disk device: 7868703c4e8345a58d568ece092baa0e.vmdk java.lang.Exception: No such disk device: 7868703c4e8345a58d568ece092baa0e.= vmdk at com.cloud.hypervisor.vmware.resource.VmwareResource.getVirtualDi= skInfo(VmwareResource.java:4420) at com.cloud.hypervisor.vmware.resource.VmwareResource.execute(Vmwa= reResource.java:4397) at com.cloud.hypervisor.vmware.resource.VmwareResource.executeReque= st(VmwareResource.java:454) at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(Dir= ectAgentAttache.java:216) at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.r= un(ManagedContextRunnable.java:49) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext= $1.call(DefaultManagedContext.java:56) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext= .callWithContext(DefaultManagedContext.java:103) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext= .runWithContext(DefaultManagedContext.java:53) at org.apache.cloudstack.managed.context.ManagedContextRunnable.run= (ManagedContextRunnable.java:46) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.ja= va:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:33= 4) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFuture= Task.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFuture= Task.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExec= utor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe= cutor.java:603) at java.lang.Thread.run(Thread.java:722) 2014-02-13 06:17:57,400 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-415= :ctx-33da787a) Seq 1-2016020265: Response Received: 2014-02-13 06:17:57,401 DEBUG [c.c.a.t.Request] (DirectAgent-415:ctx-33da78= 7a) Seq 1-2016020265: Processing: { Ans: , MgmtId: 52230907924, via: 1, Ve= r: v1, Flags: 110, [{"com.cloud.agent.api.storage.MigrateVolumeAnswer":{"re= sult":false,"details":"Catch Exception java.lang.Exception due to java.lang= .Exception: No such disk device: 7868703c4e8345a58d568ece092baa0e.vmdk","wa= it":0}}] } 2014-02-13 06:17:57,401 DEBUG [c.c.a.t.Request] (Job-Executor-7:ctx-5972265= e ctx-d2079367) Seq 1-2016020265: Received: { Ans: , MgmtId: 52230907924, = via: 1, Ver: v1, Flags: 110, { MigrateVolumeAnswer } } 2014-02-13 06:17:57,401 DEBUG [o.a.c.s.m.AncientDataMotionStrategy] (Job-Ex= ecutor-7:ctx-5972265e ctx-d2079367) copy failed com.cloud.utils.exception.CloudRuntimeException: Failed to migrate volume o= rg.apache.cloudstack.storage.volume.VolumeObject@70240ea0 to storage pool o= rg.apache.cloudstack.storage.datastore.PrimaryDataStoreImpl@4f3c63e4 at org.apache.cloudstack.storage.motion.AncientDataMotionStrategy.m= igrateVolumeToPool(AncientDataMotionStrategy.java:386) at org.apache.cloudstack.storage.motion.AncientDataMotionStrategy.c= opyAsync(AncientDataMotionStrategy.java:421) at org.apache.cloudstack.storage.motion.DataMotionServiceImpl.copyA= sync(DataMotionServiceImpl.java:70) at org.apache.cloudstack.storage.volume.VolumeServiceImpl.migrateVo= lume(VolumeServiceImpl.java:931) at com.cloud.storage.VolumeApiServiceImpl.liveMigrateVolume(VolumeA= piServiceImpl.java:1680) at com.cloud.storage.VolumeApiServiceImpl.orchestrateMigrateVolume(= VolumeApiServiceImpl.java:1666) at com.cloud.storage.VolumeApiServiceImpl.migrateVolume(VolumeApiSe= rviceImpl.java:1622) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessor= Impl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethod= AccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingRef= lection(AopUtils.java:317) at org.springframework.aop.framework.ReflectiveMethodInvocation.inv= okeJoinpoint(ReflectiveMethodInvocation.java:183) at org.springframework.aop.framework.ReflectiveMethodInvocation.proc= eed(ReflectiveMethodInvocation.java:150) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.= invoke(ExposeInvocationInterceptor.java:91) at org.springframework.aop.framework.ReflectiveMethodInvocation.pro= ceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkD= ynamicAopProxy.java:204) at $Proxy196.migrateVolume(Unknown Source) at org.apache.cloudstack.api.command.user.volume.MigrateVolumeCmd.e= xecute(MigrateVolumeCmd.java:103) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161) at com.cloud.api.ApiAsyncJobDispatcher.runJobInContext(ApiAsyncJobD= ispatcher.java:109) at com.cloud.api.ApiAsyncJobDispatcher$1.run(ApiAsyncJobDispatcher.= java:66) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext= $1.call(DefaultManagedContext.java:56) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext= .callWithContext(DefaultManagedContext.java:103) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext= .runWithContext(DefaultManagedContext.java:53) at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher= .java:63) at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.= runInContext(AsyncJobManagerImpl.java:526) at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.r= un(ManagedContextRunnable.java:49) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext= $1.call(DefaultManagedContext.java:56) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext= .callWithContext(DefaultManagedContext.java:103) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext= .runWithContext(DefaultManagedContext.java:53) at org.apache.cloudstack.managed.context.ManagedContextRunnable.run= (ManagedContextRunnable.java:46) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.ja= va:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:33= 4) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExec= utor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe= cutor.java:603) at java.lang.Thread.run(Thread.java:722) -- This message was sent by Atlassian JIRA (v6.1.5#6160)