Mailing-List: contact issues-help@cloudstack.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@cloudstack.apache.org
Date: Wed, 14 Aug 2013 08:51:49 +0000 (UTC)
From: "Sanjeev N (JIRA)" <jira@apache.org>
To: cloudstack-issues@incubator.apache.org
Message-ID: <JIRA.12659051.1374486114782.63053.1376470309510@arcas>
In-Reply-To: <JIRA.12659051.1374486114782@arcas>
References: <JIRA.12659051.1374486114782@arcas>
Subject: [jira] [Closed] (CLOUDSTACK-3707) [Object_Store_Refactor] Failed to
 extract volume using local storage as primary and S3 as secondary storage
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable


     [ https://issues.apache.org/jira/browse/CLOUDSTACK-3707?page=3Dcom.atl=
assian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sanjeev N closed CLOUDSTACK-3707.
---------------------------------


Verified with latest build. Works fine.
               =20
> [Object_Store_Refactor] Failed to extract volume using local storage as p=
rimary and S3 as secondary storage
> -------------------------------------------------------------------------=
----------------------------------
>
>                 Key: CLOUDSTACK-3707
>                 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-370=
7
>             Project: CloudStack
>          Issue Type: Bug
>      Security Level: Public(Anyone can view this level - this is the defa=
ult.)=20
>          Components: Storage Controller, Volumes
>    Affects Versions: 4.2.0
>         Environment: Latest build from ACS 4.2  branch.
> Cluster: KVM
> Storage: S3 for secondary and Local for Primary
>            Reporter: Sanjeev N
>            Assignee: Min Chen
>            Priority: Critical
>             Fix For: 4.2.0
>
>         Attachments: cloud.dmp, management-server.rar, management-server.=
rar
>
>
> [Object_Store_Refactor] Failed to extract volume using local storage as p=
rimary and S3 as secondary storage
> Steps to Reproduce:
> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
> 1.Bring up CS in advanced zone with kvm cluster
> 2.Use s3 for the secondary storage and Local storage for Primary
> 3.Deploy a guest vm
> 4.Create a custom disk offering with type Local and create a data disk us=
ing it
> 5.Bring the data disk to ready state (Attach to and detach from the vm)
> 6.Now try to download the voluem
> Observations:
> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
> Download volume failed but UI prompted with URL to download the volume.
> Did not find volume either in Cache Storage or in S3 bucket .
> Following is the log snippet from management server log file:
> 2013-07-22 05:29:07,126 DEBUG [cloud.api.ApiServlet] (catalina-exec-2:nul=
l) =3D=3D=3DSTART=3D=3D=3D  10.146.0.20 -- GET  command=3DextractVolume&id=
=3D51a52b74-a6c0-4ee1-9508-07accf4c0eb6&zoneid=3D95fa0404-76ef-450b-b919-02=
b41134fb0b&mode=3DHTTP_DOWNLOAD&response=3Djson&sessionkey=3DjZa5Sz7FdnclZT=
ONr7andJxhx%2Bs%3D&_=3D1374485347356
> 2013-07-22 05:29:07,273 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina=
-exec-2:null) submit async job-27 =3D [ cdb6535d-fc7d-46c5-8a22-8533aac4c17=
1 ], details: AsyncJobVO {id:27, userId: 2, accountId: 2, sessionKey: null,=
 instanceType: Volume, instanceId: 9, cmd: org.apache.cloudstack.api.comman=
d.user.volume.ExtractVolumeCmd, cmdOriginator: null, cmdInfo: {"response":"=
json","id":"51a52b74-a6c0-4ee1-9508-07accf4c0eb6","sessionkey":"jZa5Sz7Fdnc=
lZTONr7andJxhx+s\u003d","cmdEventType":"VOLUME.EXTRACT","ctxUserId":"2","zo=
neid":"95fa0404-76ef-450b-b919-02b41134fb0b","httpmethod":"GET","_":"137448=
5347356","ctxAccountId":"2","ctxStartEventId":"111","mode":"HTTP_DOWNLOAD"}=
, cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0, process=
Status: 0, resultCode: 0, result: null, initMsid: 6615759585382, completeMs=
id: null, lastUpdated: null, lastPolled: null, created: null}
> 2013-07-22 05:29:07,276 DEBUG [cloud.api.ApiServlet] (catalina-exec-2:nul=
l) =3D=3D=3DEND=3D=3D=3D  10.146.0.20 -- GET  command=3DextractVolume&id=3D=
51a52b74-a6c0-4ee1-9508-07accf4c0eb6&zoneid=3D95fa0404-76ef-450b-b919-02b41=
134fb0b&mode=3DHTTP_DOWNLOAD&response=3Djson&sessionkey=3DjZa5Sz7FdnclZTONr=
7andJxhx%2Bs%3D&_=3D1374485347356
> 2013-07-22 05:29:07,279 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Exec=
utor-20:job-27 =3D [ cdb6535d-fc7d-46c5-8a22-8533aac4c171 ]) Executing org.=
apache.cloudstack.api.command.user.volume.ExtractVolumeCmd for job-27 =3D [=
 cdb6535d-fc7d-46c5-8a22-8533aac4c171 ]
> 2013-07-22 05:29:07,345 DEBUG [storage.motion.AncientDataMotionStrategy] =
(Job-Executor-20:job-27 =3D [ cdb6535d-fc7d-46c5-8a22-8533aac4c171 ]) copyA=
sync inspecting src type VOLUME copyAsync inspecting dest type VOLUME
> 2013-07-22 05:29:07,353 DEBUG [storage.motion.AncientDataMotionStrategy] =
(Job-Executor-20:job-27 =3D [ cdb6535d-fc7d-46c5-8a22-8533aac4c171 ]) needC=
acheStorage true, dest at volumes/2/9 dest role Image26d98086-58b4-461c-9fe=
e-c47c9bd1f565 src role Primary
> 2013-07-22 05:29:07,374 DEBUG [storage.motion.AncientDataMotionStrategy] =
(Job-Executor-20:job-27 =3D [ cdb6535d-fc7d-46c5-8a22-8533aac4c171 ]) copyA=
sync inspecting src type VOLUME copyAsync inspecting dest type VOLUME
> 2013-07-22 05:29:07,387 DEBUG [agent.manager.AgentAttache] (Job-Executor-=
20:job-27 =3D [ cdb6535d-fc7d-46c5-8a22-8533aac4c171 ]) Request seq: 108101=
6695
> 2013-07-22 05:29:07,388 DEBUG [agent.manager.AgentAttache] (Job-Executor-=
20:job-27 =3D [ cdb6535d-fc7d-46c5-8a22-8533aac4c171 ]) waiting to send 108=
1016695
> 2013-07-22 05:29:07,388 DEBUG [agent.manager.AgentAttache] (Job-Executor-=
20:job-27 =3D [ cdb6535d-fc7d-46c5-8a22-8533aac4c171 ]) entering synchroniz=
e block for sending 1081016695
> 2013-07-22 05:29:07,389 DEBUG [agent.transport.Request] (Job-Executor-20:=
job-27 =3D [ cdb6535d-fc7d-46c5-8a22-8533aac4c171 ]) Seq 1-1081016695: Send=
ing  { Cmd , MgmtId: 6615759585382, via: 1, Ver: v1, Flags: 100011, [{"org.=
apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.clouds=
tack.storage.to.VolumeObjectTO":{"uuid":"51a52b74-a6c0-4ee1-9508-07accf4c0e=
b6","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.=
PrimaryDataStoreTO":{"uuid":"41bebe55-fa87-4581-b93a-7aeda2e9afd4","id":1,"=
poolType":"Filesystem","host":"10.147.40.14","path":"/var/lib/libvirt/image=
s","port":0}},"name":"local","size":0,"path":"26d98086-58b4-461c-9fee-c47c9=
bd1f565","volumeId":9,"accountId":2,"format":"QCOW2","id":9}},"destTO":{"or=
g.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"51a52b74-a6c0-4ee1-=
9508-07accf4c0eb6","volumeType":"DATADISK","dataStore":{"com.cloud.agent.ap=
i.to.NfsTO":{"_url":"nfs://10.147.28.7/export/home/sanjeev/sec_kvm_os","_ro=
le":"ImageCache"}},"name":"local","size":0,"path":"volumes/2/9","volumeId":=
9,"accountId":2,"format":"QCOW2","id":9}},"executeInSequence":false,"wait":=
10800}}] }
> 2013-07-22 05:29:07,395 DEBUG [agent.transport.Request] (AgentManager-Han=
dler-6:null) Seq 1-1081016695: Processing:  { Ans: , MgmtId: 6615759585382,=
 via: 1, Ver: v1, Flags: 10, [{"com.cloud.agent.api.UnsupportedAnswer":{"re=
sult":false,"details":"Unsupported command issued:org.apache.cloudstack.sto=
rage.command.CopyCommand.  Are you sure you got the right type of server?",=
"wait":0}}] }
> 2013-07-22 05:29:07,395 DEBUG [agent.transport.Request] (Job-Executor-20:=
job-27 =3D [ cdb6535d-fc7d-46c5-8a22-8533aac4c171 ]) Seq 1-1081016695: Rece=
ived:  { Ans: , MgmtId: 6615759585382, via: 1, Ver: v1, Flags: 10, { Unsupp=
ortedAnswer } }
> 2013-07-22 05:29:07,395 WARN  [agent.manager.AgentManagerImpl] (Job-Execu=
tor-20:job-27 =3D [ cdb6535d-fc7d-46c5-8a22-8533aac4c171 ]) Unsupported Com=
mand: Unsupported command issued:org.apache.cloudstack.storage.command.Copy=
Command.  Are you sure you got the right type of server?
> 2013-07-22 05:29:07,408 DEBUG [storage.motion.AncientDataMotionStrategy] =
(Job-Executor-20:job-27 =3D [ cdb6535d-fc7d-46c5-8a22-8533aac4c171 ]) copy =
object failed: java.lang.NullPointerException
> 2013-07-22 05:29:07,408 DEBUG [storage.motion.AncientDataMotionStrategy] =
(Job-Executor-20:job-27 =3D [ cdb6535d-fc7d-46c5-8a22-8533aac4c171 ]) copy =
failed
> com.cloud.utils.exception.CloudRuntimeException: java.lang.NullPointerExc=
eption
>         at org.apache.cloudstack.storage.motion.AncientDataMotionStrategy=
.copyObject(AncientDataMotionStrategy.java:207)
>         at org.apache.cloudstack.storage.motion.AncientDataMotionStrategy=
.copyAsync(AncientDataMotionStrategy.java:354)
>         at org.apache.cloudstack.storage.motion.DataMotionServiceImpl.cop=
yAsync(DataMotionServiceImpl.java:55)
>         at org.apache.cloudstack.storage.volume.VolumeServiceImpl.copyVol=
umeFromPrimaryToImage(VolumeServiceImpl.java:682)
>         at org.apache.cloudstack.storage.volume.VolumeServiceImpl.copyVol=
ume(VolumeServiceImpl.java:729)
>         at com.cloud.storage.VolumeManagerImpl.extractVolume(VolumeManage=
rImpl.java:2780)
>         at com.cloud.utils.component.ComponentInstantiationPostProcessor$=
InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:12=
5)
>         at org.apache.cloudstack.api.command.user.volume.ExtractVolumeCmd=
.execute(ExtractVolumeCmd.java:130)
>         at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
>         at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.=
java:531)
>         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.=
java:471)
>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:=
334)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolEx=
ecutor.java:1110)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolE=
xecutor.java:603)
>         at java.lang.Thread.run(Thread.java:679)
> 2013-07-22 05:29:07,434 INFO  [datastore.driver.S3ImageStoreDriverImpl] (=
Job-Executor-20:job-27 =3D [ cdb6535d-fc7d-46c5-8a22-8533aac4c171 ]) Genera=
ting pre-signed s3 entity extraction URL.
> 2013-07-22 05:29:07,435 DEBUG [cloud.utils.S3Utils] (Job-Executor-20:job-=
27 =3D [ cdb6535d-fc7d-46c5-8a22-8533aac4c171 ]) Creating S3 client with co=
nfiguration: [protocol: http, connectionTimeOut: 50000, maxErrorRetry: 3, s=
ocketTimeout: 50000]
> 2013-07-22 05:29:07,444 DEBUG [cloud.utils.S3Utils] (Job-Executor-20:job-=
27 =3D [ cdb6535d-fc7d-46c5-8a22-8533aac4c171 ]) Setting the end point for =
S3 client com.amazonaws.services.s3.AmazonS3Client@c8eb2a6 to 10.147.29.57:=
8080.
> 2013-07-22 05:29:07,445 INFO  [datastore.driver.S3ImageStoreDriverImpl] (=
Job-Executor-20:job-27 =3D [ cdb6535d-fc7d-46c5-8a22-8533aac4c171 ]) Pre-Si=
gned URL =3D http://10.147.29.57:8080/imagestore/volumes%2F2%2F9?Expires=3D=
1374488947&AWSAccessKeyId=3D9M7I6JPYZHDNLG43TWCD&Signature=3DZZF%2BOx4Y5JDZ=
EGGnPxdM4Mu1Qzc%3D
> 2013-07-22 05:29:07,460 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Exec=
utor-20:job-27 =3D [ cdb6535d-fc7d-46c5-8a22-8533aac4c171 ]) Complete async=
 job-27 =3D [ cdb6535d-fc7d-46c5-8a22-8533aac4c171 ], jobStatus: 1, resultC=
ode: 0, result: org.apache.cloudstack.api.response.ExtractResponse@541ab121
> 2013-07-22 05:29:07,466 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Exec=
utor-20:job-27 =3D [ cdb6535d-fc7d-46c5-8a22-8533aac4c171 ]) Done executing=
 org.apache.cloudstack.api.command.user.volume.ExtractVolumeCmd for job-27 =
=3D [ cdb6535d-fc7d-46c5-8a22-8533aac4c171 ]

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrato=
rs
For more information on JIRA, see: http://www.atlassian.com/software/jira