cloudstack-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Min Chen <min.c...@citrix.com>
Subject Re: S3 Secondary Storage fails with large files
Date Wed, 30 Oct 2013 16:40:48 GMT
For 4.2.0, you should be able to register template > 5GB. But we are aware
of an issue you mentioned here: backup snapshot > 5GB will fail since that
part of code is still using S3 single part upload api. This bug has been
fixed in latest 4.2 branch, and will be available in 4.2.1 release.

Thanks
-min

On 10/30/13 9:18 AM, "Andrei Mikhailovsky" <andrei@arhont.com> wrote:

>Hello Guys , 
>
>I am using ACS 4.2.0 with KVM hypervisor. While trying to create
>templates and snapshots from the existing vms I am getting an error
>message / exception on the management logs:
>
>2013-10-30 13:29:07,264 DEBUG [storage.snapshot.SnapshotManagerImpl]
>(Job-Executor-12:job-41 = [ 85659739-df2e-4afe-b638-2d25e804063f ])
>Failed to create snapshot
>com.cloud.utils.exception.CloudRuntimeException: Status Code: 400, AWS
>Service: Amazon S3, AWS Request ID: null, AWS Error Code: EntityTooLarge,
>AWS Error Message: null, S3 Extended Request ID: null
>at 
>com.amazonaws.http.AmazonHttpClient.handleErrorResponse(AmazonHttpClient.j
>ava:610) 
>at 
>com.amazonaws.http.AmazonHttpClient.executeHelper(AmazonHttpClient.java:31
>0) 
>at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:164)
>at 
>com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:2906)
>at 
>com.amazonaws.services.s3.AmazonS3Client.putObject(AmazonS3Client.java:112
>3) 
>at 
>com.amazonaws.services.s3.AmazonS3Client.putObject(AmazonS3Client.java:979
>) 
>at com.cloud.utils.S3Utils.putFile(S3Utils.java:143)
>at 
>com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.copyToS3(KVMStoragePr
>ocessor.java:556) 
>at 
>com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.copyToObjectStore(KVM
>StorageProcessor.java:582)
>at 
>com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.backupSnapshotForObje
>ctStore(KVMStorageProcessor.java:622)
>at 
>com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.backupSnapshot(KVMSto
>rageProcessor.java:634)
>at 
>com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(Stor
>ageSubsystemCommandHandlerBase.java:84)
>at 
>com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorag
>eCommands(StorageSubsystemCommandHandlerBase.java:49)
>at 
>com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(
>LibvirtComputingResource.java:1286)
>at com.cloud.agent.Agent.processRequest(Agent.java:525)
>at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:852)
>at com.cloud.utils.nio.Task.run(Task.java:83)
>at 
>java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
>1146) 
>at 
>java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java
>:615) 
>at java.lang.Thread.run(Thread.java:679)
>
>at 
>org.apache.cloudstack.storage.snapshot.SnapshotServiceImpl.backupSnapshot(
>SnapshotServiceImpl.java:280)
>at 
>org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.backupSna
>pshot(XenserverSnapshotStrategy.java:138)
>at 
>org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.takeSnaps
>hot(XenserverSnapshotStrategy.java:264)
>at 
>com.cloud.storage.snapshot.SnapshotManagerImpl.takeSnapshot(SnapshotManage
>rImpl.java:1013) 
>at 
>com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorD
>ispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>at 
>org.apache.cloudstack.storage.volume.VolumeServiceImpl.takeSnapshot(Volume
>ServiceImpl.java:1307)
>at 
>com.cloud.storage.VolumeManagerImpl.takeSnapshot(VolumeManagerImpl.java:27
>19) 
>at 
>org.apache.cloudstack.api.command.user.snapshot.CreateSnapshotCmd.execute(
>CreateSnapshotCmd.java:170)
>at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
>at 
>com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
>at 
>java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>at 
>java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
>1146) 
>at 
>java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java
>:615) 
>at java.lang.Thread.run(Thread.java:679)
>2013-10-30 13:29:07,270 DEBUG [storage.volume.VolumeServiceImpl]
>(Job-Executor-12:job-41 = [ 85659739-df2e-4afe-b638-2d25e804063f ]) Take
>snapshot: 41 failed
>com.cloud.utils.exception.CloudRuntimeException: Failed to create
>snapshot 
>at 
>com.cloud.storage.snapshot.SnapshotManagerImpl.takeSnapshot(SnapshotManage
>rImpl.java:1040) 
>at 
>com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorD
>ispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>at 
>org.apache.cloudstack.storage.volume.VolumeServiceImpl.takeSnapshot(Volume
>ServiceImpl.java:1307)
>at 
>com.cloud.storage.VolumeManagerImpl.takeSnapshot(VolumeManagerImpl.java:27
>19) 
>at 
>org.apache.cloudstack.api.command.user.snapshot.CreateSnapshotCmd.execute(
>CreateSnapshotCmd.java:170)
>at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
>at 
>com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
>at 
>java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>at 
>java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
>1146) 
>at 
>java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java
>:615) 
>at java.lang.Thread.run(Thread.java:679)
>Caused by: com.cloud.utils.exception.CloudRuntimeException: Status Code:
>400, AWS Service: Amazon S3, AWS Request ID: null, AWS Error Code:
>EntityTooLarge, AWS Error Message: null, S3 Extended Request ID: null
>
>
>Does anyone know how to resolve this problem? I can upload files up to
>5GB in size. Anything over that fails.
>
>Thanks for help 
>
>Andrei 
>


Mime
View raw message