cloudstack-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tanner Danzey (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (CLOUDSTACK-4171) Xen/XCP snapshot uploading to S3 server should use multipart upload API.
Date Sun, 20 Apr 2014 18:33:15 GMT

    [ https://issues.apache.org/jira/browse/CLOUDSTACK-4171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13975214#comment-13975214
] 

Tanner Danzey edited comment on CLOUDSTACK-4171 at 4/20/14 6:32 PM:
--------------------------------------------------------------------

This seems to be at least tangentially related to my recent issue @ https://issues.apache.org/jira/browse/CLOUDSTACK-6397

Without uploads > 5GB, using S3 is basically useless.


was (Author: arkaniad):
This seems to be at least tangentially related to my recent issue @ https://issues.apache.org/jira/browse/CLOUDSTACK-6397

Without uploads > 5GB, using S3 is all but useless..

> Xen/XCP snapshot uploading to S3 server should use multipart upload API.
> ------------------------------------------------------------------------
>
>                 Key: CLOUDSTACK-4171
>                 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-4171
>             Project: CloudStack
>          Issue Type: Improvement
>      Security Level: Public(Anyone can view this level - this is the default.) 
>    Affects Versions: 4.2.0
>            Reporter: Thomas O'Dowd
>
> Currently when a snapshot is being uploaded to S3, it uses a single S3 PUT request. Snapshots
can be large and Amazon recommends using the multipart upload API once the payload reaches
100MB [1] although it's possible to use the single object PUT api up until 5GB.
> From the SMlog we can see the single PUT being used:
> [16279] 2013-08-02 08:48:54.730958 #### VMOPS Sent PUT request to s3.cloudian.com:18080/images/snapshots/5a28d935-47da-4813-a692-db92761ce7de
with headers {'Content-Length': '50430464', 'Content-MD5': 'oafg2xPUPPAnyE1sxmf+qA==', 'Expect':
'100-continue', 'Date': 'Fri, 02 Aug 2013 08:48:52 +0000', 'Content-Type': 'application/octet-stream',
'Authorization': 'AWS 00ba9a7f9a8142b070c3:fy03ARq2UQWKW2UndUSYJ/E+QfI='}. Received response
status 200: OK ####
> [1] http://docs.aws.amazon.com/AmazonS3/latest/dev/UploadingObjects.html



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message