cloudstack-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CLOUDSTACK-8640) Uploads to S3 Secondary Storage fail, stay at 0% completed
Date Fri, 31 Jul 2015 10:54:04 GMT

    [ https://issues.apache.org/jira/browse/CLOUDSTACK-8640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649069#comment-14649069
] 

ASF GitHub Bot commented on CLOUDSTACK-8640:
--------------------------------------------

GitHub user wido opened a pull request:

    https://github.com/apache/cloudstack/pull/647

    CLOUDSTACK-8640: Revert to AWS SDK 1.3.22

    The newer SDKs API changed which causes our S3 Template Downloader to never complete.
    
    Although we should fix the Template Downloader we can revert to the old AWS SDK for now.
    
    The fix on the longer run will be rewriting the S3 Template Downloader.
    
    Two methods had to be disabled for now since the old SDK does not support them. They can
    be re-enabled when the Template Downloader has been fixed.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/wido/cloudstack CLOUDSTACK-8640

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/cloudstack/pull/647.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #647
    
----
commit c32656a7ef13bc952899486026d5a4bf60ff6509
Author: Wido den Hollander <wido@widodh.nl>
Date:   2015-07-31T09:26:53Z

    CLOUDSTACK-8640: Revert to AWS SDK 1.3.22
    
    The newer SDKs API changed which causes our S3 Template Downloader to never complete.
    
    Although we should fix the Template Downloader we can revert to the old AWS SDK for now.
    
    The fix on the longer run will be rewriting the S3 Template Downloader.
    
    Two methods had to be disabled for now since the old SDK does not support them. They can
    be re-enabled when the Template Downloader has been fixed.

----


> Uploads to S3 Secondary Storage fail, stay at 0% completed
> ----------------------------------------------------------
>
>                 Key: CLOUDSTACK-8640
>                 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8640
>             Project: CloudStack
>          Issue Type: Bug
>      Security Level: Public(Anyone can view this level - this is the default.) 
>          Components: SystemVM
>    Affects Versions: Future, 4.5.1
>         Environment: Ceph RADOS Gateway with Civetweb as Secondary Storage
>            Reporter: Wido den Hollander
>            Assignee: Wido den Hollander
>              Labels: amazon, ceph, rados, s3, secondary_storage
>             Fix For: 4.6.0
>
>
> I noticed this after upgrading to 4.5.2 (build from 4.5 branch).
> Uploads never completed when a template was downloaded en directly uploaded to S3 secondary
storage provided by Ceph's RADOS Gateway using Multipart.
> After searching for hours I found this: http://docs.aws.amazon.com/AWSJavaSDK/latest/javadoc/com/amazonaws/event/ProgressEvent.html#getBytesTransferred()
> The ProgressEvent of the returned that 0 bytes had been transferred. But when using the
getBytes() method it actually works.
> The upload succeeds, but we check if the amount of uploaded bytes is equal or more then
what we expected. If not, we say the upload failed.
> This happens inside S3TemplateDownloader (which really needs some fixes btw....)
> Tracing this down if it's related to Ceph or actually something in S3TemplateDownloader.
> I also tried the Amazon SDK 1.9.34, but that didn't make a difference.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message