hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Devaraj K (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (HADOOP-5814) NativeS3FileSystem doesn't report progress when writing
Date Sat, 10 Sep 2011 09:23:09 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-5814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Devaraj K reassigned HADOOP-5814:

    Assignee:     (was: Devaraj K)

> NativeS3FileSystem doesn't report progress when writing
> -------------------------------------------------------
>                 Key: HADOOP-5814
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5814
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs/s3
>            Reporter: Tom White
>              Labels: S3Native
>         Attachments: HADOOP-5814(1).patch, HADOOP-5814.patch
> This results in timeouts since the whole file is uploaded in the close method. See http://www.mail-archive.com/core-user@hadoop.apache.org/msg09881.html.
> One solution is to keep a reference to the Progressable passed in to the NativeS3FsOutputStream's
constructor, and progress it during writes, and while copying the backup file to S3 in the
close method.

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message