hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tom White (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-5814) NativeS3FileSystem doesn't report progress when writing
Date Tue, 12 May 2009 16:33:45 GMT
NativeS3FileSystem doesn't report progress when writing

                 Key: HADOOP-5814
                 URL: https://issues.apache.org/jira/browse/HADOOP-5814
             Project: Hadoop Core
          Issue Type: Improvement
          Components: fs/s3
            Reporter: Tom White

This results in timeouts since the whole file is uploaded in the close method. See http://www.mail-archive.com/core-user@hadoop.apache.org/msg09881.html.

One solution is to keep a reference to the Progressable passed in to the NativeS3FsOutputStream's
constructor, and progress it during writes, and while copying the backup file to S3 in the
close method.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message