hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tom White (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-5814) NativeS3FileSystem doesn't report progress when writing
Date Tue, 12 May 2009 16:33:45 GMT
NativeS3FileSystem doesn't report progress when writing
-------------------------------------------------------

                 Key: HADOOP-5814
                 URL: https://issues.apache.org/jira/browse/HADOOP-5814
             Project: Hadoop Core
          Issue Type: Improvement
          Components: fs/s3
            Reporter: Tom White


This results in timeouts since the whole file is uploaded in the close method. See http://www.mail-archive.com/core-user@hadoop.apache.org/msg09881.html.

One solution is to keep a reference to the Progressable passed in to the NativeS3FsOutputStream's
constructor, and progress it during writes, and while copying the backup file to S3 in the
close method.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message