hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aaron Kimball (JIRA)" <j...@apache.org>
Subject [jira] Created: (MAPREDUCE-972) distcp can timeout during rename operation to s3
Date Fri, 11 Sep 2009 01:35:58 GMT
distcp can timeout during rename operation to s3
------------------------------------------------

                 Key: MAPREDUCE-972
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-972
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: distcp
    Affects Versions: 0.20.1
            Reporter: Aaron Kimball
            Assignee: Aaron Kimball
         Attachments: MAPREDUCE-972.patch

rename() in S3 is implemented as copy + delete. The S3 copy operation can perform very slowly,
which may cause task timeout.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message