hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mariusz Strzelecki (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-12353) S3 Native filesystem does not retry all connection failures
Date Tue, 25 Aug 2015 11:59:46 GMT
Mariusz Strzelecki created HADOOP-12353:
-------------------------------------------

             Summary: S3 Native filesystem does not retry all connection failures
                 Key: HADOOP-12353
                 URL: https://issues.apache.org/jira/browse/HADOOP-12353
             Project: Hadoop Common
          Issue Type: Bug
    Affects Versions: 2.7.1
            Reporter: Mariusz Strzelecki
            Assignee: Mariusz Strzelecki
            Priority: Minor


Current implementation of NativeS3FileSystem.java uses RetryProxy that retries exceptions
that may occur on network communication with S3 API, but these exceptions must be exact instances
of IOException:
https://github.com/apache/hadoop/blob/master/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3native/NativeS3FileSystem.java#L349

Our tests show that HttpClient throws IOException subclasses which are not handled by Proxy.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message