hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-13059) S3a over-reacts to potentially transient network problems in its init() logic
Date Fri, 13 May 2016 13:15:12 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-13059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15282679#comment-15282679
] 

Steve Loughran commented on HADOOP-13059:
-----------------------------------------

If the exception raised is an {{AmazonClientException}}, its {{isRetryable()}} flag can perhaps
be queried: if the answer is false, then it's presumably not transient

> S3a over-reacts to potentially transient network problems in its init() logic
> -----------------------------------------------------------------------------
>
>                 Key: HADOOP-13059
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13059
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>    Affects Versions: 2.8.0
>            Reporter: Steve Loughran
>            Priority: Minor
>         Attachments: HADOOP-13059-001.patch
>
>
> If there's a reason for s3a not being able to connect to AWS, then the constructor fails,
even if this is a potentially transient event.
> This happens because the code to check for a bucket existing will relay the exceptions.
> The constructor should catch IOEs against the remote FS, downgrade to warn and let the
code continue; it may fail later, but it may also recover.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message