hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-14531) Improve S3A error handling & reporting
Date Thu, 29 Jun 2017 13:06:00 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-14531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Steve Loughran updated HADOOP-14531:
------------------------------------
    Description: 
Improve S3a error handling and reporting

this includes
# looking at error codes and translating to more specific exceptions
# better retry logic where present
# adding retry logic where not present
# more diagnostics in exceptions 
# docs

Overall goals

* things that can be retried and will go away are retried for a bit
* things that don't go away when retried failfast (302, no auth, unknown host, connection
refused)
* meaningful exceptions are built in translate exception
* diagnostics are included, where possible
* our troubleshooting docs are expanded with new failures we encounter

AWS S3 error codes: http://docs.aws.amazon.com/AmazonS3/latest/API/ErrorResponses.html


  was:
Improve S3a error handling and reporting

this includes
# looking at error codes and translating to more specific exceptions
# better retry logic where present
# adding retry logic where not present
# more diagnostics in exceptions 
# docs

Overall goals

* things that can be retried and will go away are retried for a bit
* things that don't go away when retried failfast (302, no auth, unknown host, connection
refused)
* meaningful exceptions are built in translate exception
* diagnostics are included, where possible
* our troubleshooting docs are expanded with new failures we encounter




> Improve S3A error handling & reporting
> --------------------------------------
>
>                 Key: HADOOP-14531
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14531
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs/s3
>    Affects Versions: 2.8.1
>            Reporter: Steve Loughran
>
> Improve S3a error handling and reporting
> this includes
> # looking at error codes and translating to more specific exceptions
> # better retry logic where present
> # adding retry logic where not present
> # more diagnostics in exceptions 
> # docs
> Overall goals
> * things that can be retried and will go away are retried for a bit
> * things that don't go away when retried failfast (302, no auth, unknown host, connection
refused)
> * meaningful exceptions are built in translate exception
> * diagnostics are included, where possible
> * our troubleshooting docs are expanded with new failures we encounter
> AWS S3 error codes: http://docs.aws.amazon.com/AmazonS3/latest/API/ErrorResponses.html



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message