hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-12346) Increase some default timeouts / retries for S3a connector
Date Fri, 21 Aug 2015 17:59:46 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-12346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707156#comment-14707156
] 

Steve Loughran commented on HADOOP-12346:
-----------------------------------------

sorry, misread: you aren't changing s3n are you?

I'll let others look at this patch, but I don't currently have any reason to -1 it.

> Increase some default timeouts / retries for S3a connector
> ----------------------------------------------------------
>
>                 Key: HADOOP-12346
>                 URL: https://issues.apache.org/jira/browse/HADOOP-12346
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs/s3
>            Reporter: Sean Mackrory
>         Attachments: 0001-HADOOP-12346.-Increase-some-default-timeouts-retries.patch
>
>
> I've been seeing some flakiness in jobs runnings against S3a, both first hand and with
other accounts, for which increasing fs.s3a.connection.timeout and fs.s3a.attempts.maximum
have been a reliable solution. I propose we increase the defaults.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message