hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pieter Reuse (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-12844) Recover when S3A fails on IOException in read()
Date Fri, 29 Apr 2016 14:16:13 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-12844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15264105#comment-15264105
] 

Pieter Reuse commented on HADOOP-12844:
---------------------------------------

Thank you for looking into this, [~stevel@apache.org]. The patch HADOOP-13028-006 indeed fixes
the issue targeted by the patch I've uploaded here. So LGTM, and this ticket can be closed
when HADOOP-13028 is accepted.

> Recover when S3A fails on IOException in read()
> -----------------------------------------------
>
>                 Key: HADOOP-12844
>                 URL: https://issues.apache.org/jira/browse/HADOOP-12844
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>    Affects Versions: 2.7.1, 2.7.2
>            Reporter: Pieter Reuse
>            Assignee: Pieter Reuse
>         Attachments: HADOOP-12844.001.patch
>
>
> This simple patch catches IOExceptions in S3AInputStream.read(byte[] buf, int off, int
len) and reopens the connection on the same location as it was before the exception.
> This is similar to the functionality introduced in S3N in [HADOOP-6254|https://issues.apache.org/jira/browse/HADOOP-6254],
for exactly the same reason.
> Patch developed in cooperation with [~emres].



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message