hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jing Zhao (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HDFS-8272) Erasure Coding: simplify the retry logic in DFSStripedInputStream
Date Mon, 27 Apr 2015 22:58:40 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14515178#comment-14515178
] 

Jing Zhao edited comment on HDFS-8272 at 4/27/15 10:58 PM:
-----------------------------------------------------------

The 000 patch made the following changes:
# {{DFSStripedInputStream}} no longer retries finding another source DN for the same block.
# Let {{getBestNodeDNAddrPair}} not throw IOException when the chosenNode is null.
# Remove some other unnecessary retry logic from {{DFSStripedInputStream}}.
# Some code cleanup.


was (Author: jingzhao):
The 000 patch made the following changes:
# {{DFSStripedInputStream}} no longer retries finding another source DN for the same block.
# Let {{getBestNodeDNAddrPair}} not throwing IOException when the chosenNode is null.
# Remove some other unnecessary retry logic from {{DFSStripedInputStream}}.
# Some code cleanup.

> Erasure Coding: simplify the retry logic in DFSStripedInputStream
> -----------------------------------------------------------------
>
>                 Key: HDFS-8272
>                 URL: https://issues.apache.org/jira/browse/HDFS-8272
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Jing Zhao
>            Assignee: Jing Zhao
>         Attachments: h8272-HDFS-7285.000.patch
>
>
> Currently in DFSStripedInputStream the retry logic is still the same with DFSInputStream.
More specifically, every failed read will try to search for another source node. And an exception
is thrown when no new source node can be identified. This logic is not appropriate for EC
inputstream and can be simplified.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message