hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rakesh R (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9261) Erasure Coding: Skip encoding the data cells if all the parity data streamers are failed for the current block group
Date Thu, 29 Oct 2015 07:45:27 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14979991#comment-14979991
] 

Rakesh R commented on HDFS-9261:
--------------------------------

Thank you [~umamaheswararao] for the help in reviews and commit it.

> Erasure Coding: Skip encoding the data cells if all the parity data streamers are failed
for the current block group
> --------------------------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-9261
>                 URL: https://issues.apache.org/jira/browse/HDFS-9261
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Rakesh R
>            Assignee: Rakesh R
>            Priority: Minor
>             Fix For: 3.0.0
>
>         Attachments: HDFS-9261-00.patch, HDFS-9261-01.patch, HDFS-9261-02.patch
>
>
> {{DFSStripedOutputStream}} will continue writing with minimum number (dataBlockNum) of
live datanodes. It won't replace the failed datanodes immediately for the current block group.
Consider a case where all the parity data streamers are failed, now it is unnecessary to encode
the data block cells and generate the parity data. This is a corner case where it can skip
{{writeParityCells()}} step.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message