hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9261) Erasure Coding: Skip encoding the data cells if all the parity data streamers are failed for the current block group
Date Thu, 29 Oct 2015 07:42:28 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14979984#comment-14979984
] 

Hudson commented on HDFS-9261:
------------------------------

FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #599 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/599/])
HDFS-9261. Erasure Coding: Skip encoding the data cells if all the (umamahesh: rev 07ecdb877dee0aa76a3269e37ac4783a55ab6bf6)
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSStripedOutputStream.java


> Erasure Coding: Skip encoding the data cells if all the parity data streamers are failed
for the current block group
> --------------------------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-9261
>                 URL: https://issues.apache.org/jira/browse/HDFS-9261
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Rakesh R
>            Assignee: Rakesh R
>            Priority: Minor
>             Fix For: 3.0.0
>
>         Attachments: HDFS-9261-00.patch, HDFS-9261-01.patch, HDFS-9261-02.patch
>
>
> {{DFSStripedOutputStream}} will continue writing with minimum number (dataBlockNum) of
live datanodes. It won't replace the failed datanodes immediately for the current block group.
Consider a case where all the parity data streamers are failed, now it is unnecessary to encode
the data block cells and generate the parity data. This is a corner case where it can skip
{{writeParityCells()}} step.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message