hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kai Zheng (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-11566) Add tests and fix for erasure coders to recover erased parity units
Date Wed, 13 May 2015 01:09:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-11566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14541144#comment-14541144
] 

Kai Zheng commented on HADOOP-11566:
------------------------------------

Thanks Zhe for the more comments. Will update the patch accordingly.
bq. Later on we can consider making this order consistent across the code base.
Sounds good to me to use the order of data units first then parity units, even though raw
erasure coder may have its own preference. If we have to adjust the order, we can do it in
raw coder layer for sake of HDFS callers. As this change would make big impact for the existing
codes and on-going issues, you're right we'd better perform the change some time later. Thanks.

> Add tests and fix for erasure coders to recover erased parity units 
> --------------------------------------------------------------------
>
>                 Key: HADOOP-11566
>                 URL: https://issues.apache.org/jira/browse/HADOOP-11566
>             Project: Hadoop Common
>          Issue Type: Sub-task
>            Reporter: Kai Zheng
>            Assignee: Kai Zheng
>         Attachments: HADOOP-11566-HDFS-7285-v2.patch, HADOOP-11566-v1.patch
>
>
> Discussing with [~zhz] in HADOOP-11542: it's planned to have follow up a JIRA to enhance
the tests for parity chunks as well. Like erasedDataIndexes, erasedParityIndexes will be added
to specify which parity units are to be erased and recovered then.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message