hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Wang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-13061) Refactor erasure coders
Date Wed, 12 Oct 2016 01:11:20 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-13061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15567172#comment-15567172

Andrew Wang commented on HADOOP-13061:

Somewhat unrelated question related to rs-legacy: it's from the Facebook HDFS-RAID implementation
right? My recollection is that we added rs-legacy to support migration from HDFS-RAID to the
HDFS-7285 implementation without copying.

However, as it is right now, that zero-copy migration is not possible. HDFS-RAID is not striped,
it's at the block level. Also, HDFS-RAID combines an entire directory of files, whereas HDFS-7285
is on a single file. So, I don't think we can natively handle HDFS-RAID files without a lot
more work.

[~drankye], if this is accurate, do you think it's still worth keeping the rs-legacy codec

> Refactor erasure coders
> -----------------------
>                 Key: HADOOP-13061
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13061
>             Project: Hadoop Common
>          Issue Type: Sub-task
>            Reporter: Rui Li
>            Assignee: Kai Sasaki
>              Labels: hdfs-ec-3.0-must-do
>         Attachments: HADOOP-13061.01.patch, HADOOP-13061.02.patch, HADOOP-13061.03.patch,
HADOOP-13061.04.patch, HADOOP-13061.05.patch, HADOOP-13061.06.patch, HADOOP-13061.07.patch,
HADOOP-13061.08.patch, HADOOP-13061.09.patch, HADOOP-13061.10.patch, HADOOP-13061.11.patch,
HADOOP-13061.12.patch, HADOOP-13061.13.patch, HADOOP-13061.14.patch, HADOOP-13061.15.patch,

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message