hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsz Wo Nicholas Sze (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7687) Change fsck to support EC files
Date Tue, 21 Apr 2015 18:37:59 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505463#comment-14505463

Tsz Wo Nicholas Sze commented on HDFS-7687:

The items looks good.  Just a minor point: A Corrupt EC block group could have >= 6 blocks
but some of the blocks are corrupted.

> ... in (6,3)-Reed-Solomon, these groups have more than 9 blocks. (Are there these cases?)

Yes, it is possible.  E.g. a datanode D0 dies and a EC block in D0 is reconstructed in another
datanode D1. Later on, D0 comes back.  Then, both D0 and D1 have the same EC block and the
block group could have more than 9 blocks.

> Change fsck to support EC files
> -------------------------------
>                 Key: HDFS-7687
>                 URL: https://issues.apache.org/jira/browse/HDFS-7687
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Tsz Wo Nicholas Sze
>            Assignee: Takanobu Asanuma
> We need to change fsck so that it can detect "under replicated" and corrupted EC files.

This message was sent by Atlassian JIRA

View raw message