hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Takanobu Asanuma (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-11124) Report blockIds of internal blocks for EC files in Fsck
Date Wed, 25 Jan 2017 10:18:26 GMT

     [ https://issues.apache.org/jira/browse/HDFS-11124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Takanobu Asanuma updated HDFS-11124:
    Attachment: HDFS-11124.3.patch

Thank you very much for your kind review, [~jingzhao]! I updated the patch based on your comments.

bq. {{getReplicaInfo}} may be further optimized

I see. If we do that, I think indices information is required here. So we may need to add
a new API in {{BlockInfoStriped}}. I will create a separate jira.

> Report blockIds of internal blocks for EC files in Fsck
> -------------------------------------------------------
>                 Key: HDFS-11124
>                 URL: https://issues.apache.org/jira/browse/HDFS-11124
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: erasure-coding
>    Affects Versions: 3.0.0-alpha1
>            Reporter: Takanobu Asanuma
>            Assignee: Takanobu Asanuma
>              Labels: hdfs-ec-3.0-nice-to-have
>             Fix For: 3.0.0-alpha2
>         Attachments: HDFS-11124.1.patch, HDFS-11124.2.patch, HDFS-11124.3.patch
> At the moment, when we do fsck for an EC file which has corrupt blocks and missing blocks,
the result of fsck is like this:
> {quote}
> /data/striped 393216 bytes, erasure-coded: policy=RS-DEFAULT-6-3-64k, 1 block(s): 
> /data/striped: CORRUPT blockpool BP-1204772930- block blk_-9223372036854775792
>  CORRUPT 1 blocks of total size 393216 B
> 0. BP-1204772930- len=393216
Live_repl=4  [DatanodeInfoWithStorage[,DS-bcfebe1f-ff54-4d57-9258-ff5bdfde01b5,DISK](CORRUPT),
> {quote}
> It would be useful for admins if it reports the blockIds of the internal blocks.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message