hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Colin Patrick McCabe (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7648) Verify the datanode directory layout
Date Tue, 24 Feb 2015 02:24:12 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14334273#comment-14334273

Colin Patrick McCabe commented on HDFS-7648:

bq. Mmm ... We are not fixing the software bug but fixing the blocks/data. Also, there is
a conf. So it is manually but not automatically.

If you don't fix the bug, isn't this just going to re-occur?  You cannot fix a problem if
you don't know what it is.  And the software doesn't know why files would be in the wrong
position.  Similarly, the software doesn't know why VERSION might be missing, or a meta file
might not be there, or a volume might not be accessible.

> Verify the datanode directory layout
> ------------------------------------
>                 Key: HDFS-7648
>                 URL: https://issues.apache.org/jira/browse/HDFS-7648
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: datanode
>            Reporter: Tsz Wo Nicholas Sze
>            Assignee: Rakesh R
>         Attachments: HDFS-7648-3.patch, HDFS-7648-4.patch, HDFS-7648-5.patch, HDFS-7648.patch,
> HDFS-6482 changed datanode layout to use block ID to determine the directory to store
the block.  We should have some mechanism to verify it.  Either DirectoryScanner or block
report generation could do the check.

This message was sent by Atlassian JIRA

View raw message