hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsz Wo Nicholas Sze (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7648) Verify the datanode directory layout
Date Fri, 23 Jan 2015 18:59:35 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14289727#comment-14289727

Tsz Wo Nicholas Sze commented on HDFS-7648:

During block report generation or directory scanning, it traverses the directory for collecting
all the replica information.  We should verify whether the actual directory location of a
replica has the expected directory path computed using its block ID.  If a mismatch is found,
it should also fix it.  On a second thought, DirectoryScanner seems a better place to do the
verification since the purpose of the DirectoryScanner is to verify and fix the blocks stored
in the local directories.  What do you think?

> Verify the datanode directory layout
> ------------------------------------
>                 Key: HDFS-7648
>                 URL: https://issues.apache.org/jira/browse/HDFS-7648
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: datanode
>            Reporter: Tsz Wo Nicholas Sze
> HDFS-6482 changed datanode layout to use block ID to determine the directory to store
the block.  We should have some mechanism to verify it.  Either DirectoryScanner or block
report generation could do the check.

This message was sent by Atlassian JIRA

View raw message