hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rakesh R (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7648) Verify the datanode directory layout
Date Thu, 29 Jan 2015 14:32:37 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14296925#comment-14296925

Rakesh R commented on HDFS-7648:

Thanks [~cmccabe] for comments.
bq.Probably what we want to do is log a warning about files that are in locations they do
not belong in
Do you meant, DirectoryScanner should identify the blocks which are not in the expected directory
path computed using its block ID and just do a log message without fixing it. As per the earlier
discussion it need to fix. I was having an idea which is similar to the mechanism used in
Datastorage, create hardlinks. Please correct me if I miss anything.

> Verify the datanode directory layout
> ------------------------------------
>                 Key: HDFS-7648
>                 URL: https://issues.apache.org/jira/browse/HDFS-7648
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: datanode
>            Reporter: Tsz Wo Nicholas Sze
> HDFS-6482 changed datanode layout to use block ID to determine the directory to store
the block.  We should have some mechanism to verify it.  Either DirectoryScanner or block
report generation could do the check.

This message was sent by Atlassian JIRA

View raw message