hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rakesh R (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7648) Verify the datanode directory layout
Date Tue, 10 Feb 2015 13:37:12 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14314176#comment-14314176
] 

Rakesh R commented on HDFS-7648:
--------------------------------

Hi [~szetszwo], [~cmccabe], Thanks for the comments. It would be great if we can reach to
an agreement about the way to verify and handle the mismatched blocks.

As an initial attempt, I'm attaching a patch where I tried to compare the directory paths
and logging WARN message. Later based on the discussion in the jira will do the necessary
changes. Please review the approach when you get some time.

> Verify the datanode directory layout
> ------------------------------------
>
>                 Key: HDFS-7648
>                 URL: https://issues.apache.org/jira/browse/HDFS-7648
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: datanode
>            Reporter: Tsz Wo Nicholas Sze
>            Assignee: Rakesh R
>         Attachments: HDFS-7648.patch
>
>
> HDFS-6482 changed datanode layout to use block ID to determine the directory to store
the block.  We should have some mechanism to verify it.  Either DirectoryScanner or block
report generation could do the check.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message