hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinay (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-5568) Support inclusion of snapshot paths in Namenode fsck
Date Tue, 26 Nov 2013 10:04:35 GMT

    [ https://issues.apache.org/jira/browse/HDFS-5568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13832459#comment-13832459
] 

Vinay commented on HDFS-5568:
-----------------------------

I found that, if we include snapshot paths in fsck report, cluster health check will be done
properly. 
But the small problem is number of files and number of blocks validated  will be more because
it may contain duplicates. 
So It will be better to make it on demand, and in that case number of blocks and number of
files will not be accurate.

> Support inclusion of snapshot paths in Namenode fsck
> ----------------------------------------------------
>
>                 Key: HDFS-5568
>                 URL: https://issues.apache.org/jira/browse/HDFS-5568
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: snapshots
>            Reporter: Vinay
>            Assignee: Vinay
>         Attachments: HDFS-5568-1.patch, HDFS-5568.patch
>
>
> Support Fsck to check the snapshot paths also for inconsistency.
> Currently Fsck supports snapshot paths if path given explicitly refers to a snapshot
path.
> We have seen safemode problems in our clusters which were due to blocks missing which
were only present inside snapshots. But "hdfs fsck /" shows HEALTHY. 
> So supporting snapshot paths also during fsck (may be by default or on demand) would
be helpful in these cases instead of specifying each and every snapshottable directory.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message