hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Colin Patrick McCabe (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HDFS-8845) DiskChecker should not traverse entire tree
Date Mon, 17 Aug 2015 18:50:46 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698920#comment-14698920
] 

Colin Patrick McCabe edited comment on HDFS-8845 at 8/17/15 6:50 PM:
---------------------------------------------------------------------

That's an interesting point, [~andrew.wang].  However, the BlockScanner should be scheduled
to rescan the block after the error occurs.  So it should be reported to the NN relatively
rapidly even without adding synchronous code that looks at the block file path.

+1 for the latest patch.  Will commit in a day or two if there are no more comments


was (Author: cmccabe):
That's an interesting point, [~awang].  However, the BlockScanner should be scheduled to rescan
the block after the error occurs.  So it should be reported to the NN relatively rapidly even
without adding synchronous code that looks at the block file path.

+1 for the latest patch.  Will commit in a day or two if there are no more comments

> DiskChecker should not traverse entire tree
> -------------------------------------------
>
>                 Key: HDFS-8845
>                 URL: https://issues.apache.org/jira/browse/HDFS-8845
>             Project: Hadoop HDFS
>          Issue Type: Bug
>            Reporter: Chang Li
>            Assignee: Chang Li
>         Attachments: HDFS-8845.patch
>
>
> DiskChecker should not traverse entire tree because it's causing heavy disk load on checkDiskError()



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message