hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Raghu Angadi (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HDFS-763) DataBlockScanner reporting of bad blocks is slightly misleading
Date Wed, 11 Nov 2009 22:18:40 GMT

    [ https://issues.apache.org/jira/browse/HDFS-763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12776689#action_12776689
] 

Raghu Angadi commented on HDFS-763:
-----------------------------------

+1. yes. it should be incremented only for real errors.

> DataBlockScanner reporting of bad blocks is slightly misleading
> ---------------------------------------------------------------
>
>                 Key: HDFS-763
>                 URL: https://issues.apache.org/jira/browse/HDFS-763
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: data-node
>    Affects Versions: 0.20.1
>            Reporter: dhruba borthakur
>            Assignee: dhruba borthakur
>
> The Datanode generates a report of the period block scanning that verifies crcs. It reports
something like the following:
> Scans since restart : 192266
> Scan errors since restart : 33
> Transient scan errors : 0
> The statement saying that there were 33 errors is slightly midleading because these are
not crc mismatches, rather the block was being deleted when the crc verification was about
to happen. 
> I propose that DataBlockScanner.totalScanErrors is not updated if the dataset.getFile(block)
is null, i.e. the block is now deleted from the datanode. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message