hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Raghu Angadi (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HDFS-763) DataBlockScanner reporting of bad blocks is slightly misleading
Date Fri, 13 Nov 2009 19:01:39 GMT

    [ https://issues.apache.org/jira/browse/HDFS-763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777605#action_12777605

Raghu Angadi commented on HDFS-763:


"totalErrors" shown on 'blockScannerReport' now becomes same as number of verification failures,
rather than all the errors seen. 

> DataBlockScanner reporting of bad blocks is slightly misleading
> ---------------------------------------------------------------
>                 Key: HDFS-763
>                 URL: https://issues.apache.org/jira/browse/HDFS-763
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: data-node
>    Affects Versions: 0.20.1
>            Reporter: dhruba borthakur
>            Assignee: dhruba borthakur
>         Attachments: scanErrors.txt, scanErrors.txt, scanErrors.txt
> The Datanode generates a report of the period block scanning that verifies crcs. It reports
something like the following:
> Scans since restart : 192266
> Scan errors since restart : 33
> Transient scan errors : 0
> The statement saying that there were 33 errors is slightly midleading because these are
not crc mismatches, rather the block was being deleted when the crc verification was about
to happen. 
> I propose that DataBlockScanner.totalScanErrors is not updated if the dataset.getFile(block)
is null, i.e. the block is now deleted from the datanode. 

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message