hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinay (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-5031) BlockScanner scans the block multiple times and on restart scans everything
Date Tue, 30 Jul 2013 13:37:51 GMT

    [ https://issues.apache.org/jira/browse/HDFS-5031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13723858#comment-13723858

Vinay commented on HDFS-5031:

scanning is happening multiple times. also if datanode restarted, then scanning happens for
all blocks. Since this is a major problem in datanode block scanner.

if you feel, its not actually blocker, can change it to Major. No issues.
> BlockScanner scans the block multiple times and on restart scans everything
> ---------------------------------------------------------------------------
>                 Key: HDFS-5031
>                 URL: https://issues.apache.org/jira/browse/HDFS-5031
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: datanode
>    Affects Versions: 3.0.0, 2.1.0-beta
>            Reporter: Vinay
>            Assignee: Vinay
>            Priority: Blocker
>         Attachments: HDFS-5031.patch
> BlockScanner scans the block twice, also on restart of datanode scans everything.
> Steps:
> 1. Write blocks with interval of more than 5 seconds. write new block on completion of
scan for written block.
> Each time datanode scans new block, it also scans, previous block which is already scanned.

> Now after restart, datanode scans all blocks again.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message