hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsz Wo Nicholas Sze (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-9205) Do not sehedule corrupted blocks for replication
Date Wed, 07 Oct 2015 01:30:26 GMT
Tsz Wo Nicholas Sze created HDFS-9205:

             Summary: Do not sehedule corrupted blocks for replication
                 Key: HDFS-9205
                 URL: https://issues.apache.org/jira/browse/HDFS-9205
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: namenode
            Reporter: Tsz Wo Nicholas Sze
            Assignee: Tsz Wo Nicholas Sze
            Priority: Minor

Corrupted blocks by definition are blocks cannot be read. As a consequence, they cannot be
replicated.  In UnderReplicatedBlocks, there is a queue for QUEUE_WITH_CORRUPT_BLOCKS and
chooseUnderReplicatedBlocks may choose blocks from it.  It seems that scheduling corrupted
block for replication is wasting resource and potentially slow down replication for the higher
priority blocks.

This message was sent by Atlassian JIRA

View raw message