hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hairong Kuang (JIRA)" <j...@apache.org>
Subject [jira] Created: (HDFS-1765) Block Replication should respect under-replication block priority
Date Thu, 17 Mar 2011 19:02:29 GMT
Block Replication should respect under-replication block priority

                 Key: HDFS-1765
                 URL: https://issues.apache.org/jira/browse/HDFS-1765
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: name-node
    Affects Versions: 0.23.0
            Reporter: Hairong Kuang
            Assignee: Hairong Kuang
             Fix For: 0.23.0

Currently under-replicated blocks are assigned different priorities depending on how many
replicas a block has. However the replication monitor works on blocks in a round-robin fashion.
So the newly added high priority blocks won't get replicated until all low-priority blocks
are done. One example is that on decommissioning datanode WebUI we often observe that "blocks
with only decommissioning replicas" do not get scheduled to replicate before other blocks,
so risking data availability if the node is shutdown for repair before decommission completes.

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message