hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eli Collins (JIRA)" <j...@apache.org>
Subject [jira] Created: (HDFS-1562) Add rack policy tests
Date Thu, 30 Dec 2010 01:47:46 GMT
Add rack policy tests

                 Key: HDFS-1562
                 URL: https://issues.apache.org/jira/browse/HDFS-1562
             Project: Hadoop HDFS
          Issue Type: Test
          Components: name-node, test
    Affects Versions: 0.23.0
            Reporter: Eli Collins
            Assignee: Eli Collins
         Attachments: hdfs-1562-1.patch

The existing replication tests (TestPendingReplication, TestOverReplicatedBlocks, TestReplicationPolicy,
TestUnderReplicatedBlocks, TestReplication) are missing tests for rack policy violations.
 This jira adds the following tests which I created generate a new patch for HDFS-15: 

* Test that blocks that have a sufficient number of total replicas, but are not replicated
cross rack, get replicated cross rack when a rack becomes available.
* Test that new blocks for an underreplicated file will get replicated cross rack. 
* Mark a block as corrupt, test that when it is re-replicated that it is still replicated
across racks.
* Reduce the replication factor of a file, making sure that the only block that is across
racks is not removed when deleting replicas.
* Test that when a block is replicated because a replica is lost due to host failure the the
rack policy is preserved.
* Test that when the execss replicas of a block are reduced due to a node re-joining the cluster
the rack policy is not violated.
* Test that rack policy is still respected when blocks are replicated due to node decommissioning.
* Test that rack policy is still respected when blocks are replicated due to node decommissioning,
even when the blocks are over-replicated.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message