hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Junping Du (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-3258) Test for HADOOP-8144 (pseudoSortByDistance in NetworkTopology for first rack local node)
Date Thu, 12 Apr 2012 05:26:29 GMT

    [ https://issues.apache.org/jira/browse/HDFS-3258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13252211#comment-13252211
] 

Junping Du commented on HDFS-3258:
----------------------------------

This bug is because pseudoSortByDistance is not taking the topology of "data center" layer
into consideration in sorting the distance, so that "5" and "3" are treated equally because
they are both off-rack. There are also some places in hadoop (like BlockPlacePolicyDefault.java,
FifoScheduler.java, etc) considering rack/host only but not aware of datacenter layer. Will
add dc layer awareness in pseudoSortByDistance soon if required. 

Thanks,

Junping
                
> Test for HADOOP-8144 (pseudoSortByDistance in NetworkTopology for first rack local node)
> ----------------------------------------------------------------------------------------
>
>                 Key: HDFS-3258
>                 URL: https://issues.apache.org/jira/browse/HDFS-3258
>             Project: Hadoop HDFS
>          Issue Type: Test
>          Components: test
>            Reporter: Eli Collins
>            Assignee: Junping Du
>         Attachments: hdfs-3258.txt
>
>
> For updating TestNetworkTopology to cover HADOOP-8144.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message