hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-6701) Make seed optional in NetworkTopology#sortByDistance
Date Wed, 23 Jul 2014 10:59:44 GMT

    [ https://issues.apache.org/jira/browse/HDFS-6701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14071602#comment-14071602
] 

Hudson commented on HDFS-6701:
------------------------------

FAILURE: Integrated in Hadoop-Yarn-trunk #621 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/621/])
HDFS-6701. Make seed optional in NetworkTopology#sortByDistance. Contributed by Ashwin Shankar.
(wang: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1612625)
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/net/NetworkTopology.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/net/NetworkTopologyWithNodeGroup.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/net/TestNetworkTopologyWithNodeGroup.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DatanodeManager.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/net/TestNetworkTopology.java


> Make seed optional in NetworkTopology#sortByDistance
> ----------------------------------------------------
>
>                 Key: HDFS-6701
>                 URL: https://issues.apache.org/jira/browse/HDFS-6701
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: namenode
>    Affects Versions: 2.5.0
>            Reporter: Ashwin Shankar
>            Assignee: Ashwin Shankar
>             Fix For: 2.6.0
>
>         Attachments: HDFS-6701-v1.txt, HDFS-6701-v3-branch2.txt, HDFS-6701-v3.txt, HDFS-6701-v4-branch2.txt,
HDFS-6701-v4.txt
>
>
> Currently seed in NetworkTopology#sortByDistance is set to the blockid which causes the
RNG to generate same pseudo random order for each block. If no node local block location is
present,this causes the same rack local replica to be hit for a particular block.
> It'll be good to make the seed optional, so that one could turn it off if they want block
locations of a block to be randomized.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message