hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-6961) Archival Storage: BlockPlacementPolicy#chooseTarget should check each valid storage type in each choosing round
Date Fri, 19 Sep 2014 13:47:52 GMT

    [ https://issues.apache.org/jira/browse/HDFS-6961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14140516#comment-14140516
] 

Hudson commented on HDFS-6961:
------------------------------

FAILURE: Integrated in Hadoop-Mapreduce-trunk #1901 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1901/])
HDFS-6961. Archival Storage: BlockPlacementPolicy#chooseTarget should check each valid storage
type in each choosing round. (jing9: rev e08701ec71f7c10d8f15122d90c35f9f22e40837)
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestBlockStoragePolicy.java
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/BlockStoragePolicy.java
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockPlacementPolicyDefault.java
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockPlacementPolicyWithNodeGroup.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java


> Archival Storage: BlockPlacementPolicy#chooseTarget should check each valid storage type
in each choosing round
> ---------------------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-6961
>                 URL: https://issues.apache.org/jira/browse/HDFS-6961
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: balancer, namenode
>            Reporter: Jing Zhao
>            Assignee: Jing Zhao
>         Attachments: HDFS-6961.000.patch, HDFS-6961.001.patch, HDFS-6961.002.patch, HDFS-6961.002.patch,
HDFS-6961.003.patch
>
>
> Currently in each choosing round of BlockPlacementPolicy#chooseTarget (e.g., round 1
for choosing local storage, round 2 for remote rack, etc.), we only take into account the
first storage type in the storage type list. This may 
> fail to choose the local machine or sometimes may even fail to choose enough nodes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message