hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9318) considerLoad factor can be improved
Date Fri, 06 Nov 2015 21:16:11 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14994440#comment-14994440
] 

Hudson commented on HDFS-9318:
------------------------------

FAILURE: Integrated in Hadoop-trunk-Commit #8769 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/8769/])
HDFS-9318. considerLoad factor can be improved. Contributed by Kuhu (kihwal: rev bf6aa30a156b3c5cac5469014a5989e0dfdc7256)
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockPlacementPolicyDefault.java
* hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicyConsiderLoad.java
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java


> considerLoad factor can be improved
> -----------------------------------
>
>                 Key: HDFS-9318
>                 URL: https://issues.apache.org/jira/browse/HDFS-9318
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 2.6.0
>            Reporter: Kuhu Shukla
>            Assignee: Kuhu Shukla
>             Fix For: 3.0.0, 2.8.0
>
>         Attachments: HDFS-9318-v1.patch, HDFS-9318-v2.patch
>
>
> Currently considerLoad avoids choosing nodes that are too active, so it helps level the
HDFS load across the cluster. Under normal conditions, this is desired. However, when a cluster
has a large percentage of nearly full nodes, this can make it difficult to find good targets
because the placement policy wants to avoid the full nodes, but considerLoad wants to avoid
the busy less-full nodes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message