hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kuhu Shukla (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-9318) considerLoad factor can be improved
Date Tue, 27 Oct 2015 19:26:27 GMT
Kuhu Shukla created HDFS-9318:
---------------------------------

             Summary: considerLoad factor can be improved
                 Key: HDFS-9318
                 URL: https://issues.apache.org/jira/browse/HDFS-9318
             Project: Hadoop HDFS
          Issue Type: Bug
    Affects Versions: 2.6.0
            Reporter: Kuhu Shukla
            Assignee: Kuhu Shukla


Currently considerLoad avoids choosing nodes that are too active, so it helps level the HDFS
load across the cluster. Under normal conditions, this is desired. However, when a cluster
has a large percentage of nearly full nodes, this can make it difficult to find good targets
because the placement policy wants to avoid the full nodes, but considerLoad wants to avoid
the busy less-full nodes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message