hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xiaoqiao He (Jira)" <j...@apache.org>
Subject [jira] [Created] (HDFS-14882) Consider DataNode load when #getBlockLocation
Date Mon, 30 Sep 2019 10:54:00 GMT
Xiaoqiao He created HDFS-14882:
----------------------------------

             Summary: Consider DataNode load when #getBlockLocation
                 Key: HDFS-14882
                 URL: https://issues.apache.org/jira/browse/HDFS-14882
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: namenode
            Reporter: Xiaoqiao He
            Assignee: Xiaoqiao He


Currently, we consider load of datanode when #chooseTarget for writer, however not consider
it for reader. Thus, the process slot of datanode could be occupied by #BlockSender for reader,
and disk/network will be busy workload, then meet some slow node exception. IIRC same case
is reported times. Based on the fact, I propose to consider load for reader same as it did
#chooseTarget for writer.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org


Mime
View raw message