hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chen Liang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-11514) ChooseRandom can potentially be optimized
Date Wed, 08 Mar 2017 22:39:38 GMT
Chen Liang created HDFS-11514:
---------------------------------

             Summary: ChooseRandom can potentially be optimized
                 Key: HDFS-11514
                 URL: https://issues.apache.org/jira/browse/HDFS-11514
             Project: Hadoop HDFS
          Issue Type: Sub-task
            Reporter: Chen Liang
            Assignee: Chen Liang


Based on the offline discussion, one potential improvement to the {{chooseRandomWithStorageType}}
added in HDFS-11482 is that, currently given a node, the method iterates all its children
to sum up the number of candidate datanodes. Since datanode status change is much less frequent
than block placement request. It is more efficient to get rid of this iteration check, by
probably maintaining another disk type counter map. This JIRA tracks (but not limited) this
optimization.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org


Mime
View raw message