hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anu Engineer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-11564) Ozone: SCM: Add Comparable Metric Support
Date Thu, 23 Mar 2017 18:47:41 GMT

    [ https://issues.apache.org/jira/browse/HDFS-11564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15939001#comment-15939001
] 

Anu Engineer commented on HDFS-11564:
-------------------------------------

The algorithms of choosing 2 random nodes and then placing the container on the lower utilization
node is discussed in great depth in this survey paper.
https://pdfs.semanticscholar.org/3597/66cb47572028eb70c797115e987ff203e83f.pdf


> Ozone: SCM: Add Comparable Metric Support
> -----------------------------------------
>
>                 Key: HDFS-11564
>                 URL: https://issues.apache.org/jira/browse/HDFS-11564
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: ozone
>    Affects Versions: HDFS-7240
>            Reporter: Anu Engineer
>            Assignee: Anu Engineer
>
> While picking the datanode or the pool to place a container, SCM needs to be able to
compare pools and datanodes. This jira proposes to add a Comparable Metric interface from
which DatanodeCapacity and DatanodeIOLoad metrics can be derived. This will also convert SCM
Container Placement Capacity policy to use these metrics.
> Adding these metrics makes all placement policy operate on the basis of these metrics
and it makes it easy to simulate cluster imbalances as well as reason about code. All new
SCM metrics which have the property of total ordering should be derived from this interface.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message