hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tanuj Nayak (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-5695) New ResourceCalculator implementation that operates on vector of resources, but respect sum of ratios
Date Tue, 08 Aug 2017 18:21:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-5695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16118795#comment-16118795
] 

Tanuj Nayak commented on YARN-5695:
-----------------------------------

Hello I would like to throw out an idea for implementing the ratio function here given vectors
of resources for this JIRA. 

Suppose the two parameter resource vectors are a and b, we have that ratio(a, b) = <a,
b>/||b||^2 where <a,b> is the euclidean dot product of a and b. This preserves the
sum to one property that is described in this JIRA and comes pretty close to a comparison
function as it basically simplifies to the normalized projection of a onto b in the euclidean
vector space. One could argue that when a and b are orthogonal, the ratio function will awkwardly
return 0. However, as both vectors are guaranteed to be in the first octant (all coordinates
are positive) this will happen very rarely. 

Any thoughts regarding this?

> New ResourceCalculator implementation that operates on vector of resources, but respect
sum of ratios 
> ------------------------------------------------------------------------------------------------------
>
>                 Key: YARN-5695
>                 URL: https://issues.apache.org/jira/browse/YARN-5695
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Carlo Curino
>            Priority: Minor
>
> DominantResourceCalculator does not respect R1/(R1+R2) + R2/(R1+R2) = 1 (as it peaks
max of each element to produce ratios). This property is problematic for YARN-5325. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message