hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wangda Tan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-6195) Export UsedCapacity and AbsoluteUsedCapacity to JMX
Date Tue, 04 Apr 2017 21:00:42 GMT

    [ https://issues.apache.org/jira/browse/YARN-6195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955794#comment-15955794

Wangda Tan commented on YARN-6195:

[~jlowe]/[~benson.qiu], Sorry for jumping in late, since we need to squash multi vals to a
single field, I don't think we can find a perfect solution here.

Few options:
#1 Behavior of this patch, usedCapacity = max(label, usedCapacity), absUsedCapacity = max(label,
#2 abs/usedCapacity = abs/usedCapacity from default partition 
#3 usedCapacity = total-used-resource / sum-of-configured-resource-for-all-partitions, absUsedCapacity=total-used-resource
/ sum-of-all-partition-resources.

Considering issue pointed by Naga, I also prefer #2 since it looks simpler and has best compatibility
once we have per-partition-metrics. #3 is also a reasonable solution to me however it needs
more computation and changes semantics of (abs)usedCapacity.


> Export UsedCapacity and AbsoluteUsedCapacity to JMX
> ---------------------------------------------------
>                 Key: YARN-6195
>                 URL: https://issues.apache.org/jira/browse/YARN-6195
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: capacityscheduler, metrics, yarn
>    Affects Versions: 3.0.0-alpha3
>            Reporter: Benson Qiu
>            Assignee: Benson Qiu
>         Attachments: YARN-6195.001.patch, YARN-6195.002.patch, YARN-6195.003.patch
> `usedCapacity` and `absoluteUsedCapacity` are currently not available as JMX. 

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message