hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Naganarasimha G R (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-6195) Export UsedCapacity and AbsoluteUsedCapacity to JMX
Date Tue, 04 Apr 2017 20:03:42 GMT

    [ https://issues.apache.org/jira/browse/YARN-6195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955716#comment-15955716

Naganarasimha G R commented on YARN-6195:

Hi [~benson.qiu] & [~jlowe], Sorry for pitching in late!
IIUC currently we are not considering partition while updating queue metrics like allocatedMB
/ allocatedVCores / pendingMB / pendingVCores / reservedMB / reservedVCores... So as [~jlowe]
mentioned many of the metrics in QueueMetrics needs to consider partition. Or at least it
should be always giving *Default Partition*'s statistics (for better compatability).  
IMHO i would opt to show default partition used/absolute-used metrics  than/ showing max of
used/absolute-used among the partition for following reasons :
# it will not be in sync with other existing metrics captured (which also needs to be converted
to provide only for default partition)
# we might show used metric of one partition and absolute-used of other partition, as we are
considering the max.

Agree with [~jlowe] the best solution is per partition stats but max across partition would
loose the significance of its value and admin cannot deduce anything from it. Also it would
be better to have {{QueueMetrics Per partition}} similar to what we have {{QueueMetrics for
users}} currently, but just that all fields might not make sense for PartitionQueueMetrics.

> Export UsedCapacity and AbsoluteUsedCapacity to JMX
> ---------------------------------------------------
>                 Key: YARN-6195
>                 URL: https://issues.apache.org/jira/browse/YARN-6195
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: capacityscheduler, metrics, yarn
>    Affects Versions: 3.0.0-alpha3
>            Reporter: Benson Qiu
>            Assignee: Benson Qiu
>         Attachments: YARN-6195.001.patch, YARN-6195.002.patch, YARN-6195.003.patch
> `usedCapacity` and `absoluteUsedCapacity` are currently not available as JMX. 

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message