hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Manikandan R (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-6492) Generate queue metrics for each partition
Date Tue, 17 Oct 2017 02:38:02 GMT

    [ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16206928#comment-16206928

Manikandan R commented on YARN-6492:

[~jhung] Thanks for your comments.

{quote}What's the rationale behind having a separate PartitionQueueMetrics metrics info?{quote}

Currently as of now we have been following "Partition->Queue" hierarchy in UI and scheduling
as well. To ensure that we have similar hierarchy even in JMX metrics and also helps users/admins
to have a better understanding about the usage.

{quote}s it possible to factor the partition metrics to QueueMetrics class similar to how
user metrics is implemented? (i.e. have some configuration to enable partition metrics, and
register a new QueueMetrics with the partition tag){quote}

Yes, thats the plan. We will do this while implementing the same.

{quote}Also the existing metrics for PartitionQueueMetrics in the attachment only has pendingMB,
pendingVCores, pendingContainers. Will this be filled out to match the set of metrics supported
by the current queue metrics? (appsSubmitted, appsFailed, allocatedMB, availableMB, ...){quote}

Yes. Earlier attached o/p was to detail out the structure to help us in better understanding
for further discussions purpose. While doing the implementation, we will cover all the existing

> Generate queue metrics for each partition
> -----------------------------------------
>                 Key: YARN-6492
>                 URL: https://issues.apache.org/jira/browse/YARN-6492
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: capacity scheduler
>            Reporter: Jonathan Hung
>            Assignee: Manikandan R
>         Attachments: YARN-6492.001.patch, partition_metrics.txt
> We are interested in having queue metrics for all partitions. Right now each queue has
one QueueMetrics object which captures metrics either in default partition or across all partitions.
(After YARN-6467 it will be in default partition)
> But having the partition metrics would be very useful.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message