hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Varun Vasudev (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3652) A SchedulerMetrics may be need for evaluating the scheduler's performance
Date Wed, 27 May 2015 16:17:18 GMT

    [ https://issues.apache.org/jira/browse/YARN-3652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14561210#comment-14561210

Varun Vasudev commented on YARN-3652:

My apologies for the delay [~xinxianyin]. We do need a SchedulerMetrics class. The general
idea is that SchedulerHealth should pick up values from the SchedulerMetrics class but that
the SchedulerMetrics class should ideally provide more information. As an example, the SchedulerHealth
cares about the number of reserved containers, which the SchedulerMetrics class should provide.
Ideally, though, the SchedulerMetrics class would also give me some extra information such
as the mean, the distribution and the variance of the the number of reserved containers.

I think purely for the purposes of YARN-3630, you should use modify the SchedulerHealth class
to expose the number of waiting events, but we can independently work on a SchedulerMetrics
class as well.

> A SchedulerMetrics may be need for evaluating the scheduler's performance
> -------------------------------------------------------------------------
>                 Key: YARN-3652
>                 URL: https://issues.apache.org/jira/browse/YARN-3652
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: resourcemanager, scheduler
>            Reporter: Xianyin Xin
> As discussed in YARN-3630, a {{SchedulerMetrics}} may be need for evaluating the scheduler's
performance. The performance indexes includes #events waiting for being handled by scheduler,
the throughput, the scheduling delay and/or other indicators.

This message was sent by Atlassian JIRA

View raw message