hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xianyin Xin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3652) A SchedulerMetrics may be need for evaluating the scheduler's performance
Date Tue, 18 Aug 2015 14:02:46 GMT

    [ https://issues.apache.org/jira/browse/YARN-3652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14701291#comment-14701291
] 

Xianyin Xin commented on YARN-3652:
-----------------------------------

A simple introduction of the preview patch: SchedulerMetrics is focus on metrics that related
to the scheduler's performace. The following metrics are considered:

num of waiting events in the scheduler dispatch queue;
num of all kinds events in the scheduler dispatch queue;

events handling rate;
node update handling rate;

events adding rate;
node update adding rate;

statistical info of num of waiting events;
statistical info of num of waiting node update events;

containers allocation rate;

scheduling method exec rate, i.e., num of scheduling tries per second;

app allocation call duration;
nodeUpdate call duration;
scheduling call duration;

These metrics give rich information of the scheduler performance, which can be used to diagnose
the anomaly of the scheduler.

> A SchedulerMetrics may be need for evaluating the scheduler's performance
> -------------------------------------------------------------------------
>
>                 Key: YARN-3652
>                 URL: https://issues.apache.org/jira/browse/YARN-3652
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: resourcemanager, scheduler
>            Reporter: Xianyin Xin
>         Attachments: YARN-3652-preview.patch
>
>
> As discussed in YARN-3630, a {{SchedulerMetrics}} may be need for evaluating the scheduler's
performance. The performance indexes includes #events waiting for being handled by scheduler,
the throughput, the scheduling delay and/or other indicators.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message