hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhijie Shen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2543) Resource usage should be published to the timeline server as well
Date Tue, 27 Jan 2015 22:22:34 GMT

    [ https://issues.apache.org/jira/browse/YARN-2543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14294307#comment-14294307

Zhijie Shen commented on YARN-2543:

Thanks for the patch, Naga! Here're my comments.

1. I suggested to add this info as the app entity-level otherinfo. You can check other fields
like queue, type and so on.
+    eventInfo.put(ApplicationMetricsConstants.APP_CPU_METRICS,
+        appMetrics.getVcoreSeconds());
+    eventInfo.put(ApplicationMetricsConstants.APP_MEM_METRICS,
+        appMetrics.getMemorySeconds());

2. ApplicationCLI and the corresponding test case needs to be changed too.
      if (usageReport != null) {
        //completed app report in the timeline server doesn't have usage report
        appReportStr.print(usageReport.getMemorySeconds() + " MB-seconds, ");
        appReportStr.println(usageReport.getVcoreSeconds() + " vcore-seconds");
      } else {

3. Add the assertions in TestApplicationHistoryClientService too.

4. It seems CLI provides the resource usage info. It's better that the webUI can provide the
same info. However, rm app info can contain this info, too. But let's separate this issue
and cover it in another Jira.

> Resource usage should be published to the timeline server as well
> -----------------------------------------------------------------
>                 Key: YARN-2543
>                 URL: https://issues.apache.org/jira/browse/YARN-2543
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: timelineserver
>    Affects Versions: 2.6.0
>            Reporter: Zhijie Shen
>            Assignee: Naganarasimha G R
>         Attachments: YARN-2543.20150125-1.patch
> RM will include the resource usage in the app report, but generic history service doesn't,
because RM doesn't publish this data to the timeline server

This message was sent by Atlassian JIRA

View raw message