hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Varun Saxena (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-5105) entire time series is returned for YARN container system metrics (CPU and memory)
Date Mon, 23 May 2016 18:10:14 GMT

    [ https://issues.apache.org/jira/browse/YARN-5105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15296783#comment-15296783
] 

Varun Saxena commented on YARN-5105:
------------------------------------

A patch supporting METRICS_TIME_SERIES in fields to retrieve to support fetching time series
explicitly. By default, single value will be retrieved.
For flow runs, single value is returned anyways due to summation in flow run coprocessor.

One more thing we need to think about is behavior of fields to retrieve when we are querying
flow runs. While querying flow runs, only METRICS(and ALL) as fields to retrieve makes sense.
So what should we do if we get anything else in fields ? Right now we ignore fields which
are present in {{TimelineReader#Field}} but do not make sense while querying flow runs.
Should we return a 400(Bad Request) here ? Or just document that we will ignore everything
other than METRICS/ALL.
FYI, for a single flow run, all metrics are returned by default.

> entire time series is returned for YARN container system metrics (CPU and memory)
> ---------------------------------------------------------------------------------
>
>                 Key: YARN-5105
>                 URL: https://issues.apache.org/jira/browse/YARN-5105
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: timelineserver
>    Affects Versions: YARN-2928
>            Reporter: Sangjin Lee
>            Assignee: Varun Saxena
>              Labels: yarn-2928-1st-milestone
>         Attachments: YARN-5105-YARN-2928.01.patch
>
>
> I see that the entire time series of the CPU and memory metrics are returned for the
YARN containers REST query. This has a potential of bloating the output big time.
> {noformat}
> "metrics": [
> {
>     "type": "TIME_SERIES",
>     "id": "MEMORY",
>     "values": 
> {
>     "1463518173363": ​407539712,
>     "1463518170347": ​407539712,
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message