hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sangjin Lee (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-5105) entire time series is returned for YARN container system metrics (CPU and memory)
Date Mon, 23 May 2016 23:13:12 GMT

    [ https://issues.apache.org/jira/browse/YARN-5105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15297316#comment-15297316

Sangjin Lee commented on YARN-5105:

One more thing we need to think about is behavior of fields to retrieve when we are querying
flow runs. While querying flow runs, only METRICS(and ALL) as fields to retrieve makes sense.
So what should we do if we get anything else in fields ? Right now we ignore fields which
are present in TimelineReader#Field but do not make sense while querying flow runs.
Should we return a 400(Bad Request) here ? Or just document that we will ignore everything
other than METRICS/ALL.
FYI, for a single flow run, all metrics are returned by default.

That's a good point. I would be in favor of returning 400 if the user specified METRICS_TIME_SERIES
for the flow run. I think we can afford to reject the request if the user explicitly requested

On a related note, is it possible for users to specify both METRICS and METRICS_TIME_SERIES
for other queries? If so, I think we should reject those requests as they are mutually exclusive.

> entire time series is returned for YARN container system metrics (CPU and memory)
> ---------------------------------------------------------------------------------
>                 Key: YARN-5105
>                 URL: https://issues.apache.org/jira/browse/YARN-5105
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: timelineserver
>    Affects Versions: YARN-2928
>            Reporter: Sangjin Lee
>            Assignee: Varun Saxena
>              Labels: yarn-2928-1st-milestone
>         Attachments: YARN-5105-YARN-2928.01.patch
> I see that the entire time series of the CPU and memory metrics are returned for the
YARN containers REST query. This has a potential of bloating the output big time.
> {noformat}
> "metrics": [
> {
>     "type": "TIME_SERIES",
>     "id": "MEMORY",
>     "values": 
> {
>     "1463518173363": ​407539712,
>     "1463518170347": ​407539712,
> {noformat}

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message