hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Varun Saxena (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-6375) App level aggregation should not consider metric values reported in the previous aggregation cycle
Date Wed, 22 Mar 2017 22:16:41 GMT

    [ https://issues.apache.org/jira/browse/YARN-6375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15937266#comment-15937266
] 

Varun Saxena commented on YARN-6375:
------------------------------------

Assume in the first 15 second period, entities reported with corresponding metric values for
metric1 are as under:
{entity1: metric1=50, entity2: metric1=100, entity3: metric1=150, entity4: metric1=200, entity5:
metric1=250}

When aggregation occurs(SUM operation) we would write out app entity with metric1 having corresponding
value of 750.

Let us say by next 15 second period, entity1 and entity2 finish and following metric values
are reported.
{entity3: metric1=50, entity4: metric1=70, entity5: metric1=90}

When aggregation occurs(SUM operation) we would write out app entity with metric1 having corresponding
value of 360.

I think the value reported should be 210.

> App level aggregation should not consider metric values reported in the previous aggregation
cycle
> --------------------------------------------------------------------------------------------------
>
>                 Key: YARN-6375
>                 URL: https://issues.apache.org/jira/browse/YARN-6375
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: timelineserver
>            Reporter: Varun Saxena
>
> Currently app level aggregation is done every 15 seconds.
> And we consider last reported metric value for each entity belonging to an app for aggregation.
> We however merely update the corresponding metric values for the entity on put. We never
remove the entries.
> But it is possible that multiple entities finish during lifetime of an application. We
however continue to consider them till the end.
> We should however not consider metric values of entities unless reported within the 15
second period.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message