hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Varun Saxena (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-5011) Support metric filters for flow runs
Date Thu, 28 Apr 2016 20:32:12 GMT

    [ https://issues.apache.org/jira/browse/YARN-5011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262925#comment-15262925
] 

Varun Saxena commented on YARN-5011:
------------------------------------

This patch is on top of YARN-4447.
This patch matches metric filters locally because flow run internal scanner would run after
records have been fetched from backend. And this coprocessor performs summation operation
before returning metric values for a flow run. This would mean that metric filters wont work
if passed as part of Get/Scan.
So these filters have to be matched locally and we also need to take care of metrics to retrieve.

This patch does the following :
# Creates HBase qualifier filters for the metrics specified in metric filters and metrics
to retrieve. So we fetch only those metrics which need to be matched against as part of metric
filters. Or the ones which need to be returned back in response.
# Metric filters are then applied locally to drop entities which do not match.
# We also remove from response, those metrics which have been fetched because of metric filters
but are not to be returned back in response due to metrics to retrieve.

> Support metric filters for flow runs
> ------------------------------------
>
>                 Key: YARN-5011
>                 URL: https://issues.apache.org/jira/browse/YARN-5011
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: timelineserver
>    Affects Versions: YARN-2928
>            Reporter: Varun Saxena
>            Assignee: Varun Saxena
>              Labels: yarn-2928-1st-milestone
>         Attachments: YARN-5011-YARN-2928.01.patch
>
>
> Support metric filters for flow runs



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message