hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Li Lu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers
Date Fri, 12 Jun 2015 22:33:01 GMT

    [ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584197#comment-14584197

Li Lu commented on YARN-3051:

bq. APIs' for querying individual entity/flow/flow run/user and APIs' for querying a set of
entities/flow runs/flows/users. APIs' such a set of flows/users will contain aggregated data.
bq. I think we don't store the first class citizen entity in a different way and in different
tables (Li/Vrushali, correct me If I'm wrong). When fetching an entity, it doesn't matter
it is a customized entity or a predefined entity such as ApplicationEntity.

If we're discussing about storage read interface, why is it harmful to explicitly separate
interfaces for raw data and aggregated data, as [~zjshen] proposed before? We can work on
the raw data interface first, when designing aggregations. 

bq. If it's transformed to a string, it is likely to be difficult to recover the original
type information. 

I agree. A follow up concern is, who to maintain, or explain, the type information? I assume
we need the readers themselves to keep track of this? 

> [Storage abstraction] Create backing storage read interface for ATS readers
> ---------------------------------------------------------------------------
>                 Key: YARN-3051
>                 URL: https://issues.apache.org/jira/browse/YARN-3051
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: timelineserver
>    Affects Versions: YARN-2928
>            Reporter: Sangjin Lee
>            Assignee: Varun Saxena
>         Attachments: YARN-3051-YARN-2928.003.patch, YARN-3051-YARN-2928.03.patch, YARN-3051-YARN-2928.04.patch,
YARN-3051.wip.02.YARN-2928.patch, YARN-3051.wip.patch, YARN-3051_temp.patch
> Per design in YARN-2928, create backing storage read interface that can be implemented
by multiple backing storage implementations.

This message was sent by Atlassian JIRA

View raw message