hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sangjin Lee (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers
Date Mon, 30 Mar 2015 18:24:54 GMT

    [ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387136#comment-14387136

Sangjin Lee commented on YARN-3051:

cc [~vrushalic]

As for whether readers should specify the full context (cluster, user, flow id, flow run id,
and app id), we can comment on how we do it in hRaven. We do not require the full context
for queries. For example, if you want to query for all containers for a given app, the reader
does not need to specify all the context info (flow id, ...). Only the cluster and the app
id are needed to serve the queries like that.

On the storage side, to support this we do need a secondary lookup table that maps the app
id to the related context information (flow, etc.). We missed this point in the HBase schema
discussion/proposal. We'll add that.

Vrushali, let me know if I missed anything or stated something incorrectly.

> [Storage abstraction] Create backing storage read interface for ATS readers
> ---------------------------------------------------------------------------
>                 Key: YARN-3051
>                 URL: https://issues.apache.org/jira/browse/YARN-3051
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: timelineserver
>            Reporter: Sangjin Lee
>            Assignee: Varun Saxena
> Per design in YARN-2928, create backing storage read interface that can be implemented
by multiple backing storage implementations.

This message was sent by Atlassian JIRA

View raw message