hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joep Rottinghuis (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-5281) Explore supporting a simpler back-end implementation for ATS v2
Date Tue, 21 Jun 2016 18:25:58 GMT

    [ https://issues.apache.org/jira/browse/YARN-5281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15342389#comment-15342389

Joep Rottinghuis commented on YARN-5281:

Capturing [~ozawa]'s reply:
Thanks Sangjin for starting the discussion.

>> *First*, if the merge vote is approved, to which branch should this be
merged and what would be the release version?

As you mentioned, I think it's reasonable for us to target trunk and

>> Slightly unrelated to the merge, do we plan to support any other simpler
backend for users to try out, in addition to HBase? LevelDB?
> We can however, potentially change the Local File System based
implementation to a HDFS based implementation and have it as an alternate
for non-production use,

In Apache Big Data 2016 NA, some users also mentioned that they need HDFS
implementation. Currently it's pending, but I and Varun tried to work to
support HDFS backend(YARN-3874). As Karthik mentioned, it's useful for
early users to try v2.0 APIs though it's doesn't scale. IMHO, it's useful
for small cluster(e.g. smaller than 10 machines). After merging the current
implementation into trunk, I'm interested in resuming YARN-3874 work(maybe
Varun is also interested in).

- Tsuyoshi

> Explore supporting a simpler back-end implementation for ATS v2
> ---------------------------------------------------------------
>                 Key: YARN-5281
>                 URL: https://issues.apache.org/jira/browse/YARN-5281
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: timelineserver
>    Affects Versions: YARN-2928
>            Reporter: Joep Rottinghuis
> During the merge discussion [~kasha] raised the question whether we would support simpler
backend for users to try out, in addition to the HBase implementation.
> The understanding is that this would not be meant to scale, but it could simplify initial
adoption and early usage.
> I'm filing this jira to gather the merits and challenges of such approach in one place.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message