hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Varun Saxena (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3643) Provide a way to store only running applications in the state store
Date Sun, 05 Jul 2015 08:51:05 GMT

    [ https://issues.apache.org/jira/browse/YARN-3643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14614185#comment-14614185

Varun Saxena commented on YARN-3643:

But based on this, how do we go about backward compatibility for YARN-2962 ? Maybe we can
write a tool(provide a command line option in RM) to migrate apps from one scheme to another.
Thoughts ?

> Provide a way to store only running applications in the state store
> -------------------------------------------------------------------
>                 Key: YARN-3643
>                 URL: https://issues.apache.org/jira/browse/YARN-3643
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: resourcemanager
>    Affects Versions: 2.7.0
>            Reporter: Karthik Kambatla
>            Assignee: Varun Saxena
> Today, we have a config that determines the number of applications that can be stored
in the state-store. Since there is no easy way to figure out the maximum number of running
applications at any point in time, users are forced to use a conservative estimate. Our default
ends up being even more conservative.
> It would be nice to allow storing all running applications with a conservative upper
bound for it. This should allow for shorter recovery times in most deployments. 

This message was sent by Atlassian JIRA

View raw message