hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gergo Repas (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-5028) RMStateStore should trim down app state for completed applications
Date Mon, 19 Feb 2018 12:35:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369088#comment-16369088
] 

Gergo Repas commented on YARN-5028:
-----------------------------------

[~rohithsharma] [~yufeigu] - A pi job produced 1891 byte long znode with trunk code, 1866
byte long znode with trunk+YARN-5028.004.patch.

Because of the above results I created YARN-5028.005.patch which keeps only the ACL information
from the AMContainerSpec, this patch produced a 200 byte long znode for the same pi job.

> RMStateStore should trim down app state for completed applications
> ------------------------------------------------------------------
>
>                 Key: YARN-5028
>                 URL: https://issues.apache.org/jira/browse/YARN-5028
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: resourcemanager
>    Affects Versions: 2.8.0
>            Reporter: Karthik Kambatla
>            Assignee: Gergo Repas
>            Priority: Major
>         Attachments: YARN-5028.000.patch, YARN-5028.001.patch, YARN-5028.002.patch, YARN-5028.003.patch,
YARN-5028.004.patch, YARN-5028.005.patch
>
>
> RMStateStore stores enough information to recover applications in case of a restart.
The store also retains this information for completed applications to serve their status to
REST, WebUI, Java and CLI clients. We don't need all the information we store today to serve
application status; for instance, we don't need the {{ApplicationSubmissionContext}}. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message