hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gergo Repas (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-5028) RMStateStore should trim down app state for completed applications
Date Tue, 13 Feb 2018 14:24:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16362390#comment-16362390
] 

Gergo Repas commented on YARN-5028:
-----------------------------------

[~yufeigu] The two fields that are needed for the unit tests to pass are:
 # AMContainerResourceRequests
 ** needed for multiple TestWorkPreservingRMRestart tests
 ** if this field is not present the following exception is being thrown: [https://github.com/apache/hadoop/blob/0c5d7d71a80bccd4ad7eab269d0727b999606a7e/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMAppManager.java#L494]
# ApplicationType
** needed for TestRMRestart
** the exception when this field is not present: {code}java.lang.NullPointerException
        at org.apache.hadoop.util.StringUtils.toLowerCase(StringUtils.java:1127)
        at org.apache.hadoop.yarn.server.resourcemanager.ClientRMService.getApplications(ClientRMService.java:869)
        at org.apache.hadoop.yarn.server.resourcemanager.TestRMRestart.testRMRestartGetApplicationList(TestRMRestart.java:1017)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
        at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
        at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
        at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
        at org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
{code}

> RMStateStore should trim down app state for completed applications
> ------------------------------------------------------------------
>
>                 Key: YARN-5028
>                 URL: https://issues.apache.org/jira/browse/YARN-5028
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: resourcemanager
>    Affects Versions: 2.8.0
>            Reporter: Karthik Kambatla
>            Assignee: Gergo Repas
>            Priority: Major
>         Attachments: YARN-5028.000.patch, YARN-5028.001.patch, YARN-5028.002.patch
>
>
> RMStateStore stores enough information to recover applications in case of a restart.
The store also retains this information for completed applications to serve their status to
REST, WebUI, Java and CLI clients. We don't need all the information we store today to serve
application status; for instance, we don't need the {{ApplicationSubmissionContext}}. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message