hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2674) Distributed shell AM may re-launch containers if RM work preserving restart happens
Date Tue, 01 May 2018 15:27:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-2674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16459760#comment-16459760

Hudson commented on YARN-2674:

SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14099 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/14099/])
YARN-2674. Fix distributed shell AM container relaunch during RM work (billie: rev 4e1382aca4cf23ca229bdd24e0f143c22449b329)
* (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/ApplicationMaster.java
* (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/TestDSAppMaster.java

> Distributed shell AM may re-launch containers if RM work preserving restart happens
> -----------------------------------------------------------------------------------
>                 Key: YARN-2674
>                 URL: https://issues.apache.org/jira/browse/YARN-2674
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: applications, resourcemanager
>            Reporter: Chun Chen
>            Assignee: Shane Kumpf
>            Priority: Major
>              Labels: oct16-easy
>             Fix For: 3.2.0, 3.1.1
>         Attachments: YARN-2674.1.patch, YARN-2674.2.patch, YARN-2674.3.patch, YARN-2674.4.patch,
YARN-2674.5.patch, YARN-2674.6.patch, YARN-2674.7.patch
> Currently, if RM work preserving restart happens while distributed shell is running,
distribute shell AM may re-launch all the containers, including new/running/complete. We must
make sure it won't re-launch the running/complete containers.
> We need to remove allocated containers from AMRMClientImpl#remoteRequestsTable once AM
receive them from RM. 

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message