hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shane Kumpf (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2674) Distributed shell AM may re-launch containers if RM work preserving restart happens
Date Tue, 17 Apr 2018 12:17:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-2674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16440797#comment-16440797

Shane Kumpf commented on YARN-2674:

Attaching a patch based on [~chenchun]'s previous work. I did not include the mini cluster
based RM failover integration test as the allocation test appears sufficient here. The existing
mini cluster based integration tests take quite a while to run already, so I'm not keen to
add another. If others feel that test is needed, I'll can add it.

> Distributed shell AM may re-launch containers if RM work preserving restart happens
> -----------------------------------------------------------------------------------
>                 Key: YARN-2674
>                 URL: https://issues.apache.org/jira/browse/YARN-2674
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: applications, resourcemanager
>            Reporter: Chun Chen
>            Assignee: Shane Kumpf
>            Priority: Major
>              Labels: oct16-easy
>         Attachments: YARN-2674.1.patch, YARN-2674.2.patch, YARN-2674.3.patch, YARN-2674.4.patch,
YARN-2674.5.patch, YARN-2674.6.patch
> Currently, if RM work preserving restart happens while distributed shell is running,
distribute shell AM may re-launch all the containers, including new/running/complete. We must
make sure it won't re-launch the running/complete containers.
> We need to remove allocated containers from AMRMClientImpl#remoteRequestsTable once AM
receive them from RM. 

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message