hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Subru Krishnan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-6704) Add Federation Interceptor restart when work preserving NM is enabled
Date Tue, 21 Nov 2017 22:25:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16261588#comment-16261588

Subru Krishnan commented on YARN-6704:

Thanks [~botong] for updating the patch. I went through it and have a few minor comments:
* Where are we cleaning up the registry/NMSS entries? This should be done when AM completes
and should be covered in tests.
* Can we proceed with recovery even though not work preserving for secondaries when there's
no registry setup as now we have HA and restart intermixed?
* Nit: move log level to debug for recovery of individual containers in home SC.

> Add Federation Interceptor restart when work preserving NM is enabled
> ---------------------------------------------------------------------
>                 Key: YARN-6704
>                 URL: https://issues.apache.org/jira/browse/YARN-6704
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Botong Huang
>            Assignee: Botong Huang
>         Attachments: YARN-6704-YARN-2915.v1.patch, YARN-6704-YARN-2915.v2.patch, YARN-6704.v3.patch,
YARN-6704.v4.patch, YARN-6704.v5.patch
> YARN-1336 added the ability to restart NM without loosing any running containers. {{AMRMProxy}}
restart is added in YARN-6127. In a Federated YARN environment, there's additional state in
the {{FederationInterceptor}} to allow for spanning across multiple sub-clusters, so we need
to enhance {{FederationInterceptor}} to support work-preserving restart.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message