hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Junping Du (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-3449) Recover appTokenKeepAliveMap upon nodemanager restart
Date Sat, 04 Apr 2015 01:07:33 GMT
Junping Du created YARN-3449:
--------------------------------

             Summary: Recover appTokenKeepAliveMap upon nodemanager restart
                 Key: YARN-3449
                 URL: https://issues.apache.org/jira/browse/YARN-3449
             Project: Hadoop YARN
          Issue Type: Sub-task
          Components: nodemanager
    Affects Versions: 2.6.0, 2.7.0
            Reporter: Junping Du
            Assignee: Junping Du


appTokenKeepAliveMap in NodeStatusUpdaterImpl is used to keep application alive after application
is finished but NM still need app token to do log aggregation (when enable security and log
aggregation). 
The applications are only inserted into this map when receiving getApplicationsToCleanup()
from RM heartbeat response. And RM only send this info one time in RMNodeImpl.updateNodeHeartbeatResponseForCleanup().
NM restart work preserving should put appTokenKeepAliveMap into NMStateStore and get recovered
after restart. Without doing this, RM could terminate application earlier, so log aggregation
could be failed if security is enabled.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message