hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsuyoshi OZAWA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1776) renewDelegationToken should survive RM failover
Date Thu, 20 Mar 2014 07:30:44 GMT

    [ https://issues.apache.org/jira/browse/YARN-1776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13941484#comment-13941484

Tsuyoshi OZAWA commented on YARN-1776:

[~zjshen], For FileSystemRMStateStore, I thought RM-HA is also supposed to work with HDFS.
Is this wrong? IMO, we can handle the case with temporary file as follows:

1. Create UPDATING file, which includes both new delegation token information and old delegation
token information.
2. Create new delegation token file.
3. Delete obsolete delegation token file. 
4. Delete UPDATING file.

At recovery time, if RM find UPDATING file, we can recover the state of RMStateStore with

> renewDelegationToken should survive RM failover
> -----------------------------------------------
>                 Key: YARN-1776
>                 URL: https://issues.apache.org/jira/browse/YARN-1776
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Zhijie Shen
>            Assignee: Zhijie Shen
>         Attachments: YARN-1776.1.patch
> When a delegation token is renewed, two RMStateStore operations: 1) removing the old
DT, and 2) storing the new DT will happen. If RM fails in between. There would be problem.

This message was sent by Atlassian JIRA

View raw message