hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jian He (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3439) RM fails to renew token when Oozie launcher leaves before sub-job finishes
Date Tue, 07 Apr 2015 18:18:13 GMT

    [ https://issues.apache.org/jira/browse/YARN-3439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14483685#comment-14483685
] 

Jian He commented on YARN-3439:
-------------------------------

IIUC, isn't this a long-standing issue that Ozzie doesn't set "mapreduce.job.complete.cancel.delegation.tokens"
to false for standard MR Job ? according to [here | https://issues.apache.org/jira/browse/YARN-2964?focusedCommentId=14250926&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14250926].
Should we set it to false on Ozzie side ?

> RM fails to renew token when Oozie launcher leaves before sub-job finishes
> --------------------------------------------------------------------------
>
>                 Key: YARN-3439
>                 URL: https://issues.apache.org/jira/browse/YARN-3439
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: resourcemanager
>    Affects Versions: 2.7.0
>            Reporter: Jason Lowe
>            Assignee: Daryn Sharp
>            Priority: Blocker
>         Attachments: YARN-3439.001.patch
>
>
> When the Oozie launcher runs a standard MapReduce job (not Pig) it doesn't linger waiting
for the sub-job to finish.  At that point the RM stops renewing delegation tokens for the
launcher job which wreaks havoc on the sub-job if the sub-job runs long enough for the tokens
to expire.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message