hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daryn Sharp (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3911) Pending Jobs Metric can get off if job is submitted with invalid HDFS delegation token.
Date Mon, 27 Feb 2012 15:26:49 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13217224#comment-13217224
] 

Daryn Sharp commented on MAPREDUCE-3911:
----------------------------------------

{{DelegationTokenRenewal}} is used to renew the job's tokens.  It will attempt an immediate
renewal, but the problem is the first renewal is performed in a background thread that ignores
renewal failures.  If the first renewal is performed in the job's thread context, then an
invalid token will abort the job.

I posted a patch a few months ago that fixed this very issue.  Unfortunately I'm having trouble
finding the jira.
                
> Pending Jobs Metric can get off if job is submitted with invalid HDFS delegation token.
> ---------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3911
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3911
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv1
>    Affects Versions: 1.0.0
>            Reporter: Robert Joseph Evans
>
> If a job is submitted, but the HDFS delegation token is invalid, The pending jobs counter
will be incremented, then an exception will be thrown when we cannot get an instance of FileSystem
to read the jobs configuration.  The error is returned, but the pending counter is never decremented.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message