hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthew Paduano (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-13123) Permit the default hadoop delegation token file format to be configurable
Date Tue, 10 May 2016 00:25:12 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-13123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277398#comment-15277398

Matthew Paduano commented on HADOOP-13123:

2016-05-09 16:12:18,733 [ERROR] [main] |app.DAGAppMaster|: Error starting DAGAppMaster
java.io.IOException: Exception reading /tmp/hadoop-llu/nm-local-dir/usercache/llu/appcache/application_1462833671675_0001/container_e03_1462833671675_0001_01_000001/container_tokens
        at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:197)
        at org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:789)
        at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:748)
        at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:621)
        at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2345)
Caused by: java.io.IOException: Unknown version 1 in token storage.
        at org.apache.hadoop.security.Credentials.readTokenStorageStream(Credentials.java:*215*)
        at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:*194*)
        ... 4 more

note that the file line numbers in the stack trace complaining of "unknown version 1" correspond
to pre-dtutil code.

> Permit the default hadoop delegation token file format to be configurable
> -------------------------------------------------------------------------
>                 Key: HADOOP-13123
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13123
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Matthew Paduano
>            Assignee: Matthew Paduano
> If one environment updates to using the new dtutil code and accompanying Credentials
code, there is a backward compatibility issue with the default file format being JAVA.  Older
clients need to be updated to ask for a file in the legacy format (FORMAT_JAVA).  
> As an aid to users in this trap, we can add a configuration property to set the default
file format.  When set to FORMAT_JAVA, the new server code will serve up legacy files without
being asked.  The default value for this property will remain FORMAT_PB.  But affected users
can add this config option to the services using the newer code.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message