hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-4951) FsShell commands using secure httpfs throw exceptions due to missing TokenRenewer
Date Wed, 10 Jul 2013 10:55:53 GMT

    [ https://issues.apache.org/jira/browse/HDFS-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13704421#comment-13704421
] 

Hudson commented on HDFS-4951:
------------------------------

Integrated in Hadoop-Yarn-trunk #266 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/266/])
    HDFS-4951. FsShell commands using secure httpfs throw exceptions due to missing TokenRenewer.
(rknater via tucu) (Revision 1501451)

     Result = SUCCESS
tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1501451
Files : 
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/client/HttpFSKerberosAuthenticator.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/lib/service/DelegationTokenIdentifier.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

                
> FsShell commands using secure httpfs throw exceptions due to missing TokenRenewer
> ---------------------------------------------------------------------------------
>
>                 Key: HDFS-4951
>                 URL: https://issues.apache.org/jira/browse/HDFS-4951
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 2.1.0-beta
>            Reporter: Robert Kanter
>            Assignee: Robert Kanter
>             Fix For: 2.1.0-beta
>
>         Attachments: HDFS-4951.patch, HDFS-4951.patch
>
>
> It looks like there isn't a {{TokenRenewer}} for HttpFS delegation tokens ({{HTTPFS_DELEGATION_TOKENS}}
tokens, so when it goes to cancel the token, it throws an exception:
> {noformat}
> $ hadoop fs -ls webhdfs://host:14000
> // File listing omitted
> 13/06/21 13:09:04 WARN token.Token: No TokenRenewer defined for token kind HTTPFS_DELEGATION_TOKEN
> 13/06/21 13:09:04 WARN util.ShutdownHookManager: ShutdownHook 'ClientFinalizer' failed,
java.lang.UnsupportedOperationException: Token cancel is not supported  for HTTPFS_DELEGATION_TOKEN
tokens
> java.lang.UnsupportedOperationException: Token cancel is not supported  for HTTPFS_DELEGATION_TOKEN
tokens
> 	at org.apache.hadoop.security.token.Token$TrivialRenewer.cancel(Token.java:417)
> 	at org.apache.hadoop.security.token.Token.cancel(Token.java:382)
> 	at org.apache.hadoop.fs.DelegationTokenRenewer$RenewAction.cancel(DelegationTokenRenewer.java:146)
> 	at org.apache.hadoop.fs.DelegationTokenRenewer$RenewAction.access$200(DelegationTokenRenewer.java:58)
> 	at org.apache.hadoop.fs.DelegationTokenRenewer.removeRenewAction(DelegationTokenRenewer.java:233)
> 	at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.close(WebHdfsFileSystem.java:790)
> 	at org.apache.hadoop.fs.FileSystem$Cache.closeAll(FileSystem.java:2398)
> 	at org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer.run(FileSystem.java:2414)
> 	at org.apache.hadoop.util.ShutdownHookManager$1.run(ShutdownHookManager.java:54)
> {noformat}
> WebHDFS doesn't have this problem because it has a {{TokenRenewer}} for its delegation
tokens ({{"WEBHDFS delegation"}} tokens).  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message