hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-4951) FsShell commands using secure httpfs throw exceptions due to missing TokenRenewer
Date Tue, 09 Jul 2013 00:53:49 GMT

    [ https://issues.apache.org/jira/browse/HDFS-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13702711#comment-13702711
] 

Hadoop QA commented on HDFS-4951:
---------------------------------

{color:red}-1 overall{color}.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12591321/HDFS-4951.patch
  against trunk revision .

    {color:green}+1 @author{color}.  The patch does not contain any @author tags.

    {color:red}-1 tests included{color}.  The patch doesn't appear to include any new or modified
tests.
                        Please justify why no new tests are needed for this patch.
                        Also please list what manual steps were performed to verify this patch.

    {color:green}+1 javac{color}.  The applied patch does not increase the total number of
javac compiler warnings.

    {color:green}+1 javadoc{color}.  The javadoc tool did not generate any warning messages.

    {color:green}+1 eclipse:eclipse{color}.  The patch built with eclipse:eclipse.

    {color:green}+1 findbugs{color}.  The patch does not introduce any new Findbugs (version
1.3.9) warnings.

    {color:green}+1 release audit{color}.  The applied patch does not increase the total number
of release audit warnings.

    {color:red}-1 core tests{color}.  The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs-httpfs:

                  org.apache.hadoop.fs.http.client.TestHttpFSFWithWebhdfsFileSystem

    {color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/4608//testReport/
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/4608//console

This message is automatically generated.
                
> FsShell commands using secure httpfs throw exceptions due to missing TokenRenewer
> ---------------------------------------------------------------------------------
>
>                 Key: HDFS-4951
>                 URL: https://issues.apache.org/jira/browse/HDFS-4951
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 3.0.0
>            Reporter: Robert Kanter
>            Assignee: Robert Kanter
>         Attachments: HDFS-4951.patch
>
>
> It looks like there isn't a {{TokenRenewer}} for HttpFS delegation tokens ({{HTTPFS_DELEGATION_TOKENS}}
tokens, so when it goes to cancel the token, it throws an exception:
> {noformat}
> $ hadoop fs -ls webhdfs://host:14000
> // File listing omitted
> 13/06/21 13:09:04 WARN token.Token: No TokenRenewer defined for token kind HTTPFS_DELEGATION_TOKEN
> 13/06/21 13:09:04 WARN util.ShutdownHookManager: ShutdownHook 'ClientFinalizer' failed,
java.lang.UnsupportedOperationException: Token cancel is not supported  for HTTPFS_DELEGATION_TOKEN
tokens
> java.lang.UnsupportedOperationException: Token cancel is not supported  for HTTPFS_DELEGATION_TOKEN
tokens
> 	at org.apache.hadoop.security.token.Token$TrivialRenewer.cancel(Token.java:417)
> 	at org.apache.hadoop.security.token.Token.cancel(Token.java:382)
> 	at org.apache.hadoop.fs.DelegationTokenRenewer$RenewAction.cancel(DelegationTokenRenewer.java:146)
> 	at org.apache.hadoop.fs.DelegationTokenRenewer$RenewAction.access$200(DelegationTokenRenewer.java:58)
> 	at org.apache.hadoop.fs.DelegationTokenRenewer.removeRenewAction(DelegationTokenRenewer.java:233)
> 	at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.close(WebHdfsFileSystem.java:790)
> 	at org.apache.hadoop.fs.FileSystem$Cache.closeAll(FileSystem.java:2398)
> 	at org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer.run(FileSystem.java:2414)
> 	at org.apache.hadoop.util.ShutdownHookManager$1.run(ShutdownHookManager.java:54)
> {noformat}
> WebHDFS doesn't have this problem because it has a {{TokenRenewer}} for its delegation
tokens ({{"WEBHDFS delegation"}} tokens).  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message