hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yi Liu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7206) Fix warning of "token.Token: Cannot find class for token kind kms-dt" for KMS when running jobs on Encryption zones
Date Thu, 09 Oct 2014 06:20:34 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14164812#comment-14164812
] 

Yi Liu commented on HDFS-7206:
------------------------------

This warning is because {{tokenKindMap}} is initialized through service loader of {{TokenIdentifier}}
and _token kind_ is const for each one. But for {{org.apache.hadoop.security.token.delegation.web.DelegationTokenIdentifier}},
it has not been added to provider-configuration file and the _token kind_ is variable, so
service loader can't find it.

dt for KMS is in this case.  It works fine since server side construct that kind of token
identifier directly, this warnings happen in client side where try to log the token and need
to decode it. 

The patch simply suppresses the warnings to debug message, otherwise there are too many such
warning and will confuse user.

> Fix warning of "token.Token: Cannot find class for token kind kms-dt" for KMS when running
jobs on Encryption zones
> -------------------------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-7206
>                 URL: https://issues.apache.org/jira/browse/HDFS-7206
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: encryption
>    Affects Versions: 2.6.0
>            Reporter: Yi Liu
>            Assignee: Yi Liu
>
> This issue is produced when running MapReduce job and encryption zones are configured.
> {quote}
> 14/10/09 05:06:02 INFO security.TokenCache: Got dt for hdfs://hnode1.sh.intel.com:9000;
Kind: HDFS_DELEGATION_TOKEN, Service: 10.239.47.8:9000, Ident: (HDFS_DELEGATION_TOKEN token
21 for user)
> 14/10/09 05:06:02 WARN token.Token: Cannot find class for token kind kms-dt
> 14/10/09 05:06:02 INFO security.TokenCache: Got dt for hdfs://hnode1.sh.intel.com:9000;
Kind: kms-dt, Service: 10.239.47.8:16000, Ident: 00 04 75 73 65 72 04 79 61 72 6e 00 8a 01
48 f1 8e 85 07 8a 01 49 15 9b 09 07 04 02
> 14/10/09 05:06:03 INFO input.FileInputFormat: Total input paths to process : 1
> 14/10/09 05:06:03 INFO mapreduce.JobSubmitter: number of splits:1
> 14/10/09 05:06:03 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1412723333197_0004
> 14/10/09 05:06:03 WARN token.Token: Cannot find class for token kind kms-dt
> 14/10/09 05:06:03 WARN token.Token: Cannot find class for token kind kms-dt
> {quote}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message