hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Devaraj Das (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1383) Allow storage and caching of delegation token.
Date Wed, 27 Jan 2010 08:48:09 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12805425#action_12805425
] 

Devaraj Das commented on MAPREDUCE-1383:
----------------------------------------

[exec] compile-aspects:
     [exec]      [echo] 1.6
     [exec]      [echo] Start weaving aspects in place
     [exec]      [iajc] /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h6.grid.sp2.yahoo.net/trunk/src/java/org/apache/hadoop/mapreduce/JobSubmitter.java:39
[error] The import org.apache.hadoop.hdfs cannot be resolved
     [exec]      [iajc] import org.apache.hadoop.hdfs.DistributedFileSystem;
     [exec]      [iajc]        ^^^^^^^^^^^^^^^^^^^^^
     [exec]      [iajc] /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h6.grid.sp2.yahoo.net/trunk/src/java/org/apache/hadoop/mapreduce/JobSubmitter.java:40
[error] The import org.apache.hadoop.hdfs cannot be resolved
     [exec]      [iajc] import org.apache.hadoop.hdfs.security.token.DelegationTokenIdentifier;
     [exec]      [iajc]        ^^^^^^^^^^^^^^^^^^^^^
     [exec]      [iajc] /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h6.grid.sp2.yahoo.net/trunk/src/java/org/apache/hadoop/mapreduce/JobSubmitter.java:41
[error] The import org.apache.hadoop.hdfs cannot be resolved
     [exec]      [iajc] import org.apache.hadoop.hdfs.server.namenode.NameNode;
     [exec]      [iajc]        ^^^^^^^^^^^^^^^^^^^^^
     [exec]      [iajc] /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h6.grid.sp2.yahoo.net/trunk/src/java/org/apache/hadoop/mapreduce/security/TokenCache.java:32
[error] The import org.apache.hadoop.hdfs cannot be resolved
     [exec]      [iajc] import org.apache.hadoop.hdfs.DistributedFileSystem;
     [exec]      [iajc]        ^^^^^^^^^^^^^^^^^^^^^
     [exec]      [iajc] /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h6.grid.sp2.yahoo.net/trunk/src/java/org/apache/hadoop/mapreduce/security/TokenCache.java:33
[error] The import org.apache.hadoop.hdfs cannot be resolved
     [exec]      [iajc] import org.apache.hadoop.hdfs.security.token.DelegationTokenIdentifier;
     [exec]      [iajc]        ^^^^^^^^^^^^^^^^^^^^^
     [exec]      [iajc] /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h6.grid.sp2.yahoo.net/trunk/src/java/org/apache/hadoop/mapreduce/security/TokenCache.java:99
[error] DelegationTokenIdentifier cannot be resolved to a type
     [exec]      [iajc] public static Token<DelegationTokenIdentifier> getDelegationToken(String
namenode) {
     [exec]      [iajc]                     ^^^^^^^^^^^^^^^^^^^^^^
     [exec]      [iajc] /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h6.grid.sp2.yahoo.net/trunk/src/java/org/apache/hadoop/mapreduce/security/TokenCache.java:181
[error] DistributedFileSystem cannot be resolved to a type
     [exec]      [iajc] if(fs instanceof DistributedFileSystem) {
     [exec]      [iajc]                  ^^^^^^^^^^^^^^
     [exec]      [iajc] /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h6.grid.sp2.yahoo.net/trunk/src/java/org/apache/hadoop/mapreduce/security/TokenCache.java:182
[error] DistributedFileSystem cannot be resolved to a type
     [exec]      [iajc] DistributedFileSystem dfs = (DistributedFileSystem)fs;
     [exec]      [iajc] ^^^^^^^^^^^^
     [exec]      [iajc] /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h6.grid.sp2.yahoo.net/trunk/src/java/org/apache/hadoop/mapreduce/security/TokenCache.java:182
[error] DistributedFileSystem cannot be resolved to a type
     [exec]      [iajc] DistributedFileSystem dfs = (DistributedFileSystem)fs;
     [exec]      [iajc]                              ^^^^^^^^^^^^
     [exec]      [iajc] /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h6.grid.sp2.yahoo.net/trunk/src/java/org/apache/hadoop/mapreduce/security/TokenCache.java:186
[error] DelegationTokenIdentifier cannot be resolved to a type
     [exec]      [iajc] Token<DelegationTokenIdentifier> token = 
     [exec]      [iajc]       ^^^^^^^^^^^^^^^^
     [exec]      [iajc] /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h6.grid.sp2.yahoo.net/trunk/src/java/org/apache/hadoop/mapreduce/security/TokenCache.java:187
[error] The method getDelegationToken(String) is undefined for the type TokenCache
     [exec]      [iajc] TokenCache.getDelegationToken(fs_uri); 
     [exec]      [iajc]            ^^^^^^^
     [exec]      [iajc] 
     [exec]      [iajc] 11 errors
     [exec] 
     [exec] BUILD FAILED

This is there is the log of the build. The reason for this is the hdfs jar is not present
in the classpath when compile-aspects is running. Is there a way to avoid having to import
hdfs.* in the patch.

> Allow storage and caching of delegation token.
> ----------------------------------------------
>
>                 Key: MAPREDUCE-1383
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>            Reporter: Boris Shkolnik
>         Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch,
MAPREDUCE-1383-6.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going to work with
and pass it to the application.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message