hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Joseph Evans (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-4148) MapReduce should not have a compile-time dependency on HDFS
Date Tue, 01 May 2012 17:38:49 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-4148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13265927#comment-13265927
] 

Robert Joseph Evans commented on MAPREDUCE-4148:
------------------------------------------------

I agree with Daryn on this.  I don't really like using the static block to register things.
 We have had issues in the past in the RM where renewing delegation tokens did not work because
the HDFS configuration files were not loaded in a static block because there was no reference
to the class with the static block in the code being run.  It was a beast to debug too.

I would prefer to see something that uses a ServiceLoader, or like Daryn said something from
the secret manager could ensure that those static blocks are called for all of them that it
cares about, but I think the service loader is the direction that a lot of the code has been
going in.
                
> MapReduce should not have a compile-time dependency on HDFS
> -----------------------------------------------------------
>
>                 Key: MAPREDUCE-4148
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4148
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Tom White
>            Assignee: Tom White
>         Attachments: MAPREDUCE-4148.patch, MAPREDUCE-4148.patch
>
>
> MapReduce depends on HDFS's DelegationTokenIdentifier (for printing token debug information).
We should remove this dependency and MapReduce's compile-time dependency on HDFS.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message