crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jeremy Beard (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CRUNCH-372) Allow MRPipeline to retrieve delegation token if available
Date Thu, 10 Apr 2014 15:08:19 GMT

    [ https://issues.apache.org/jira/browse/CRUNCH-372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13965425#comment-13965425
] 

Jeremy Beard commented on CRUNCH-372:
-------------------------------------

I want to use it for Oozie, yes. I don't know enough about the workings and usage of delegation
tokens in Hadoop to suggest how Crunch should best handle this.

> Allow MRPipeline to retrieve delegation token if available
> ----------------------------------------------------------
>
>                 Key: CRUNCH-372
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-372
>             Project: Crunch
>          Issue Type: Improvement
>          Components: Core
>    Affects Versions: 0.8.0
>            Reporter: Jeremy Beard
>            Assignee: Josh Wills
>
> Delegation tokens are used when executing MR from an Oozie workflow. MR in Crunch can
be manually set to reference the token:
> if (System.getenv("HADOOP_TOKEN_FILE_LOCATION") != null) {
>     getConf().set("mapreduce.job.credentials.binary", System.getenv("HADOOP_TOKEN_FILE_LOCATION"));
> }
> However if it would be nice if this was somewhere in the API, or perhaps automatically
handled?



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message