crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Micah Whitacre (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CRUNCH-372) Allow MRPipeline to retrieve delegation token if available
Date Tue, 01 Apr 2014 00:47:19 GMT

    [ https://issues.apache.org/jira/browse/CRUNCH-372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13955953#comment-13955953
] 

Micah Whitacre commented on CRUNCH-372:
---------------------------------------

Should it always override or only if not specified in the Configuration already?

Also while you reference MR in Oozie is this request to make using Crunch in Oozie easier
or were you using it as an example and want to use it outside of Oozie?

> Allow MRPipeline to retrieve delegation token if available
> ----------------------------------------------------------
>
>                 Key: CRUNCH-372
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-372
>             Project: Crunch
>          Issue Type: Improvement
>          Components: Core
>    Affects Versions: 0.8.0
>            Reporter: Jeremy Beard
>            Assignee: Josh Wills
>
> Delegation tokens are used when executing MR from an Oozie workflow. MR in Crunch can
be manually set to reference the token:
> if (System.getenv("HADOOP_TOKEN_FILE_LOCATION") != null) {
>     getConf().set("mapreduce.job.credentials.binary", System.getenv("HADOOP_TOKEN_FILE_LOCATION"));
> }
> However if it would be nice if this was somewhere in the API, or perhaps automatically
handled?



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message