Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: mapreduce-issues@hadoop.apache.org
Date: Tue, 14 Jan 2014 01:49:54 +0000 (UTC)
From: "Siddharth Seth (JIRA)" <jira@apache.org>
To: mapreduce-issues@hadoop.apache.org
Message-ID: <JIRA.12682266.1386029238174.90925.1389664194899@arcas>
In-Reply-To: <JIRA.12682266.1386029238174@arcas>
References: <JIRA.12682266.1386029238174@arcas>
Subject: [jira] [Commented] (MAPREDUCE-5663) Add an interface to Input/Ouput
 Formats to obtain delegation tokens
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/MAPREDUCE-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13870282#comment-13870282 ] 

Siddharth Seth commented on MAPREDUCE-5663:
-------------------------------------------

That's only for the submission directory. The tokens for the actual data may be different, and is tied to the I/OFormats. Does this code actually get invoked when submitting a job to Oozie (on the client machine) ?
What I don't understand is the following - When a job is submitted to Oozie, How does Oozie know which tokens it needs to obtain on the client machine ? (which namenodes will be used to execute the MR job / workflow, tokens from other sources ?, etc).

> Add an interface to Input/Ouput Formats to obtain delegation tokens
> -------------------------------------------------------------------
>
>                 Key: MAPREDUCE-5663
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5663
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>            Reporter: Siddharth Seth
>            Assignee: Michael Weng
>         Attachments: MAPREDUCE-5663.4.txt, MAPREDUCE-5663.5.txt, MAPREDUCE-5663.6.txt, MAPREDUCE-5663.patch.txt, MAPREDUCE-5663.patch.txt2, MAPREDUCE-5663.patch.txt3
>
>
> Currently, delegation tokens are obtained as part of the getSplits / checkOutputSpecs calls to the InputFormat / OutputFormat respectively.
> This works as long as the splits are generated on a node with kerberos credentials. For split generation elsewhere (AM for example), an explicit interface is required.


--
This message was sent by Atlassian JIRA
(v6.1.5#6160)