hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod K V (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-2089) JobToken should be passed over RPC
Date Thu, 30 Sep 2010 07:00:38 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12916394#action_12916394
] 

Vinod K V commented on MAPREDUCE-2089:
--------------------------------------

A related point I noted is that the Child task needs the token file irrespective of whether
security is turned on or off. This can be skipped for no-security, can we do that here too?

> JobToken should be passed over RPC
> ----------------------------------
>
>                 Key: MAPREDUCE-2089
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2089
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: client, job submission, jobtracker, security, task, tasktracker
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.22.0
>
>         Attachments: mr-2089.patch, mr-2089.patch
>
>
> JobToken file is currently created by the JobTracker, and stored in the HDFS. Later on,
the TaskTrackers pull that file from the HDFS as part of job localization. The HDFS operations
can be avoided if the the jobToken file is passed over RPC (Jobclient -> JobTracker ->
TaskTrackers).

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message