hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hemanth Yamijala (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-4490) Map and Reduce tasks should run as the user who submitted the job
Date Thu, 05 Mar 2009 11:17:56 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-4490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12679158#action_12679158

Hemanth Yamijala commented on HADOOP-4490:

Mahadev, thanks for debugging this issue. The problem was that the permissions being used
in LinuxTaskController were making an assumption that files submitted to the cluster, say
via streaming jobs, or in distributed cache, will *already* be executable if they need to
be executed as part of the tasks. However, there seem to be scenarios in which this is not
mandated, and the framework handles this in the default case (when user tasks are run as the
tasktracker itself). The right fix is to modify the permissions without this assumption. If
we do that, I guess the change in RunJar is not necessary. One more concern is that the RunJar
change would fix the problem only for jar files, but not for other types of archives. We are
testing this (with the failed streaming test case) with the modified permissions in LinuxTaskController.
If that works, I suggest we just use the new version of the LinuxTaskController itself.

Again, thanks for debugging this issue !

> Map and Reduce tasks should run as the user who submitted the job
> -----------------------------------------------------------------
>                 Key: HADOOP-4490
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4490
>             Project: Hadoop Core
>          Issue Type: Sub-task
>          Components: mapred, security
>            Reporter: Arun C Murthy
>            Assignee: Hemanth Yamijala
>             Fix For: 0.21.0
>         Attachments: hadoop-4490-design.pdf, HADOOP-4490.patch, HADOOP-4490.patch, HADOOP-4490.patch,
HADOOP-4490.patch, HADOOP-4490.patch, HADOOP-4490.patch, HADOOP-4490.patch, HADOOP-4490_streaming.patch
> Currently the TaskTracker spawns the map/reduce tasks, resulting in them running as the
user who started the TaskTracker.
> For security and accounting purposes the tasks should be run as the job-owner.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message