hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hemanth Yamijala (JIRA)" <j...@apache.org>
Subject [jira] Updated: (MAPREDUCE-896) Users can set non-writable permissions on temporary files for TT and can abuse disk usage.
Date Tue, 22 Dec 2009 05:44:18 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Hemanth Yamijala updated MAPREDUCE-896:

    Attachment: MR-896.v6.patch

In MAPREDUCE-181, the job submission mechanism was changed to transfer job info via a staging
directory and the jobtracker completely owns creation of the job directory under the mapreduce
system directory. As a result, the code in Jobtracker to do with cleaning up the mapred system
directory using the cleanup queue when job submission fails, is no longer needed. Note that
the staging directory is cleaned up on client in a finally block, so the functionality is
still available, though not in Jobtracker.

The new patch removes changes in Jobtracker.java and adjusts a merge conflict in JobInProgress.java.
Other things are the same.

> Users can set non-writable permissions on temporary files for TT and can abuse disk usage.
> ------------------------------------------------------------------------------------------
>                 Key: MAPREDUCE-896
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-896
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tasktracker
>    Affects Versions: 0.21.0
>            Reporter: Vinod K V
>            Assignee: Ravi Gummadi
>             Fix For: 0.21.0
>         Attachments: MR-896.patch, MR-896.v1.patch, MR-896.v2.patch, MR-896.v3.patch,
MR-896.v4.patch, MR-896.v5.patch, MR-896.v6.patch, y896.v1.patch, y896.v2.1.fix.patch, y896.v2.1.fix.v1.patch,
y896.v2.1.fix.v2.patch, y896.v2.1.patch, y896.v2.patch
> As of now, irrespective of the TaskController in use, TT itself does a full delete on
local files created by itself or job tasks. This step, depending upon TT's umask and the permissions
set by files by the user, for e.g in job-work/task-work or child.tmp directories, may or may
not go through successful completion fully. Thus is left an opportunity for abusing disk space
usage either accidentally or intentionally by TT/users.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message