Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: mapreduce-issues@hadoop.apache.org
Message-ID: <1117161730.1261460658105.JavaMail.jira@brutus>
Date: Tue, 22 Dec 2009 05:44:18 +0000 (UTC)
From: "Hemanth Yamijala (JIRA)" <jira@apache.org>
To: mapreduce-issues@hadoop.apache.org
Subject: [jira] Updated: (MAPREDUCE-896) Users can set non-writable
 permissions on temporary files for TT and can abuse disk usage.
In-Reply-To: <795470237.1250829494816.JavaMail.jira@brutus>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


     [ https://issues.apache.org/jira/browse/MAPREDUCE-896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hemanth Yamijala updated MAPREDUCE-896:
---------------------------------------

    Attachment: MR-896.v6.patch

In MAPREDUCE-181, the job submission mechanism was changed to transfer job info via a staging directory and the jobtracker completely owns creation of the job directory under the mapreduce system directory. As a result, the code in Jobtracker to do with cleaning up the mapred system directory using the cleanup queue when job submission fails, is no longer needed. Note that the staging directory is cleaned up on client in a finally block, so the functionality is still available, though not in Jobtracker.

The new patch removes changes in Jobtracker.java and adjusts a merge conflict in JobInProgress.java. Other things are the same.

> Users can set non-writable permissions on temporary files for TT and can abuse disk usage.
> ------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-896
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-896
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tasktracker
>    Affects Versions: 0.21.0
>            Reporter: Vinod K V
>            Assignee: Ravi Gummadi
>             Fix For: 0.21.0
>
>         Attachments: MR-896.patch, MR-896.v1.patch, MR-896.v2.patch, MR-896.v3.patch, MR-896.v4.patch, MR-896.v5.patch, MR-896.v6.patch, y896.v1.patch, y896.v2.1.fix.patch, y896.v2.1.fix.v1.patch, y896.v2.1.fix.v2.patch, y896.v2.1.patch, y896.v2.patch
>
>
> As of now, irrespective of the TaskController in use, TT itself does a full delete on local files created by itself or job tasks. This step, depending upon TT's umask and the permissions set by files by the user, for e.g in job-work/task-work or child.tmp directories, may or may not go through successful completion fully. Thus is left an opportunity for abusing disk space usage either accidentally or intentionally by TT/users.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.