hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hemanth Yamijala (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-896) Users can set non-writable permissions on temporary files for TT and can abuse disk usage.
Date Tue, 22 Dec 2009 11:46:29 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12793592#action_12793592

Hemanth Yamijala commented on MAPREDUCE-896:

TestMapReduceJobControl failed with a timeout. Locally, I ran this several times and every
time it passed. Without logs it is difficult to debug this issue. And as Ravi pointed out,
it appears it has been observed previously.

The failure in TestServiceLevelAuthorization could be explained though. Essentially, the test
case is failing at a place where it assumes that the localized job directories are cleaned
up. However, this cleanup is asynchronous in nature and hence, because of timing issues it
can fail. However, it is also true that this patch could make the failure situation a little
more probable as it does more work in the asynchronous cleanup code. Since the issue is inherently
present in the test case even without this patch, we can fix it in a follow-up JIRA. The advantage
we get is that we merge this reasonably complex patch on trunk, thereby avoiding more merge
conflicts, like I discovered today. Thoughts ?

> Users can set non-writable permissions on temporary files for TT and can abuse disk usage.
> ------------------------------------------------------------------------------------------
>                 Key: MAPREDUCE-896
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-896
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tasktracker
>    Affects Versions: 0.21.0
>            Reporter: Vinod K V
>            Assignee: Ravi Gummadi
>             Fix For: 0.21.0
>         Attachments: MR-896.patch, MR-896.v1.patch, MR-896.v2.patch, MR-896.v3.patch,
MR-896.v4.patch, MR-896.v5.patch, MR-896.v6.patch, y896.v1.patch, y896.v2.1.fix.patch, y896.v2.1.fix.v1.patch,
y896.v2.1.fix.v2.patch, y896.v2.1.patch, y896.v2.patch
> As of now, irrespective of the TaskController in use, TT itself does a full delete on
local files created by itself or job tasks. This step, depending upon TT's umask and the permissions
set by files by the user, for e.g in job-work/task-work or child.tmp directories, may or may
not go through successful completion fully. Thus is left an opportunity for abusing disk space
usage either accidentally or intentionally by TT/users.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message