hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ravi Gummadi (JIRA)" <j...@apache.org>
Subject [jira] Updated: (MAPREDUCE-890) After HADOOP-4491, the user who started mapred system is not able to run job.
Date Thu, 21 Jan 2010 05:04:55 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ravi Gummadi updated MAPREDUCE-890:
-----------------------------------

    Assignee: Ravi Gummadi  (was: Vinod K V)
      Status: Open  (was: Patch Available)

Setting drwxrws--- for jobcache and distcache directories allows users to create files in
these directories and as these directories won't be cleaned up for each job(will be cleaned
up only when TT is restarted), this can cause space issues.

So I propose considering tt_user running MR job as a special case and handle that in a special
way. i.e. set drwxrwx--- for distcache and jobcache only for jobs of tt_user. This keeps the
security of these dirs for all other users as it is there in current trunk.

Thoughts ?

> After HADOOP-4491, the user who started mapred system is not able to run job.
> -----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-890
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-890
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tasktracker
>            Reporter: Karam Singh
>            Assignee: Ravi Gummadi
>            Priority: Blocker
>             Fix For: 0.21.0
>
>         Attachments: MAPREDUCE-890-20090904.txt, MAPREDUCE-890-20090909.txt
>
>
> Even setup and cleanup task of job fails due exception -: It fails to create job and
related directories under mapred.local.dir/taskTracker/jobcache
> Directories are created as -:
> [dr-xrws--- mapred   hadoop  ]  job_200908190916_0002
> mapred is not wrtie under this. Even manually I failed to touch file.
> mapred is use of started mr cluster 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message