hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Luca Telloli (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-2925) [HOD] Create mapred system directory using a naming convention that will avoid clashes in multi-user shared cluster scenario.
Date Tue, 04 Mar 2008 17:15:45 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-2925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12575058#action_12575058
] 

Luca Telloli commented on HADOOP-2925:
--------------------------------------

I patched the version 0.4.0 of Hadoop 0.16.0 and it worked flawlessly. Directory names do
not clash under /mapredsystem which is a very useful step waiting for HADOOP-2899. 

Thanks,
Luca

> [HOD] Create mapred system directory using a naming convention that will avoid clashes
in multi-user shared cluster scenario.
> -----------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-2925
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2925
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: contrib/hod
>    Affects Versions: 0.16.0
>            Reporter: Hemanth Yamijala
>            Assignee: Hemanth Yamijala
>             Fix For: 0.16.1
>
>         Attachments: 2925.patch
>
>
> Currently, HOD generates the name of the mapredsystem directory using the name /mapredsystem/hostname-of-jobtracker.
> In HADOOP-2899, we ran into a scenario where this naming convention could lead to problems
in case dfs permissions are enabled. While the bug should ideally be addressed in Hadoop M/R,
it will be better that HOD does not generate names that can potentially clash across runs.
One way to solve the problem is to do what HOD already does for local log and temp directories
- name it using username.torque-job-id, which is going to be pretty unique mostly.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message