hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jian Fang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-6111) Hadoop users' staging directories should be under a user folder
Date Fri, 26 Sep 2014 20:59:34 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-6111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jian Fang updated MAPREDUCE-6111:
---------------------------------
    Status: Open  (was: Patch Available)

> Hadoop users' staging directories should be under a user folder
> ---------------------------------------------------------------
>
>                 Key: MAPREDUCE-6111
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6111
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 2.4.1, 2.5.0
>            Reporter: Jian Fang
>         Attachments: MAPREDUCE-6111.patch
>
>
> Right now, Hadoop puts all users' staging directories under /tmp/hadoop-yarn/staging/,
for example /tmp/hadoop-yarn/staging/hadoop for user hadoop, but the directory /tmp/hadoop-yarn/staging
is also used for other purpose. For example, /tmp/hadoop-yarn/staging/history/ is used to
hold finished JHS files. The shared parent /tmp/hadoop-yarn/staging makes it difficult to
track all users' folders without adding extra logic to exclude other known folders. 
> As a result, we should move all users' folders to a user sub-folder, i.e., /tmp/hadoop-yarn/staging/user/.
In this case, user hadoop's staging folder becomes /tmp/hadoop-yarn/staging/user/hadoop/.staging.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message