hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hemanth Yamijala (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-3103) [HOD] Hadoop.tmp.dir should not be set to cluster directory
Date Thu, 27 Mar 2008 14:07:24 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-3103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12582655#action_12582655
] 

Hemanth Yamijala commented on HADOOP-3103:
------------------------------------------

+1 for the patch. Validated against both 16 branch and trunk. Verified the hadoop.tmp.dir
value is set to the hod.temp-dir and dfs.client.buffer.dir is set to hadoop.tmp.dir/dfs/tmp.
Verified also that while running a job, the jar file is expanded in this directory, and it
is cleaned up at the end.

> [HOD] Hadoop.tmp.dir should not be set to cluster directory
> -----------------------------------------------------------
>
>                 Key: HADOOP-3103
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3103
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: contrib/hod
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Vinod Kumar Vavilapalli
>            Priority: Blocker
>             Fix For: 0.16.2
>
>         Attachments: HADOOP-3103, HADOOP-3103.1.for.16, HADOOP-3103.1.for.17, HADOOP-3103.for.16,
HADOOP-3103.for.17
>
>
> Currently HOD generates  hadoop.tmp.dir pointing to the cluster directory(hod.clusterdir),
which users typically create in their home directories. This hadoop.tmp.dir is used on the
client side when a jar is run(org/apache/hadoop/util/RunJar.java). The user home directories
might be NFS mounted in some environments, which might result in a hit, for example when running
a jar.
> So, HOD *should not* generate hadoop.tmp.dir pointing to cluster directory. Instead,
it should use hod.temp-dir, which *is* the location that dfs.client.buffer.dir uses to alleviate
any such NFS hit problems. Further, though currently hadoop.tmp.dir is not used on hadoop
daemons side, it would be good if HOD generates it on daemons side too, and thus preclude
any related problems in future.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message