Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-issues@hadoop.apache.org
Date: Wed, 24 Oct 2012 12:24:13 +0000 (UTC)
From: "Robert Justice (JIRA)" <jira@apache.org>
To: common-issues@hadoop.apache.org
Message-ID: <814118183.21355.1351081453849.JavaMail.jiratomcat@arcas>
Subject: [jira] [Created] (HADOOP-8970) Need a different environment
 variable or configuration that states where local temporary files are
 stored than hadoop.tmp.dir
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit

Robert Justice created HADOOP-8970:
--------------------------------------

             Summary: Need a different environment variable or configuration that states where local temporary files are stored than hadoop.tmp.dir
                 Key: HADOOP-8970
                 URL: https://issues.apache.org/jira/browse/HADOOP-8970
             Project: Hadoop Common
          Issue Type: Improvement
          Components: conf
            Reporter: Robert Justice


I'm finding that hadoop.tmp.dir is used for a base directory in configuration of working directories for many other hadoop sub components (mapred, hdfs, hue, etc) and that it directs where the Hadoop client stores some local temporary files, as well as temporary files on HDFS.  

Users may be dealing with tight space in /tmp.  In order to move where job setup files, hive, hue files, etc, are locally stored, they have to create a new directory on HDFS (i.e. /temp) and local directories on another filesystem and make sure permissions are setup properly in HDFS and for the local filesystem across all the nodes across the cluster.

I'm wondering if it would be better to have a hadoop.local.tmp.dir that is configurable at the client level to say where local files are kept, and break that out from hadoop.tmp.dir?  Know this is a major change, but thought I would suggest it.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira