hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sandeep L <sandeepvre...@outlook.com>
Subject RE: HDFS to a different location other than HADOOP HOME
Date Wed, 12 Jun 2013 05:55:28 GMT
Instead of using ${hadoop.tmp.dir}/dfs/data you give multiple directories with absolute paths.Just
try as follows:<property><name>hadoop.data.dir</name><value>/home1/user1/dir1,/home2/user2/dir2</value></property>This
will allow HDFS to write data into all specified directories.
From: sandeepvreddy@outlook.com
To: user@hadoop.apache.org
Subject: RE: HDFS to a different location other than HADOOP HOME
Date: Wed, 12 Jun 2013 11:18:34 +0530




Instead of using ${hadoop.tmp.dir}/dfs/data you give multiple directories with absolute paths.Just
try as follows:<property><name>hadoop.data.dir</name><value>/home1/user1/dir1,/home2/user2/dir2</value></property>This
will allow HDFS to write data into all specified directories.
From: dontariq@gmail.com
Date: Tue, 11 Jun 2013 23:14:08 +0530
Subject: Re: HDFS to a different location other than HADOOP HOME
To: user@hadoop.apache.org

Thank you Pramod and Shahab.Warm Regards,Tariqcloudfront.blogspot.com





On Tue, Jun 11, 2013 at 11:03 PM, Shahab Yunus <shahab.yunus@gmail.com> wrote:


http://hadoop.apache.org/docs/stable/hdfs-default.html


dfs.data.dir
${hadoop.tmp.dir}/dfs/dataDetermines where on the local filesystem an DFS data node should
store its blocks. If this is a comma-delimited list of directories, then data will be stored
in all named directories, typically on different devices. Directories that do not exist are
ignored.




On Tue, Jun 11, 2013 at 1:08 PM, Raj Hadoop <hadoopraj@yahoo.com> wrote:



Hi Tariq,
 
What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have this value defined.
So what is the default value?
 
Thanks,
Raj








From: Mohammad Tariq <dontariq@gmail.com>
To: "user@hadoop.apache.org" <user@hadoop.apache.org>; Raj Hadoop <hadoopraj@yahoo.com>




Sent: Tuesday, June 11, 2013 12:49 PM
Subject: Re: HDFS to a different location other than HADOOP HOME




Hello Raj,


    Although the way which Mustaqeem has told is correct, there is more appropriate way to
do this. Add the "dfs.data.dir" property in your hdfs-site.xml and give the "path you want
to use for HDFS data storage" as its value. The directory pointed by hadoop.tmp.dir also contains
the metadata and some other temporary files, so it's always better to have a dedicated location
to store the actual HDFS data.





Warm Regards,
Tariq
cloudfront.blogspot.com



On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <hadoopraj@yahoo.com> wrote:




 
Thanks Mustaqeem.
 
hadoop.tmp.dir - Can this store HDFS files? I mean - is there any difference in files from
the one we create under HADOOP_HOME.
 
 








From: Mohammad Mustaqeem <3m.mustaqeem@gmail.com>
To: user <user@hadoop.apache.org>; Raj Hadoop <hadoopraj@yahoo.com> 



Sent: Tuesday, June 11, 2013 10:28 AM
Subject: Re: HDFS to a different location other than HADOOP HOME






You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as - 

<property>
<name>hadoop.tmp.dir</name>
<value>/app/software/app1</value>
</property>
"/app/software/app1" will be used as location for storing the hdfs files.





On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <hadoopraj@yahoo.com> wrote:




Hi,
 
I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a directory
 
/usr/home/hadoop
 
I dont have much space on /usr and want to use other accounts/applications storage which are
located at /app/software/app1 etc.,
 
How can I use the /app/software/app1 location for my HDFS files and storage. Is it possible?
Please advise.
 
Thanks,
Raj


-- 

With regards ---

Mohammad Mustaqeem,
M.Tech (CSE)
MNNIT Allahabad
9026604270










 		 	   		   		 	   		  
Mime
View raw message