hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dieter De Witte <drdwi...@gmail.com>
Subject Re: How to set "hadoop.tmp.dir" if I have multiple disks per node?
Date Mon, 16 Dec 2013 08:12:49 GMT
Hi,

Make sure to also set mapred.local.dir to the same set of output
directories, this is were the intermediate key-value pairs are stored!

Regards, Dieter


2013/12/16 Tao Xiao <xiaotao.cs.nju@gmail.com>

> I have ten disks per node,and I don't know what value I should set to
> "hadoop.tmp.dir". Some said this property refers to a location in local
> disk while some other said it refers to a directory in HDFS. I'm confused,
> who can explain it ?
>
> I want to spread I/O since I have ten disks per node, so should I set a
> comma-separated list of directories (which are on different disks) to
> "hadoop.tmp.dir" ?
>

Mime
View raw message