hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From modemide <modem...@gmail.com>
Subject Re: how to set different hadoop.tmp.dir for each machines?
Date Wed, 30 Mar 2011 11:54:28 GMT
Ok, so if I understand correctly, you want to change the location of
the datastore on individual computers.

I've tested it on my cluster, and it seems to work.  Just for the sake
of troubleshooting, you didn't mention the following:
1) Which computer were you editing the files on
2) which file were you editing?

******************************************************************************
Here's my typical DataNode configuration:
Computer: DataNode
FileName: core-site.xml
Contents:
....
<name>hadoop.tmp.dir</name>
<value>/usr/local/hadoop/datastore/hadoop-${user.name}</value>
...
******************************************************************************
Here's the configuration of another DataNode I modified to test what
you were asking:
Computer: DataNode2
FileName: core-site.xml
Contents:
....
<name>hadoop.tmp.dir</name>
<value>/usr/local/hadoop/ANOTHERDATASTORE/hadoop-${user.name}</value>
....
******************************************************************************
Then, I moved datastore to ANOTHERDATASTORE on DataNode1.

I started my cluster back up, and it worked perfectly.


On Wed, Mar 30, 2011 at 6:08 AM, ke xie <oeddyo@gmail.com> wrote:
> Hey guys, I'm new here, and recently I'm working on configuring a cluster
> with 32 nodes.
>
> However, there are some problems, I describe below
>
> The cluster consists of nodes, which I don't have "root" to configure as I
> wish. We only have the space /localhost_name/local space to use.
> Thus, we only have
>
> /machine_a/local
> /machine_b/local
> ...
>
> So I guess to set hadoop.tmp.dir=/${HOSTNAME}/local will work, but sadly it
> didn't...
>
> Almost all the tutorials online are trying to set hadoop.tmp.dir as a single
> path, which assume on each machine the path is the same... but in my case
> it's not...
>
> I did some googling... like "hadoop.tmp.dir different"... but no results...
>
> Anybody can help? I'll appreciate that... for i've been working on this
> problem for more than 30 hours...
>
> --
> Name: Ke Xie   Eddy
> Research Group of Information Retrieval
> State Key Laboratory of Intelligent Technology and Systems
> Tsinghua University
>

Mime
View raw message