hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "YongChul Kwon" <godsl...@gmail.com>
Subject Re: Sharing Hadoop cluster among multiple users
Date Thu, 26 Jun 2008 19:45:23 GMT
Hi Hiajun,

Yes, they, path related to shared things for map reduce, set to
default. I thought there is a reason for the default values containing
'username' in them. Is it safe to use some global path, say dropping
the username reference from the default values?

Thank you,

On Thu, Jun 26, 2008 at 12:19 PM, Haijun Cao <haijun@kindsight.net> wrote:
> Is it because you leave the mapred.system.dir as default (see
> hadoop-default.xml)?
> Haijun
> -----Original Message-----
> From: YongChul Kwon [mailto:godslord@gmail.com]
> Sent: Thursday, June 26, 2008 12:10 PM
> To: core-user@hadoop.apache.org
> Subject: Sharing Hadoop cluster among multiple users
> Hello all,
> I deployed hadoop to a small cluster. The HDFS is running as user A.
> Now user B comes in and wants to run a simple Map-Reduce task. The
> Map-Reduce client creates all shared files in correct location
> '/tmp/hadoop-B/mapred/system/...'. However, JobTracker, running as
> user A, always tries to read the job related files from
> '/tmp/hadoop-A/mapred/system/...'.
> The questions are following.
> a) Does everybody who wants to run map-reduce job have to launch one's
> own JobTracker?
> b) Do I have to set HOD for this? I really don't want to do this extra
> since B is currently the only user running Map-Reduce.
> Thank you,
> YongChul


View raw message