Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of harsh@cloudera.com designates
 209.85.210.174 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <4bd2eeb2.5e5c7e.13e4824c75d.Webtop.48@charter.net>
References: <4bd2eeb2.5e5c7e.13e4824c75d.Webtop.48@charter.net>
From: Harsh J <harsh@cloudera.com>
Date: Mon, 29 Apr 2013 23:45:52 +0530
Message-ID: 
 <CAOcnVr1Ub3wwAqeaP9tcHctozHnr0+_Uush7kyYA_diLm0YB6w@mail.gmail.com>
Subject: Re: M/R job to a cluster?
To: "<user@hadoop.apache.org>" <user@hadoop.apache.org>
Content-Type: text/plain; charset=ISO-8859-1

To validate if your jobs are running locally, look for the classname
"LocalJobRunner" in the runtime output.

Configs are sourced either from the classpath (if a dir or jar on the
classpath has the XMLs at their root, they're read), or via the code
(conf.set("mapred.job.tracker", "foo:349");) or also via -D parameters
if you use Tool.

The tool + classpath way is usually the best thing to do, for flexibility.

On Sat, Apr 27, 2013 at 2:29 AM,  <rkevinburton@charter.net> wrote:
> I suspect that my MapReduce job is being run locally. I don't have any
> evidence but I am not sure how the specifics of my configuration are
> communicated to the Java code that I write. Based on the text that I have
> read online basically I start with code like:
>
> JobClient client = new JobClient();
> JobConf conf - new JobConf(WordCount.class);
> . . . . .
>
> Where do I communicate the configuration information so that the M/R job
> runs on the cluster and not locally? Or is the configuration location
> "magically determined"?
>
> Thank you.


-- 
Harsh J