Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id CE58310A7C for ; Fri, 26 Apr 2013 21:22:33 +0000 (UTC) Received: (qmail 12803 invoked by uid 500); 26 Apr 2013 21:22:29 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 12588 invoked by uid 500); 26 Apr 2013 21:22:28 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 12580 invoked by uid 99); 26 Apr 2013 21:22:28 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 26 Apr 2013 21:22:28 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of rkevinburton@charter.net designates 216.33.127.83 as permitted sender) Received: from [216.33.127.83] (HELO mta41.charter.net) (216.33.127.83) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 26 Apr 2013 21:22:24 +0000 Received: from imp11 ([10.20.200.11]) by mta41.charter.net (InterMail vM.8.01.05.02 201-2260-151-103-20110920) with ESMTP id <20130426212203.OXFG10143.mta41.charter.net@imp11>; Fri, 26 Apr 2013 17:22:03 -0400 Received: from [10.137.80.141] ([166.137.98.168]) by imp11 with smtp.charter.net id UlN21l00r3dyqaE05lN2tR; Fri, 26 Apr 2013 17:22:03 -0400 X-Authority-Analysis: v=2.0 cv=dIr+A5lb c=1 sm=1 a=heFkX8GE0HSvg/b3XXqNIQ==:17 a=YppAxU6FmN8A:10 a=yUnIBFQkZM0A:10 a=hOpmn2quAAAA:8 a=eue_ZPy9maIA:10 a=NpGacYD8AAAA:8 a=YvWDXD_7a0iKUfy7fE4A:9 a=CjuIK1q_8ugA:10 a=CxL5Yf00k4MA:10 a=hUswqBWy9Q8A:10 a=aAbPJnMWAAAA:8 a=2NadHV0nLxCrtlVy4LsA:9 a=QEXdDO2ut3YA:10 a=_W_S_7VecoQA:10 a=tXsnliwV7b4A:10 a=Kf3sjvYiIlTEa2MM:21 a=heFkX8GE0HSvg/b3XXqNIQ==:117 X-Auth-id: cmtldmluYnVydG9uQGNoYXJ0ZXIubmV0 References: <4bd2eeb2.5e5c7e.13e4824c75d.Webtop.48@charter.net> In-Reply-To: Mime-Version: 1.0 (1.0) Content-Transfer-Encoding: 7bit Content-Type: multipart/alternative; boundary=Apple-Mail-5B7FAD09-EF43-467B-A81F-3B9C38450991 Message-Id: Cc: "user@hadoop.apache.org" X-Mailer: iPhone Mail (10B329) From: Kevin Burton Subject: Re: M/R job to a cluster? Date: Fri, 26 Apr 2013 16:22:02 -0500 To: "user@hadoop.apache.org" X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail-5B7FAD09-EF43-467B-A81F-3B9C38450991 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable It is hdfs://devubuntu05:9000. Is this wrong? Devubuntu05 is the name of the= host where the NameNode and JobTracker should be running. It is also the ho= st where I am running the M/R client code. On Apr 26, 2013, at 4:06 PM, Rishi Yadav wrote: > check core-site.xml and see value of fs.default.name. if it has localhost y= ou are running locally. >=20 >=20 >=20 >=20 > On Fri, Apr 26, 2013 at 1:59 PM, wrote: >> I suspect that my MapReduce job is being run locally. I don't have any ev= idence but I am not sure how the specifics of my configuration are communica= ted to the Java code that I write. Based on the text that I have read online= basically I start with code like: >>=20 >> JobClient client =3D new JobClient(); >> JobConf conf - new JobConf(WordCount.class); >> . . . . . >>=20 >> Where do I communicate the configuration information so that the M/R job r= uns on the cluster and not locally? Or is the configuration location "magica= lly determined"? >>=20 >> Thank you. >=20 --Apple-Mail-5B7FAD09-EF43-467B-A81F-3B9C38450991 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 7bit
It is hdfs://devubuntu05:9000. Is this wrong? Devubuntu05 is the name of the host where the NameNode and JobTracker should be running. It is also the host where I am running the M/R client code.

On Apr 26, 2013, at 4:06 PM, Rishi Yadav <rishi@infoobjects.com> wrote:

check core-site.xml and see value of fs.default.name. if it has localhost you are running locally.




On Fri, Apr 26, 2013 at 1:59 PM, <rkevinburton@charter.net> wrote:
I suspect that my MapReduce job is being run locally. I don't have any evidence but I am not sure how the specifics of my configuration are communicated to the Java code that I write. Based on the text that I have read online basically I start with code like:

JobClient client = new JobClient();
JobConf conf - new JobConf(WordCount.class);
. . . . .

Where do I communicate the configuration information so that the M/R job runs on the cluster and not locally? Or is the configuration location "magically determined"?

Thank you.

--Apple-Mail-5B7FAD09-EF43-467B-A81F-3B9C38450991--