Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of Tony.Dean@sas.com designates
 216.32.181.182 as permitted sender)
Received-SPF: pass (mail39-ch1: domain of sas.com designates 149.173.6.148 as
 permitted sender) client-ip=149.173.6.148; envelope-from=Tony.Dean@sas.com;
 helo=mercav06d.na.sas.com ;d.na.sas.com ;
From: Tony Dean <Tony.Dean@sas.com>
To: "user@hadoop.apache.org" <user@hadoop.apache.org>
Subject: mr1 and mr2
Thread-Topic: mr1 and mr2
Thread-Index: Ac9sqS7fGI+jg8UlS1uDbiGPYOfg3A==
Date: Sat, 10 May 2014 23:52:14 +0000
Message-ID: <cc3c6d6e3a5549559329f30b51ceba5a@MERCMBX39R.na.SAS.com>
Accept-Language: en-US
Content-Language: en-US
Content-Type: multipart/alternative;
	boundary="_000_cc3c6d6e3a5549559329f30b51ceba5aMERCMBX39RnaSAScom_"
MIME-Version: 1.0

--_000_cc3c6d6e3a5549559329f30b51ceba5aMERCMBX39RnaSAScom_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

Hi,

I am trying to write a Java application that works with either MR1 and MR2.=
  At the present I have MR2 (YARN) implementation deployed and running.  I =
am using mapred API.  I believe that I read mapred and mapreduce APIs are c=
ompatible so either should work.  The only thing that is different is the c=
onfiguration properties that need to be specified depending on whether the =
back-end is MR1 or MR2. BTW: I'm using CDH 4.6 (Hadoop 2.0).

My problem is that I can't seem to submit a job to the cluster.  It always =
runs locally.  I setup JobConf with appropriate properties and submit the j=
obs using JobClient.  The properties that I set on JobConf are as follows:

mapreduce.jobtracker.address=3Dhost:port (I know this is for MR1, but I'm t=
rying everything)
mapreduce.framework.name=3Dyarn
yarn.resourcemanager.address=3Dhost:port
yarn.resourcemanager.host=3Dhost:port

The last 2 are the same but I read 2 different ways to set it in different =
conflicting documentations.

Anyway, can someone explain how to get this seemingly simple deployment to =
work?  What am I missing?

Thanks!!!

--_000_cc3c6d6e3a5549559329f30b51ceba5aMERCMBX39RnaSAScom_
Content-Type: text/html; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<html xmlns:v=3D"urn:schemas-microsoft-com:vml" xmlns:o=3D"urn:schemas-micr=
osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" xmlns=3D"http:=
//www.w3.org/TR/REC-html40">
<head>
<meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dus-ascii"=
>
<meta name=3D"Generator" content=3D"Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
	{font-family:"Cambria Math";
	panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
	{font-family:Calibri;
	panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
	{margin:0in;
	margin-bottom:.0001pt;
	font-size:11.0pt;
	font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
	{mso-style-priority:99;
	color:#0563C1;
	text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
	{mso-style-priority:99;
	color:#954F72;
	text-decoration:underline;}
span.EmailStyle17
	{mso-style-type:personal-compose;
	font-family:"Calibri","sans-serif";
	color:windowtext;}
.MsoChpDefault
	{mso-style-type:export-only;
	font-family:"Calibri","sans-serif";}
@page WordSection1
	{size:8.5in 11.0in;
	margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
	{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext=3D"edit">
<o:idmap v:ext=3D"edit" data=3D"1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang=3D"EN-US" link=3D"#0563C1" vlink=3D"#954F72">
<div class=3D"WordSection1">
<p class=3D"MsoNormal">Hi,<o:p></o:p></p>
<p class=3D"MsoNormal"><o:p>&nbsp;</o:p></p>
<p class=3D"MsoNormal">I am trying to write a Java application that works w=
ith either MR1 and MR2.&nbsp; At the present I have MR2 (YARN) implementati=
on deployed and running.&nbsp; I am using mapred API.&nbsp; I believe that =
I read mapred and mapreduce APIs are compatible so
 either should work.&nbsp; The only thing that is different is the configur=
ation properties that need to be specified depending on whether the back-en=
d is MR1 or MR2. BTW: I&#8217;m using CDH 4.6 (Hadoop 2.0).<o:p></o:p></p>
<p class=3D"MsoNormal"><o:p>&nbsp;</o:p></p>
<p class=3D"MsoNormal">My problem is that I can&#8217;t seem to submit a jo=
b to the cluster.&nbsp; It always runs locally.&nbsp; I setup JobConf with =
appropriate properties and submit the jobs using JobClient.&nbsp; The prope=
rties that I set on JobConf are as follows:<o:p></o:p></p>
<p class=3D"MsoNormal"><o:p>&nbsp;</o:p></p>
<p class=3D"MsoNormal">mapreduce.jobtracker.address=3Dhost:port (I know thi=
s is for MR1, but I&#8217;m trying everything)<o:p></o:p></p>
<p class=3D"MsoNormal">mapreduce.framework.name=3Dyarn<o:p></o:p></p>
<p class=3D"MsoNormal">yarn.resourcemanager.address=3Dhost:port<o:p></o:p><=
/p>
<p class=3D"MsoNormal">yarn.resourcemanager.host=3Dhost:port<o:p></o:p></p>
<p class=3D"MsoNormal"><o:p>&nbsp;</o:p></p>
<p class=3D"MsoNormal">The last 2 are the same but I read 2 different ways =
to set it in different conflicting documentations.<o:p></o:p></p>
<p class=3D"MsoNormal"><o:p>&nbsp;</o:p></p>
<p class=3D"MsoNormal">Anyway, can someone explain how to get this seemingl=
y simple deployment to work?&nbsp; What am I missing?<o:p></o:p></p>
<p class=3D"MsoNormal"><o:p>&nbsp;</o:p></p>
<p class=3D"MsoNormal">Thanks!!!<o:p></o:p></p>
</div>
</body>
</html>

--_000_cc3c6d6e3a5549559329f30b51ceba5aMERCMBX39RnaSAScom_--