Return-Path: 
 <user-return-14851-apmail-hadoop-common-user-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-user-archive@www.apache.org
Delivered-To: apmail-hadoop-common-user-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 9EEEE10929
	for <apmail-hadoop-common-user-archive@www.apache.org>;
 Thu, 10 Apr 2014 11:44:44 +0000 (UTC)
Received: (qmail 50329 invoked by uid 500); 10 Apr 2014 11:44:36 -0000
Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org
Received: (qmail 50240 invoked by uid 500); 10 Apr 2014 11:44:32 -0000
Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@hadoop.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@hadoop.apache.org>
List-Post: <mailto:user@hadoop.apache.org>
List-Id: <user.hadoop.apache.org>
Reply-To: user@hadoop.apache.org
Delivered-To: mailing list user@hadoop.apache.org
Received: (qmail 50225 invoked by uid 99); 10 Apr 2014 11:44:30 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 10 Apr 2014 11:44:30 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
	tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of smart.rahul.iiit@gmail.com
 designates 74.125.82.178 as permitted sender)
Received: from [74.125.82.178] (HELO mail-we0-f178.google.com) (74.125.82.178)
    by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 10 Apr 2014 11:44:25 +0000
Received: by mail-we0-f178.google.com with SMTP id u56so3840146wes.9
        for <user@hadoop.apache.org>; Thu, 10 Apr 2014 04:44:04 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        bh=wmx+N7bE6c6HCGS61XVvUcI+GtkzU4IMf28aEhqpuJc=;
        b=tKOL24twM5NV2X17RhVkB2CZWVv9+5wzOTGT+j7Z8wMM5qym8FoqpGt2TwpL7fp3kz
         lGWiBfD8/U5U8XcWvNXq8N17ERJXSQRRW+FMN4r0wCCG8p1d5yAiwaZWTtwW8F96QqNR
         svnnQy75XWRL3ZsAQtZ/MvDNg/GWNTyAEB+uv+HsKyE5gYtHxjRBx1qT7QkUY3MEgfQh
         3IfCXl16OunZG37SjQ/Ynw6bn8Ui3W5Zk/dGTQlN6z9l/k6D2xeWAwIBdAdP3XStkKZ0
         2pHq2uxPgRByyqOzpeXLidgV8XqzcwzcE/FPsAy6SOb3YlkWB2b/qtm/pPgYPRgoGlx7
         enYw==
MIME-Version: 1.0
X-Received: by 10.194.24.74 with SMTP id s10mr14572175wjf.43.1397130244486;
 Thu, 10 Apr 2014 04:44:04 -0700 (PDT)
Received: by 10.227.94.6 with HTTP; Thu, 10 Apr 2014 04:44:04 -0700 (PDT)
In-Reply-To: 
 <CAAqOWyb=DMT6V_DqQ2mqWJhZ9j83PtMfA6-6h+AsXWfex9Qwbg@mail.gmail.com>
References: 
 <CAO5zWOsjK3WSE984A4vf2zu4Cy9VoqikQ-Z1hU-TLg-Q7pq2iA@mail.gmail.com>
	<CAAqOWyb=DMT6V_DqQ2mqWJhZ9j83PtMfA6-6h+AsXWfex9Qwbg@mail.gmail.com>
Date: Thu, 10 Apr 2014 17:14:04 +0530
Message-ID: 
 <CAO5zWOuf23wEx2UQkfoKD+5MMm6mqa_3QmA05sep-uzTC95R3w@mail.gmail.com>
Subject: Re: not able to run map reduce job example on aws machine
From: Rahul Singh <smart.rahul.iiit@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=047d7b5d2542ed7d3f04f6aebb8d
X-Virus-Checked: Checked by ClamAV on apache.org

--047d7b5d2542ed7d3f04f6aebb8d
Content-Type: text/plain; charset=ISO-8859-1

here is my mapred.site.xml config

<property>
  <name>mapred.job.tracker</name>
  <value>localhost:54311</value>
  <description>The host and port that the MapReduce job tracker runs
  at.  If "local", then jobs are run in-process as a single map
  and reduce task.
  </description>
</property>


Also, The job runs fine in memory, if i remove the dependency on yarn, i.e.
if i comment out:
<property>
  <name> mapreduce.framework.name</name>
  <value>yarn</value>
</property>

in mapred-site.xml.




On Thu, Apr 10, 2014 at 4:43 PM, Kiran Dangeti <kirandkumar2013@gmail.com>wrote:

> Rahul,
>
> Please check the port name given in mapred.site.xml
> Thanks
> Kiran
>
> On Thu, Apr 10, 2014 at 3:23 PM, Rahul Singh <smart.rahul.iiit@gmail.com>wrote:
>
>>  Hi,
>>   I am getting following exception while running word count example,
>>
>> 14/04/10 15:17:09 INFO mapreduce.Job: Task Id :
>> attempt_1397123038665_0001_m_000000_2, Status : FAILED
>> Container launch failed for container_1397123038665_0001_01_000004 :
>> java.lang.IllegalArgumentException: Does not contain a valid host:port
>> authority: poc_hadoop04:46162
>>     at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:211)
>>     at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:163)
>>     at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:152)
>>     at
>> org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy$ContainerManagementProtocolProxyData.newProxy(ContainerManagementProtocolProxy.java:210)
>>     at
>> org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy$ContainerManagementProtocolProxyData.<init>(ContainerManagementProtocolProxy.java:196)
>>     at
>> org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy.getProxy(ContainerManagementProtocolProxy.java:117)
>>     at
>> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl.getCMProxy(ContainerLauncherImpl.java:403)
>>     at
>> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$Container.launch(ContainerLauncherImpl.java:138)
>>     at
>> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$EventProcessor.run(ContainerLauncherImpl.java:369)
>>     at
>> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>>     at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>>     at java.lang.Thread.run(Thread.java:662)
>>
>>
>> I have everything configured with hdfs  running where i am able to create
>> files and directories. running jps on my machine shows all components
>> running.
>>
>> 10290 NameNode
>> 10416 DataNode
>> 10738 ResourceManager
>> 11634 Jps
>> 10584 SecondaryNameNode
>> 10844 NodeManager
>>
>>
>> Any pointers will be appreciated.
>>
>> Thanks and Regards,
>> -Rahul Singh
>>
>
>

--047d7b5d2542ed7d3f04f6aebb8d
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">here is my mapred.site.xml config<br><div><br>&lt;property=
&gt;<br>=A0 &lt;name&gt;mapred.job.tracker&lt;/name&gt;<br>=A0 &lt;value&gt=
;localhost:54311&lt;/value&gt;<br>=A0 &lt;description&gt;The host and port =
that the MapReduce job tracker runs<br>
=A0 at.=A0 If &quot;local&quot;, then jobs are run in-process as a single m=
ap<br>=A0 and reduce task.<br>=A0 &lt;/description&gt;<br>&lt;/property&gt;=
<br><br><br></div><div>Also, The job runs fine in memory, if i remove the d=
ependency on yarn, i.e. if i comment out:<br>
&lt;property&gt;<br>=A0 &lt;name&gt; <a href=3D"http://mapreduce.framework.=
name">mapreduce.framework.name</a>&lt;/name&gt;<br>=A0 &lt;value&gt;yarn&lt=
;/value&gt;<br>&lt;/property&gt;<br><br></div><div>in mapred-site.xml.<br><=
br>
<br></div></div><div class=3D"gmail_extra"><br><br><div class=3D"gmail_quot=
e">On Thu, Apr 10, 2014 at 4:43 PM, Kiran Dangeti <span dir=3D"ltr">&lt;<a =
href=3D"mailto:kirandkumar2013@gmail.com" target=3D"_blank">kirandkumar2013=
@gmail.com</a>&gt;</span> wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex"><div>Rahul,</div>
<div>=A0</div>
<div>Please check the port name given in mapred.site.xml</div>
<div>Thanks </div><span class=3D"HOEnZb"><font color=3D"#888888">
<div>Kiran<br><br></div></font></span><div class=3D"HOEnZb"><div class=3D"h=
5">
<div class=3D"gmail_quote">On Thu, Apr 10, 2014 at 3:23 PM, Rahul Singh <sp=
an dir=3D"ltr">&lt;<a href=3D"mailto:smart.rahul.iiit@gmail.com" target=3D"=
_blank">smart.rahul.iiit@gmail.com</a>&gt;</span> wrote:<br>
<blockquote style=3D"BORDER-LEFT:#ccc 1px solid;MARGIN:0px 0px 0px 0.8ex;PA=
DDING-LEFT:1ex" class=3D"gmail_quote">
<div dir=3D"ltr">
<div>Hi,<br></div>=A0 I am getting following exception while running word c=
ount example,<br>
<div>
<div>
<div><br>14/04/10 15:17:09 INFO mapreduce.Job: Task Id : attempt_1397123038=
665_0001_m_000000_2, Status : FAILED<br>Container launch failed for contain=
er_1397123038665_0001_01_000004 : java.lang.IllegalArgumentException: Does =
not contain a valid host:port authority: poc_hadoop04:46162<br>

=A0=A0=A0 at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:=
211)<br>=A0=A0=A0 at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUti=
ls.java:163)<br>=A0=A0=A0 at org.apache.hadoop.net.NetUtils.createSocketAdd=
r(NetUtils.java:152)<br>

=A0=A0=A0 at org.apache.hadoop.yarn.client.api.impl.ContainerManagementProt=
ocolProxy$ContainerManagementProtocolProxyData.newProxy(ContainerManagement=
ProtocolProxy.java:210)<br>=A0=A0=A0 at org.apache.hadoop.yarn.client.api.i=
mpl.ContainerManagementProtocolProxy$ContainerManagementProtocolProxyData.&=
lt;init&gt;(ContainerManagementProtocolProxy.java:196)<br>

=A0=A0=A0 at org.apache.hadoop.yarn.client.api.impl.ContainerManagementProt=
ocolProxy.getProxy(ContainerManagementProtocolProxy.java:117)<br>=A0=A0=A0 =
at org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl.getCMP=
roxy(ContainerLauncherImpl.java:403)<br>

=A0=A0=A0 at org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherI=
mpl$Container.launch(ContainerLauncherImpl.java:138)<br>=A0=A0=A0 at org.ap=
ache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$EventProcessor.=
run(ContainerLauncherImpl.java:369)<br>

=A0=A0=A0 at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadP=
oolExecutor.java:886)<br>=A0=A0=A0 at java.util.concurrent.ThreadPoolExecut=
or$Worker.run(ThreadPoolExecutor.java:908)<br>=A0=A0=A0 at java.lang.Thread=
.run(Thread.java:662)<br>

<br><br></div>
<div>I have everything configured with hdfs=A0 running where i am able to c=
reate files and directories. running jps on my machine shows all components=
 running.<br><br>10290 NameNode<br>10416 DataNode<br>10738 ResourceManager<=
br>

11634 Jps<br>10584 SecondaryNameNode<br>10844 NodeManager<br><br><br></div>
<div>Any pointers will be appreciated. <br><br></div>
<div>Thanks and Regards,<br></div>
<div>-Rahul Singh<br></div></div></div></div></blockquote></div><br>
</div></div></blockquote></div><br></div>

--047d7b5d2542ed7d3f04f6aebb8d--