Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2CCAF10BF5 for ; Fri, 15 Nov 2013 23:52:12 +0000 (UTC) Received: (qmail 36342 invoked by uid 500); 15 Nov 2013 23:52:11 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 36285 invoked by uid 500); 15 Nov 2013 23:52:10 -0000 Mailing-List: contact mapreduce-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-user@hadoop.apache.org Delivered-To: mailing list mapreduce-user@hadoop.apache.org Received: (qmail 36277 invoked by uid 99); 15 Nov 2013 23:52:09 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 15 Nov 2013 23:52:09 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of nagarjuna.kanamarlapudi@gmail.com designates 209.85.220.44 as permitted sender) Received: from [209.85.220.44] (HELO mail-pa0-f44.google.com) (209.85.220.44) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 15 Nov 2013 23:52:03 +0000 Received: by mail-pa0-f44.google.com with SMTP id fb1so2669173pad.17 for ; Fri, 15 Nov 2013 15:51:42 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=BVRZgFRdsKZuNPOzbViuu7Zi744DHkQVoaZuhdCbNN0=; b=ZUwefrQcvCCUjDrX2O/jn6Ahd04c62MWz3T18+hQFw1v/JnEF60VAvsKxynN3WGqLJ 0chZkyCdq6E0b+tJeL/kOqGAU/kwzBxDmW4LmABgPGd7KmrnUhPLQk8NjGar3E0mNdJj Sxjxln3GTs/E4bKDcDG3w5PlxBCjg5wIc11JqI6hQUXEA8iYCIuL9kSAuVwyOCBNRdy/ v6Myaj+FYoyttUPq1gs3d1iquNpxyLeWJvVerYQwtty5VPThr+bxIW96AJaxRtiXkgbY unwcfppSJbL6qvZLQjXEw9/e8jSAnmyQxaFmruR5LBwPjP84UoM4epDEssZ8WusDvIAb 5TTA== MIME-Version: 1.0 X-Received: by 10.66.162.167 with SMTP id yb7mr9502884pab.16.1384559502288; Fri, 15 Nov 2013 15:51:42 -0800 (PST) Received: by 10.70.10.5 with HTTP; Fri, 15 Nov 2013 15:51:42 -0800 (PST) Date: Sat, 16 Nov 2013 05:21:42 +0530 Message-ID: Subject: java.lang.IllegalStateException: Invalid shuffle port number -1 From: nagarjuna kanamarlapudi To: mapreduce-user@hadoop.apache.org Content-Type: multipart/alternative; boundary=047d7bacbe704decfe04eb3fe19f X-Virus-Checked: Checked by ClamAV on apache.org --047d7bacbe704decfe04eb3fe19f Content-Type: text/plain; charset=ISO-8859-1 Hi, I am trying to run mapreduce with yarn (mrv2). Kicked off with word count example but failed with the below exception. Can some one help me out. Container launch failed for container_1384558555627_0001_01_000002 : java.lang.IllegalStateException: Invalid shuffle port number -1 returned for attempt_1384558555627_0001_m_000000_0 at org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$Container.launch(ContainerLauncherImpl.java:170) at org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$EventProcessor.run(ContainerLauncherImpl.java:396) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) mapred-site.xml ========================= mapred.job.tracker localhost:9001 mapreduce.framework.name yarn mapreduce.shuffle.port 8081 yarn-site.xml ===================== yarn.nodemanager.aux-services.mapreduce.shuffle.class org.apache.hadoop.mapred.ShuffleHandler Regards, Nagarjuna K --047d7bacbe704decfe04eb3fe19f Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi,

I am trying to r= un mapreduce with yarn (mrv2). Kicked off with word count example but faile= d with the below exception. Can some one help me out.

Container laun= ch failed for container_1384558555627_0001_01_000002 : java.lang.IllegalSta= teException: Invalid shuffle port number -1 returned for attempt_1384558555= 627_0001_m_000000_0
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.mapreduce.v2.app.launcher.Contai= nerLauncherImpl$Container.launch(ContainerLauncherImpl.java:170)
=A0=A0= =A0=A0=A0=A0=A0 at org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLau= ncherImpl$EventProcessor.run(ContainerLauncherImpl.java:396)
=A0=A0=A0=A0=A0=A0=A0 at java.util.concurrent.ThreadPoolExecutor.runWorker(= ThreadPoolExecutor.java:1145)
=A0=A0=A0=A0=A0=A0=A0 at java.util.concurr= ent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
=A0=A0=A0= =A0=A0=A0=A0 at java.lang.Thread.run(Thread.java:724)









mapred-site.xml
=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D

<= configuration>
=A0=A0=A0=A0 <property>
=A0=A0=A0=A0=A0=A0=A0= =A0 <name>mapred.job.tracker</name>
=A0=A0=A0=A0=A0=A0=A0=A0= <value>localhost:9001</value>
=A0=A0=A0=A0 </property>


=A0<property>
=A0=A0=A0= =A0=A0 <name>mapreduce.fr= amework.name</name>
=A0=A0=A0=A0=A0 <value>yarn</valu= e>
=A0=A0 </property>


=A0<property>
=A0=A0=A0=A0=A0 <name>mapreduce.shuffl= e.port</name>
=A0=A0=A0=A0=A0 <value>8081</value>
= =A0=A0 </property>


</configuration>



<= /div>yarn-site.xml
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D
<!-- Site specific YARN configuration properties -->
<!--
&l= t;property>
=A0=A0 <name>yarn.nodemanager.aux-services</name= >
=A0=A0 <value>mapreduce_shuffle</value>
</propert= y>
-->
<property>
=A0=A0 <name>yarn.nodemanager.aux-servi= ces.mapreduce.shuffle.class</name>
=A0=A0 <value>org.apache.= hadoop.mapred.ShuffleHandler</value>
</property>
</con= figuration>


Regards,
Nagarjuna K
--047d7bacbe704decfe04eb3fe19f--