Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 654C8105C4 for ; Wed, 26 Mar 2014 23:13:19 +0000 (UTC) Received: (qmail 18113 invoked by uid 500); 26 Mar 2014 23:13:11 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 17857 invoked by uid 500); 26 Mar 2014 23:13:11 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 17850 invoked by uid 99); 26 Mar 2014 23:13:11 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 26 Mar 2014 23:13:11 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,MIME_QP_LONG_LINE,RCVD_IN_DNSWL_NONE,SPF_PASS,WEIRD_QUOTING X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of azuryyyu@gmail.com designates 209.85.192.169 as permitted sender) Received: from [209.85.192.169] (HELO mail-pd0-f169.google.com) (209.85.192.169) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 26 Mar 2014 23:13:04 +0000 Received: by mail-pd0-f169.google.com with SMTP id fp1so2521314pdb.0 for ; Wed, 26 Mar 2014 16:12:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:content-type:content-transfer-encoding:mime-version:subject :message-id:date:references:in-reply-to:to; bh=pmp8URKtt+Ai4PZIO8OXoz2mX5KPUO26ijHfXFckWJY=; b=CMxcccXE5s6/64z+MV/+wOWi/4mrLiznPo/CsCqCwBVt5tey3K5okzdY2pJr+FkYuZ ++sO86h3Cc4L7JI4c+6fOGNqO+OmHhXr8WSHcPSq0mu94VUILiKU0Q6vkX2P2ozsO/4e HFaiMb/yB23+hdyaTpMIPJFYh3xq1z9JobC+l8esXKrpherczg9gRC7CW/Uc7OG46wMx UJ+vSykEUcLyEfe2qxviusK4evL+Pf26W1sBNrqU2Wb4xiDUoNhXVdN69gPZEhzYnw/e CJrp1DWanwVAmL0MpUu6yLIxsEL6nOJodpWnRibRUHYEFWB4gWJz2pxb0HPP0DpTbWfp eRtQ== X-Received: by 10.66.147.130 with SMTP id tk2mr7694114pab.125.1395875562305; Wed, 26 Mar 2014 16:12:42 -0700 (PDT) Received: from [192.168.1.100] ([124.127.213.184]) by mx.google.com with ESMTPSA id iv2sm453476pbc.19.2014.03.26.16.12.40 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Wed, 26 Mar 2014 16:12:41 -0700 (PDT) From: Azuryy Content-Type: multipart/alternative; boundary=Apple-Mail-00105EAD-CAFC-4274-9E95-610EB4768007 Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (1.0) Subject: Re: Getting error message from AM container launch Message-Id: <8671AF14-69AD-432E-92A1-1DD903471CF4@gmail.com> Date: Thu, 27 Mar 2014 07:12:37 +0800 References: <869970D71E26D7498BDAC4E1CA92226B86EA8BCB@MBX021-E3-NJ-2.exch021.domain.local> <869970D71E26D7498BDAC4E1CA92226B86EA8C15@MBX021-E3-NJ-2.exch021.domain.local> <869970D71E26D7498BDAC4E1CA92226B86EA8C3E@MBX021-E3-NJ-2.exch021.domain.local> In-Reply-To: <869970D71E26D7498BDAC4E1CA92226B86EA8C3E@MBX021-E3-NJ-2.exch021.domain.local> To: "user@hadoop.apache.org" X-Mailer: iPhone Mail (11D167) X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail-00105EAD-CAFC-4274-9E95-610EB4768007 Content-Type: text/plain; charset=gb2312 Content-Transfer-Encoding: quoted-printable You used 'nice' in your app? Sent from my iPhone5s > On 2014=C4=EA3=D4=C227=C8=D5, at 6:55, John Lilley wrote: >=20 > On further examination they appear to be 369 characters long. I=A1=AFve r= ead about similar issues showing when the environment exceeds 132KB, but we a= ren=A1=AFt putting anything significant in the environment. > John > =20 > =20 > From: John Lilley [mailto:john.lilley@redpoint.net]=20 > Sent: Wednesday, March 26, 2014 4:41 PM > To: user@hadoop.apache.org > Subject: RE: Getting error message from AM container launch > =20 > We do have a fairly long container command-line. Not huge, around 200 cha= racters. > John > =20 > From: John Lilley [mailto:john.lilley@redpoint.net]=20 > Sent: Wednesday, March 26, 2014 4:38 PM > To: user@hadoop.apache.org > Subject: Getting error message from AM container launch > =20 > Running a non-MapReduce YARN application, one of the containers launched b= y the AM is failing with an error message I=A1=AFve never seen. Any ideas? = I=A1=AFm not sure who exactly is running =A1=B0nice=A1=B1 or why its argume= nt list would be too long. > Thanks > john > =20 > Container for appattempt_1395755163053_0030_000001 exited with exitCode: 0= due to: Exception from container-launch: > java.io.IOException: Cannot run program ""nice"" (in directory ""/ephemera= l02/hadoop/yarn/local/usercache/SYSTEM/appcache/application_1395755163053_00= 30/container_1395755163053_0030_01_000001""): java.io.IOException: error=3D7= , Argument list too long > at java.lang.ProcessBuilder.start(ProcessBuilder.java:460)= > at org.apache.hadoop.util.Shell.runCommand(Shell.java:407)= > at org.apache.hadoop.util.Shell.run(Shell.java:379) > at org.apache.hadoop.util.Shell$ShellCommandExecutor.execu= te(Shell.java:589) > at org.apache.hadoop.yarn.server.nodemanager.DefaultContai= nerExecutor.launchContainer(DefaultContainerExecutor.java:195) > at org.apache.hadoop.yarn.server.nodemanager.containermana= ger.launcher.ContainerLaunch.call(ContainerLaunch.java:283) > at org.apache.hadoop.yarn.server.nodemanager.containermana= ger.launcher.ContainerLaunch.call(ContainerLaunch.java:79) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTas= k.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138= ) > at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(= ThreadPoolExecutor.java:886) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(Thre= adPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:662) > Caused by: java.io.IOException: java.io.IOException: error=3D7, Argument l= ist too long > at java.lang.UNIXProcess.(UNIXProcess.java:148) > at java.lang.ProcessImpl.start(ProcessImpl.java:65) > at java.lang.ProcessBuilder.start(ProcessBuilder.java:453)= > ... 11 more > =20 --Apple-Mail-00105EAD-CAFC-4274-9E95-610EB4768007 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable
You used 'nice' in your app?


Sent from my iPhone5s

On 2014=E5=B9=B43=E6=9C=8827=E6= =97=A5, at 6:55, John Lilley <john.lilley@redpoint.net> wrote:

=

On further examination t= hey appear to be 369 characters long.  I=E2=80=99ve read about similar i= ssues showing when the environment exceeds 132KB, but we aren=E2=80=99t putt= ing anything significant in the environment.

John<= /p>

 

 

 

We do have a fairly lon= g container command-line.  Not huge, around 200 characters.<= /span>

John<= /p>

 

 

Running a non-MapReduce YARN application, one of the c= ontainers launched by the AM is failing with an error message I=E2=80=99ve n= ever seen.  Any ideas?  I=E2=80=99m not sure who exactly is runnin= g =E2=80=9Cnice=E2=80=9D or why its argument list would be too long.

Thanks

john

 

Container for appattempt_1395755163053_0030_000001 ex= ited with  exitCode: 0 due to: Exception from container-launch:

java.io.IOException: Cannot run program ""nice"" (in d= irectory ""/ephemeral02/hadoop/yarn/local/usercache/SYSTEM/appcache/applicat= ion_1395755163053_0030/container_1395755163053_0030_01_000001""): java.io.IO= Exception: error=3D7, Argument list too long

         = ;       at java.lang.ProcessBuilder.start(Proc= essBuilder.java:460)

         = ;       at org.apache.hadoop.util.Shell.runCom= mand(Shell.java:407)

         = ;       at org.apache.hadoop.util.Shell.run(Sh= ell.java:379)

         = ;       at org.apache.hadoop.util.Shell$ShellC= ommandExecutor.execute(Shell.java:589)

         = ;       at org.apache.hadoop.yarn.server.nodem= anager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.jav= a:195)

         = ;       at org.apache.hadoop.yarn.server.nodem= anager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:2= 83)

         = ;       at org.apache.hadoop.yarn.server.nodem= anager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:7= 9)

         = ;       at java.util.concurrent.FutureTask$Syn= c.innerRun(FutureTask.java:303)

         = ;       at java.util.concurrent.FutureTask.run= (FutureTask.java:138)

         = ;       at java.util.concurrent.ThreadPoolExec= utor$Worker.runTask(ThreadPoolExecutor.java:886)

         = ;       at java.util.concurrent.ThreadPoolExec= utor$Worker.run(ThreadPoolExecutor.java:908)

         = ;       at java.lang.Thread.run(Thread.java:66= 2)

Caused by: java.io.IOException: java.io.IOException: e= rror=3D7, Argument list too long

         = ;       at java.lang.UNIXProcess.<init>(= UNIXProcess.java:148)

         = ;       at java.lang.ProcessImpl.start(Process= Impl.java:65)

         = ;       at java.lang.ProcessBuilder.start(Proc= essBuilder.java:453)

         = ;       ... 11 more

 

= --Apple-Mail-00105EAD-CAFC-4274-9E95-610EB4768007--