Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A7744100E2 for ; Fri, 21 Mar 2014 22:10:06 +0000 (UTC) Received: (qmail 71079 invoked by uid 500); 21 Mar 2014 22:09:20 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 70948 invoked by uid 500); 21 Mar 2014 22:09:11 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 70227 invoked by uid 99); 21 Mar 2014 22:08:36 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 21 Mar 2014 22:08:36 +0000 X-ASF-Spam-Status: No, hits=1.7 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of ashwinshankar77@gmail.com designates 209.85.220.54 as permitted sender) Received: from [209.85.220.54] (HELO mail-pa0-f54.google.com) (209.85.220.54) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 21 Mar 2014 22:08:32 +0000 Received: by mail-pa0-f54.google.com with SMTP id lf10so2978897pab.27 for ; Fri, 21 Mar 2014 15:08:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=AP9tYa6Ulai5YF6tov5Yfqhwh8YAitp8gcbUsAQe8t0=; b=0e0kLF7H3l5APYKR28CpCT2KOr7gapCohWXtc1JibVzDWTrZskEZJlC3osrSn/tTH/ yoqBom8KpOeGgGo6zHq76HedP9LwZL45kjc/9/Z0PkqwYeLTsKiUycPfeSwvRxMo4iV8 KntptNwBoEvGby6nqmoOAIRreG9+20ZVNHI5YUBSt7CzRi42aafIetl29Gbf8uqD/BCY JqpRU34EnMMQM9Rlf0gkSleaS/kUwrqk4EpI1q2DKLQRo4xK9xd+kYJNffXW2dumFcIo MwPjOElNqbMsLbUVPliB5hdkMYu10wcVp3dA40t46pVq1tgdVan0EeiEfNmbOc+utS8g wEog== MIME-Version: 1.0 X-Received: by 10.68.11.199 with SMTP id s7mr57637650pbb.12.1395439692237; Fri, 21 Mar 2014 15:08:12 -0700 (PDT) Received: by 10.68.250.3 with HTTP; Fri, 21 Mar 2014 15:08:12 -0700 (PDT) In-Reply-To: <0EE80F6F7A98A64EBD18F2BE839C911567536926@szxeml512-mbs.china.huawei.com> References: <0EE80F6F7A98A64EBD18F2BE839C911567536926@szxeml512-mbs.china.huawei.com> Date: Fri, 21 Mar 2014 15:08:12 -0700 Message-ID: Subject: Re: Job fails if I change HADOOP_USER_NAME From: Ashwin Shankar To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=bcaec5314b5529527004f5251f6c X-Virus-Checked: Checked by ClamAV on apache.org --bcaec5314b5529527004f5251f6c Content-Type: text/plain; charset=ISO-8859-1 Hi Rohit, How I enable debug for AM container logs ? and to which location are they written to ? I tried changing log4j.prop and can see DEBUGs for RM,NM etc but I don't see AM related debug logs. Thanks, Ashwin On Fri, Mar 21, 2014 at 3:05 AM, Rohith Sharma K S < rohithsharmaks@huawei.com> wrote: > Hi > > > > The below stack trace is generic for any am launcher failed to launch. Can > debug on AM container logs, so get proper stacktrace.? > > > > > > Thanks & Regards > > Rohith Sharma K S > > > > *From:* Ashwin Shankar [mailto:ashwinshankar77@gmail.com] > *Sent:* 21 March 2014 14:02 > *To:* user@hadoop.apache.org > *Subject:* Job fails if I change HADOOP_USER_NAME > > > > Hi, > > I'm writing a new feature in Fair scheduler and wanted to test it out > > by running jobs submitted by different users from my laptop. > > > > My sleep job runs fine as long as the user name is my mac user name. > > If I change my hadoop user name by setting HADOOP_USER_NAME, > > my jobs fail with the exception > *org.apache.hadoop.util.Shell$ExitCodeException.* > > I also tried creating a new user account on my laptop and running a job as > that user but I get the same exception. > > > > Please let me know if any of you have come across this. > > I tried changing ulimits max proc(to 1024),but doesn't solve the problem. > > > > Here is the stack trace : > > > > Job job_1395389889916_0001 failed with state FAILED due to: Application > application_1395389889916_0001 failed 3 times due to AM Container for > appattempt_1395389889916_0001_000003 exited with exitCode: 1 due to: > Exception from container-launch: > org.apache.hadoop.util.Shell$ExitCodeException: > > org.apache.hadoop.util.Shell$ExitCodeException: > > at org.apache.hadoop.util.Shell.runCommand(Shell.java:505) > > at org.apache.hadoop.util.Shell.run(Shell.java:418) > > at > org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650) > > at > org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195) > > > > -- > > Thanks, > Ashwin > > -- Thanks, Ashwin --bcaec5314b5529527004f5251f6c Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi Rohit,
How I enable debug for AM container logs ? a= nd to which location are they written to ?
I tried changing log4j= .prop and can see DEBUGs for RM,NM etc but I don't see AM related debug= logs.

Thanks,
Ashwin


On Fri, Mar 21, 2014 at 3:05 AM,= Rohith Sharma K S <rohithsharmaks@huawei.com> wrote= :

Hi

=A0<= /p>

The below stack trace is = generic for any am launcher failed to launch. Can debug on AM container log= s, so get proper stacktrace.?

=A0<= /p>

=A0<= /p>

Thanks & Regards

Rohith Sharma K S<= u>

=A0<= /p>

From: Ashwin S= hankar [mailto:ashwinshankar77@gmail.com]
Sent: 21 March 2014 14:02
To: user= @hadoop.apache.org
Subject: Job fails if I change HADOOP_USER_NAME=

=A0

Hi,

I'm writing a new feature in Fair scheduler and = wanted to test it out

by running jobs submitted by different users from my= laptop.

=A0

My sleep job runs fine as long as the user name is m= y mac user name.

If I change my hadoop user name by setting HADOOP_US= ER_NAME,

my jobs fail with the exception org.apache.hadoop= .util.Shell$ExitCodeException.

I also tried creating a new user account on my lapto= p and running a job as that user but I get the same exception.

=A0

Please let me know if any of you have come across th= is.

I tried changing ulimits max proc(to 1024),but doesn= 't solve the problem.

=A0

Here is the stack trace :

=A0

Job job_1395389889916_0001 failed with state FAILED = due to: Application application_1395389889916_0001 failed 3 times due to AM= Container for appattempt_1395389889916_0001_000003 exited with =A0exitCode= : 1 due to: Exception from container-launch: org.apache.hadoop.util.Shell$ExitCodeException:

org.apache.hadoop.util.Shell$ExitCodeException:

=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 at org.apache.hado= op.util.Shell.runCommand(Shell.java:505)

=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 at org.apache.hado= op.util.Shell.run(Shell.java:418)

=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 at org.apache.hado= op.util.Shell$ShellCommandExecutor.execute(Shell.java:650)

=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 at org.apache.hado= op.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(Default= ContainerExecutor.java:195)

=A0

--

Thanks,
Ashwin




--
Thanks,
Ashwin


--bcaec5314b5529527004f5251f6c--