Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6EA75187FE for ; Fri, 22 Jan 2016 20:20:17 +0000 (UTC) Received: (qmail 31053 invoked by uid 500); 22 Jan 2016 20:20:12 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 30906 invoked by uid 500); 22 Jan 2016 20:20:12 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 30895 invoked by uid 99); 22 Jan 2016 20:20:11 -0000 Received: from Unknown (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 22 Jan 2016 20:20:11 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 444EFC0D58 for ; Fri, 22 Jan 2016 20:20:11 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.101 X-Spam-Level: X-Spam-Status: No, score=-0.101 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id MWANToq4EwHO for ; Fri, 22 Jan 2016 20:20:00 +0000 (UTC) Received: from mail-io0-f178.google.com (mail-io0-f178.google.com [209.85.223.178]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id 3F0ED43F64 for ; Fri, 22 Jan 2016 20:20:00 +0000 (UTC) Received: by mail-io0-f178.google.com with SMTP id g73so101772112ioe.3 for ; Fri, 22 Jan 2016 12:20:00 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=azmkF/RbjhJdluiA1OHxPg7EMSQetKnMjUbHwUhzGE8=; b=A/sZZB5e44lotXhE2m8iqGw7SrM35wEVKAxmV52xwfdvVBBe9ls4tP7afeU6BYN53j VGl0BgneBOKoxAP8BpuYMsktxG0oL0w7nvdQIlqyWb3CXNjUcRg3PtB2kGdWlikC+q6A 1nXifHt7VlDTIBVlqnHQRPnSODcEqjUz+AFjc5uIhleyEaGB0KA1jo5zHXlmJbrlrjRG ZU7LnWfhsK4xBYqfMo4lXkyr6zTtKHuoz0V318YAtdZqgy6Msrfq00Z5j9MZKh3sggaO NtLlxfWg5XDkns3yrO1p5bh3fEUNrjSQcSLcSEB8QGOwgqSptI/IX7GBhKfiUObrMfVG C1vQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type :content-transfer-encoding; bh=azmkF/RbjhJdluiA1OHxPg7EMSQetKnMjUbHwUhzGE8=; b=djCMdbDphx4reF6RkpKPNlk/zPeU4lHlrRU3398kwQSpOeimoP2jrMpVe9gpsw7Toz U0DyzBUZp7jHi7Q9HclSKtaUezUHUEZj2kLnZiNuW2AcDCznyJSECRFYdYzzkI4Jp6G8 ooQEQ6SeqWPb/0LEgron6KFhHJJH9SEdtzZSzABN7KREuBopgoYRNcKXbExxCIxegKms 8WciYe/VbcFXEieaWBrngx9tlTU1dn85SWbFCS0P/XdUqJ7QTwVaOPOBsEHfRfP9d0pr VOMztShf7M1RgAZfxlTRYmPfILYfwuLCFhBpRkBPpx0oleEAZCtipw154aKoSguRkR6z S7Cg== X-Gm-Message-State: AG10YORA17ZYJZpqaSjd4UrXnP8U8ZutaJgKBJIKnKWARm14BSP+fUdm7dLNV/JnzVlhyG2FW1ruzzwpZCNhVw== MIME-Version: 1.0 X-Received: by 10.107.14.73 with SMTP id 70mr5373542ioo.31.1453493999784; Fri, 22 Jan 2016 12:19:59 -0800 (PST) Received: by 10.36.26.136 with HTTP; Fri, 22 Jan 2016 12:19:59 -0800 (PST) In-Reply-To: <56CE6BC6-5CFB-412E-8040-5D593C5D8E1D@apache.org> References: <56CE6BC6-5CFB-412E-8040-5D593C5D8E1D@apache.org> Date: Fri, 22 Jan 2016 21:19:59 +0100 Message-ID: Subject: Re: Yarn app: Cannot run "java -jar" container From: =?UTF-8?Q?Kristoffer_Sj=C3=B6gren?= To: Hitesh Shah Cc: user@hadoop.apache.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Thanks for the tip Hitesh - that's really helpful. On Fri, Jan 22, 2016 at 7:47 PM, Hitesh Shah wrote: > Ideally, the =E2=80=9Cyarn logs -application=E2=80=9D command should give= you the logs for the container in question and the stdout/stderr there usu= ally gives you a good indication on what is going wrong. > > Second more complex option: > - Set yarn.nodemanager.delete.debug-delay-sec to say 1200 or a large e= nough value. Restart all NMs. > - Run your application. > - Find the node on which your container failed. > - Search through the yarn nodemanager local-dirs to find the launch_co= ntainer.sh for your container. > - Look at its contents to see if things are being setup correctly. Run= it manually to debug. > > =E2=80=94 Hitesh > > On Jan 22, 2016, at 5:52 AM, Kristoffer Sj=C3=B6gren w= rote: > >> Hi >> >> I'm trying to run a yarn 2.7.1 application using a basic boilerplate >> [1]. But I have trouble running the container with an executable jar >> file using the following args list. >> >> List arg =3D Collections.singletonList( >> "/usr/jdk64/jdk1.8.0_40/bin/java -jar app-1.0.0-SNAPSHOT.jar" + >> " 1>" + ApplicationConstants.LOG_DIR_EXPANSION_VAR + "/stdout= " + >> " 2>" + ApplicationConstants.LOG_DIR_EXPANSION_VAR + "/stderr= " >> ); >> >> I'm not really sure why it doesn't work because the diagnostics >> message on tells me exit code 1 (see below). Neither the stdout or >> stderr files appear, and I have tried to pipe them to /tmp/stdout etc. >> >> How do I debug this error? Is the diagnostics message the only way? I >> have tried a gazillion different combinations of running the >> container, and the process is very time consuming and frustrating when >> there isn't any information to debug. >> >> Any tips or pointers on how to trace this error down? >> >> Cheers, >> -Kristoffer >> >> [1] https://github.com/hortonworks/simple-yarn-app/tree/master/src/main/= java/com/hortonworks/simpleyarnapp >> >> >> Stack trace: ExitCodeException exitCode=3D1: >> at org.apache.hadoop.util.Shell.runCommand(Shell.java:576) >> at org.apache.hadoop.util.Shell.run(Shell.java:487) >> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:= 753) >> at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.la= unchContainer(DefaultContainerExecutor.java:212) >> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.C= ontainerLaunch.call(ContainerLaunch.java:302) >> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.C= ontainerLaunch.call(ContainerLaunch.java:82) >> at java.util.concurrent.FutureTask.run(FutureTask.java:266) >> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.= java:1142) >> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor= .java:617) >> at java.lang.Thread.run(Thread.java:745) >> >> >> Container exited with a non-zero exit code 1 >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org >> For additional commands, e-mail: user-help@hadoop.apache.org >> > --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org For additional commands, e-mail: user-help@hadoop.apache.org