Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7D421D8C2 for ; Tue, 15 Jan 2013 06:19:16 +0000 (UTC) Received: (qmail 8695 invoked by uid 500); 15 Jan 2013 06:19:11 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 8584 invoked by uid 500); 15 Jan 2013 06:19:10 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 8548 invoked by uid 99); 15 Jan 2013 06:19:09 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Jan 2013 06:19:09 +0000 X-ASF-Spam-Status: No, hits=1.7 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of anilgupta84@gmail.com designates 74.125.83.52 as permitted sender) Received: from [74.125.83.52] (HELO mail-ee0-f52.google.com) (74.125.83.52) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Jan 2013 06:19:01 +0000 Received: by mail-ee0-f52.google.com with SMTP id b15so1830421eek.25 for ; Mon, 14 Jan 2013 22:18:41 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=Rng0C8XYS+HY2SxSznP0uJaMM/DXI5OcbEUu0xKOBl4=; b=CLQfiwqS0NT6UPydWyN0m1lyHz1MaQ1H8lX9qgzn2tb1eIQvNyWYOr3QEgjhgRs/PL aNtKQrXUXe0XCkQBeC1Wsl8ACsm/QVzueN0Ilb4B3TRgnHVZPuyDHDuhxtxjzgFtkAd+ cSQ/KjJfLzc+kIhOHXNjpnZygCKm97EovXVTTzoVvQbo7oEh3lCwlyXCwKPmq2zIWtzc fctTVBzs8CHedsHKVj3qG9yvhVgY5A8/HsNKLkLW+kLy2nr3AZnSMq6434t6glvpJWeP f4GR+s6u+uFHwN/Zl3SPOe6BuH8KsOUC4RSr7aR+4v6lkRhRkKtp9UPxgeRTdqW1EOyj rB1A== Received: by 10.14.219.72 with SMTP id l48mr238876492eep.37.1358230721027; Mon, 14 Jan 2013 22:18:41 -0800 (PST) MIME-Version: 1.0 Received: by 10.223.159.135 with HTTP; Mon, 14 Jan 2013 22:18:20 -0800 (PST) In-Reply-To: References: From: anil gupta Date: Mon, 14 Jan 2013 22:18:20 -0800 Message-ID: Subject: Re: OutofMemoryError when running an YARN application with 25 containers To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=047d7b622124a65f3804d34dbbfa X-Virus-Checked: Checked by ClamAV on apache.org --047d7b622124a65f3804d34dbbfa Content-Type: text/plain; charset=ISO-8859-1 The following log tells you the exact error: *JVMDUMP013I Processed dump event "systhrow", detail "java/lang/OutOfMemoryError".* * * *Exception in thread "Thread-7" java.lang.OutOfMemoryError* * at ApplicationMaster.readMessage(**ApplicationMaster.java:241)* * at ApplicationMaster$**SectionLeaderRunnable.run(** ApplicationMaster.java:825)* * * * at java.lang.Thread.run(Thread.**java:736)* You might need to increase the HeapSize of ApplicationMaster. HTH, Anil Gupta On Mon, Jan 14, 2013 at 4:35 AM, Krishna Kishore Bonagiri < write2kishore@gmail.com> wrote: > Hi, > > I am getting the following error in ApplicationMaster.stderr when > running an application with around 25 container launches. How can I resolve > this issue? > > JVMDUMP006I Processing dump event "systhrow", detail > "java/lang/OutOfMemoryError" - please wait. > JVMDUMP032I JVM requested Heap dump using > '/tmp/nm-local-dir/usercache/dsadm/appcache/application_1355219238448_0461/container_1355219238448_0461_01_000001/heapdump.20130114.044646.16631.0001.phd' > in response to an event > JVMDUMP010I Heap dump written to > /tmp/nm-local-dir/usercache/dsadm/appcache/application_1355219238448_0461/container_1355219238448_0461_01_000001/heapdump.20130114.044646.16631.0001.phd > JVMDUMP032I JVM requested Java dump using > '/tmp/nm-local-dir/usercache/dsadm/appcache/application_1355219238448_0461/container_1355219238448_0461_01_000001/javacore.20130114.044646.16631.0002.txt' > in response to an event > JVMDUMP010I Java dump written to > /tmp/nm-local-dir/usercache/dsadm/appcache/application_1355219238448_0461/container_1355219238448_0461_01_000001/javacore.20130114.044646.16631.0002.txt > JVMDUMP032I JVM requested Snap dump using > '/tmp/nm-local-dir/usercache/dsadm/appcache/application_1355219238448_0461/container_1355219238448_0461_01_000001/Snap.20130114.044646.16631.0003.trc' > in response to an event > JVMDUMP010I Snap dump written to > /tmp/nm-local-dir/usercache/dsadm/appcache/application_1355219238448_0461/container_1355219238448_0461_01_000001/Snap.20130114.044646.16631.0003.trc > JVMDUMP013I Processed dump event "systhrow", detail > "java/lang/OutOfMemoryError". > Exception in thread "Thread-7" java.lang.OutOfMemoryError > at ApplicationMaster.readMessage(ApplicationMaster.java:241) > at > ApplicationMaster$SectionLeaderRunnable.run(ApplicationMaster.java:825) > at java.lang.Thread.run(Thread.java:736) > > > Thanks, > Kishore > -- Thanks & Regards, Anil Gupta --047d7b622124a65f3804d34dbbfa Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable The following log tells you the exact error:
JVMDUMP013I Process= ed dump event "systhrow", detail "java/lang/OutOfMemoryError= ".
Exception in thread "Thread-7" java.lang.OutOfMemoryE= rror
=A0 =A0 =A0 =A0 at ApplicationMaster.readMessage(= ApplicationMaster.java:241)
=A0 =A0 =A0 =A0 at Applicat= ionMaster$SectionLeaderRunnable.run(ApplicationMaster.java:82= 5)
=A0 =A0 =A0 =A0 at java.lang.Thread.run(Thread.java:736)=

You might need to increase the HeapSize of ApplicationMa= ster.

HTH,
Anil Gupta


On Mon, Jan 14, 2013 at 4:35 AM, Krishna Kishore Bonagiri <write2ki= shore@gmail.com> wrote:
Hi,

=A0 I am getting the following error in ApplicationMaster.stderr whe= n running an application with around 25 container launches. How can I resol= ve this issue?

JVMDUMP006I Processing dump event "systhrow",= detail "java/lang/OutOfMemoryError" - please wait.
JVM= DUMP032I JVM requested Heap dump using '/tmp/nm-local-dir/usercache/dsa= dm/appcache/application_1355219238448_0461/container_1355219238448_0461_01_= 000001/heapdump.20130114.044646.16631.0001.phd' in response to an event=
JVMDUMP010I Heap dump written to /tmp/nm-local-dir/usercache/dsadm/app= cache/application_1355219238448_0461/container_1355219238448_0461_01_000001= /heapdump.20130114.044646.16631.0001.phd
JVMDUMP032I JVM requeste= d Java dump using '/tmp/nm-local-dir/usercache/dsadm/appcache/applicati= on_1355219238448_0461/container_1355219238448_0461_01_000001/javacore.20130= 114.044646.16631.0002.txt' in response to an event
JVMDUMP010I Java dump written to /tmp/nm-local-dir/usercache/dsadm/app= cache/application_1355219238448_0461/container_1355219238448_0461_01_000001= /javacore.20130114.044646.16631.0002.txt
JVMDUMP032I JVM requeste= d Snap dump using '/tmp/nm-local-dir/usercache/dsadm/appcache/applicati= on_1355219238448_0461/container_1355219238448_0461_01_000001/Snap.20130114.= 044646.16631.0003.trc' in response to an event
JVMDUMP010I Snap dump written to /tmp/nm-local-dir/usercache/dsadm/app= cache/application_1355219238448_0461/container_1355219238448_0461_01_000001= /Snap.20130114.044646.16631.0003.trc
JVMDUMP013I Processed dump e= vent "systhrow", detail "java/lang/OutOfMemoryError".
Exception in thread "Thread-7" java.lang.OutOfMemoryError
=A0 =A0 =A0 =A0 at ApplicationMaster.readMessage(ApplicationMaster.= java:241)
=A0 =A0 =A0 =A0 at ApplicationMaster$SectionLeaderRunna= ble.run(ApplicationMaster.java:825)
=A0 =A0 =A0 =A0 at java.lang.Thread.run(Thread.java:736)

Thanks,
Kishore



--
Thanks & Regards,Anil Gupta --047d7b622124a65f3804d34dbbfa--