Return-Path: X-Original-To: apmail-giraph-user-archive@www.apache.org Delivered-To: apmail-giraph-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7188D11210 for ; Tue, 15 Apr 2014 08:44:02 +0000 (UTC) Received: (qmail 69988 invoked by uid 500); 15 Apr 2014 08:44:01 -0000 Delivered-To: apmail-giraph-user-archive@giraph.apache.org Received: (qmail 69660 invoked by uid 500); 15 Apr 2014 08:43:59 -0000 Mailing-List: contact user-help@giraph.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@giraph.apache.org Delivered-To: mailing list user@giraph.apache.org Received: (qmail 69302 invoked by uid 99); 15 Apr 2014 08:43:58 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Apr 2014 08:43:58 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of agrta.rawat@gmail.com designates 209.85.128.181 as permitted sender) Received: from [209.85.128.181] (HELO mail-ve0-f181.google.com) (209.85.128.181) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Apr 2014 08:43:52 +0000 Received: by mail-ve0-f181.google.com with SMTP id oy12so8589138veb.40 for ; Tue, 15 Apr 2014 01:43:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=iwUk1HDS4lrHLaNA3Brgdj/fEPLjmAruJy6pJVhibv8=; b=lIduRdnN4Xyia98SMoR3TT/YZidD2c887za2zEtnqsRiJKbloiuoo0juBoa6W2UXxp VSll6b5m1wSKH7zRepJ2RW8LLEPzmqb7Qbnmhqbg3TfWjAgdSwmKtyNymybvGFgl5tfH /k196tmCIiQ+zkQfXQJTGi3z9rsfW3nT0de4bMX5fTKHMPpU8gBggmPORhNUpcj7W5eH qaVAeufA2nlQwxOoAUW5O/eoqRFSHjtFdEsawxkrJrbiv8rxFe2CZBOngqyz1Hamf2KJ GsTr3T3M8T8KLlBAcWKFZw6IUiQbNwzZJfw9VTUj6UkIfIV5nuckpH0HGW998feE2ncN 67ng== MIME-Version: 1.0 X-Received: by 10.221.4.66 with SMTP id ob2mr281739vcb.28.1397551410349; Tue, 15 Apr 2014 01:43:30 -0700 (PDT) Received: by 10.58.98.226 with HTTP; Tue, 15 Apr 2014 01:43:30 -0700 (PDT) In-Reply-To: References: Date: Tue, 15 Apr 2014 14:13:30 +0530 Message-ID: Subject: Re: giraph memory usage info From: Agrta Rawat To: user@giraph.apache.org Content-Type: multipart/alternative; boundary=089e0122a9245e8a8c04f710cbaa X-Virus-Checked: Checked by ClamAV on apache.org --089e0122a9245e8a8c04f710cbaa Content-Type: text/plain; charset=UTF-8 Hi Arun, I would suggest you to check two things - 1. Does your code run successfully for some small data? 2. Have you modified hadoop-env.sh and mapred-site.xml file for all 6 clusters? And it is showing "Caused by: java.util.concurrent. ExecutionException: java.lang.OutOfMemoryError: Java heap space" This means there is something in your code that is being modified and accessed simultaneously at runtime. e.g. if you are iterating a hashset and removing or adding contents to it, it will give such kind of exceptions. Regards, Agrta Rawat On Mon, Apr 14, 2014 at 7:02 PM, Arun Kumar wrote: > Hello, > > I am trying to run triangle count program in giraph using a hadoop cluster > of 6 machines each having 16 gb of ram. My data set is of size 1 gb which > is of json format. > > The issue is I am getting OutOfMemoryError while trying to run this. For > data which is up to 25 thousand line of code it runs fine.I have updated > > Hadoop-env.sh with export HADOOP_HEAPSIZE=2000 and mapred-site.xml with > mapred.child.java.opts > -Xmx3000m -XX:+UseConcMarkSweepGC > and the number of map instance is max 3 so for each machine will occupy > 13 gb > > But even after doing all this things I am getting the below exception, > > Error from attempt_201404140400_0001_m_000011_0: > java.lang.IllegalStateException: run: Caught an unrecoverable exception > waitFor: ExecutionException occurred while waiting for > org.apache.giraph.utils.ProgressableUtils$FutureWaitable@3e3a2536 > at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:102) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:364) > at org.apache.hadoop.mapred.Child$4.run(Child.java:255) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:396) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190) > at org.apache.hadoop.mapred.Child.main(Child.java:249) > Caused by: java.lang.IllegalStateException: waitFor: ExecutionException > occurred while waiting for > org.apache.giraph.utils.ProgressableUtils$FutureWaitable@3e3a2536 > at > org.apache.giraph.utils.ProgressableUtils.waitFor(ProgressableUtils.java:151) > at > org.apache.giraph.utils.ProgressableUtils.waitForever(ProgressableUtils.java:111) > at > org.apache.giraph.utils.ProgressableUtils.getFutureResult(ProgressableUtils.java:73) > at > org.apache.giraph.utils.ProgressableUtils.getResultsWithNCallables(ProgressableUtils.java:192) > at > org.apache.giraph.graph.GraphTaskManager.processGraphPartitions(GraphTaskManager.java:753) > at > org.apache.giraph.graph.GraphTaskManager.execute(GraphTaskManager.java:273) > at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:92) > ... 7 more > Caused by: java.util.concurrent.ExecutionException: > java.lang.OutOfMemoryError: Java heap space > at > java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:232) > at java.util.concurrent.FutureTask.get(FutureTask.java:91) > at > org.apache.giraph.utils.ProgressableUtils$FutureWaitable.waitFor(ProgressableUtils.java:271) > at > org.apache.giraph.utils.ProgressableUtils.waitFor(ProgressableUtils.java:143) > ... 13 more > Caused by: java.lang.OutOfMemoryError: Java heap space > > Thanks, > > Arun > --089e0122a9245e8a8c04f710cbaa Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi Arun,

=C2=A0I would su= ggest you to check two things -

1. Does your code run successf= ully for some small data?
2. Have you modified hadoop-env.sh and m= apred-site.xml file for all 6 clusters?

And it is showing=C2=A0 "Caused by: java.util.concurrent.

ExecutionException: java.lang.OutOfMemoryError: Java heap space"


This means there is something in your code that is being modified and a= ccessed simultaneously at runtime.

e.g. if you ar= e iterating a hashset and removing or adding contents to it, it will give s= uch kind of exceptions.


Regards,

Agrta Rawat



=
On Mon, Apr 14, 2014 at 7:02 PM, Arun Kumar <to= garun@gmail.com> wrote:

Hell= o,

I am trying to run triangle count program in giraph = using a hadoop cluster of 6 machines each having 16 gb of ram. My data set is of=C2= =A0 size 1 gb which is of json format.

The issue is I am getting=C2=A0 OutOfMemoryError=C2=A0 while trying to run this. For data which is up to 25 thousand line of code it runs fine.I h= ave updated

Hadoop-env.sh with export HADOOP_HEAPSIZE=3D2000 and mapred-site.xml with <name>mapred.child.java.opts</name>
=C2=A0=C2=A0 <value>-Xmx3000m -XX:+UseConcMarkSweepGC</value> and the number of map instance is max 3=C2=A0 so for each machine=C2=A0 will occupy 13 gb

But even after doing all this things I am getting th= e below exception,

Error from attempt_201404140400_0001_m_000011_0: java.lang.IllegalStateException: run: Caught an unrecoverable exception waitFor: ExecutionException occurred whil= e waiting for org.apache.giraph.utils.Progressabl= eUtils$FutureWaitable@3e3a2536
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:102)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.mapred.MapTask.run(MapTask.java:364)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at java.security.AccessController.doPrivileged(Native Method)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at javax.security.auth.Subject.doAs(Subject.java:396)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.j= ava:1190)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.lang.IllegalStateException: waitFor: ExecutionException occurred while waiting for org.apache.giraph.ut= ils.ProgressableUtils$FutureWaitable@3e3a2536
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.giraph.utils.ProgressableUtils.waitFor(ProgressableUtils.java:15= 1)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.giraph.utils.ProgressableUtils.waitForever(ProgressableUtils.jav= a:111)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.giraph.utils.ProgressableUtils.getFutureResult(ProgressableUtils= .java:73)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.giraph.utils.ProgressableUtils.getResultsWithNCallables(Progress= ableUtils.java:192)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.giraph.graph.GraphTaskManager.processGraphPartitions(GraphTaskMa= nager.java:753)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.giraph.graph.GraphTaskManager.execute(GraphTaskManager.java:273)=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.giraph.graph.Graph= Mapper.run(GraphMapper.java:92)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 ... 7 more
Caused by: java.util.concurrent.ExecutionException: java.lang.OutOfMemoryEr= ror: Java heap space
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:232)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at java.util.concurrent.FutureTa= sk.get(FutureTask.java:91)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.giraph.utils.ProgressableUtils$FutureWaitable.waitFor(Progressab= leUtils.java:271)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.giraph.utils.ProgressableUtils.waitFor(ProgressableUtils.java:14= 3)
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 ... 13 more
Caused by: java.lang.OutOfMemoryError: Java heap space

Thanks,

Arun


--089e0122a9245e8a8c04f710cbaa--