Return-Path: X-Original-To: apmail-giraph-user-archive@www.apache.org Delivered-To: apmail-giraph-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5A7D011572 for ; Fri, 19 Sep 2014 17:34:08 +0000 (UTC) Received: (qmail 25188 invoked by uid 500); 19 Sep 2014 17:34:08 -0000 Delivered-To: apmail-giraph-user-archive@giraph.apache.org Received: (qmail 25137 invoked by uid 500); 19 Sep 2014 17:34:08 -0000 Mailing-List: contact user-help@giraph.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@giraph.apache.org Delivered-To: mailing list user@giraph.apache.org Received: (qmail 25127 invoked by uid 99); 19 Sep 2014 17:34:08 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 19 Sep 2014 17:34:08 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of puagarwal@yahoo.com designates 98.138.229.32 as permitted sender) Received: from [98.138.229.32] (HELO nm39.bullet.mail.ne1.yahoo.com) (98.138.229.32) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 19 Sep 2014 17:34:00 +0000 Received: from [127.0.0.1] by nm39.bullet.mail.ne1.yahoo.com with NNFMP; 19 Sep 2014 17:33:39 -0000 Received: from [98.138.100.112] by nm39.bullet.mail.ne1.yahoo.com with NNFMP; 19 Sep 2014 17:30:52 -0000 Received: from [98.137.12.175] by tm103.bullet.mail.ne1.yahoo.com with NNFMP; 19 Sep 2014 17:30:51 -0000 Received: from [98.137.12.232] by tm14.bullet.mail.gq1.yahoo.com with NNFMP; 19 Sep 2014 17:30:51 -0000 Received: from [127.0.0.1] by omp1040.mail.gq1.yahoo.com with NNFMP; 19 Sep 2014 17:30:51 -0000 X-Yahoo-Newman-Property: ymail-4 X-Yahoo-Newman-Id: 482598.57259.bm@omp1040.mail.gq1.yahoo.com Received: (qmail 16786 invoked by uid 60001); 19 Sep 2014 17:30:51 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1411147851; bh=+5AU+5nE7IY9ouzSznV17GydHAOxBuEahuXaKba0CQY=; h=References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=AqbQ1Q+Kz79dhjdYsNAurL7h2bGYtv/XCU/YL/+tXhF4sip4kZ8n8G8gkp6OmfDfwn90aSjRRPPoNLB5rlodcaDua7qrSiNRdj4w622mft5OtCDMYxphuyOgUkvgpyh1MoBLzixLQX7Yi5dzikvq6H17n93cXlwDo5VjUHDp5+I= X-YMail-OSG: KmcVju0VM1kbJsG1KChEkLCufZCBAtmO6zD9Pe5Bsh2O1Ic Ow9CjlC_jfokq44cGjlS7Y0jnFqkbWXJwHFiew0.j8_aUk1R4iPuf.iaMItU z_kkZ8m.PsDgjLqmMz73MZOmtnJ9G2YcVqsmtp5ET9trNmBMFBmMTSrWwUbG qKGSsYbb9q1kanMMWk5QWUZfaVlCUaCX0aHeGIJ.YbBtO9lp.fLCiQ3osRzK c9RY.a5lXrn11ByI6YFByV7FOVP0wfsRCHtIbPyh5lxHTvp9y17lsDUv0k3l nN.S7Iq1l6uSaZeF8YArOMItcb_vKMed1VPJYLBaOKHXPjF8wDsqpiz_T9VT 95oPC12lZIIl4docyvqb5u02C11Ws5jGuXmk679zNFe94wh257mW0Po.s9ca hH0svuwfQvzvHiVM96lg8e6UFFqu_FdsKSdgK2.81wx9zf2I_ZhaDQXRgNJy _aekwvWnQkFrCZ4mSEZ4BMWa5UO3wRqqsEkBZH0CtXotsQ70Rblj4FUURszq C2g8YBP7wYoOvcVVQC3iCFw10aSlje2caT1Wy9vK9r3Qrivu8vh6uyuaH5V_ m.6AP Received: from [103.255.77.165] by web163603.mail.gq1.yahoo.com via HTTP; Fri, 19 Sep 2014 10:30:51 PDT X-Rocket-MIMEInfo: 002.001,SXQgZ290IHNvbHZlZC4KCkkgd2FzIHVzaW5nIHRoZSBmb2xsb3dpbmcgYXBpIAoKYXJyYXlMaXN0VmFyLmFkZChpLCBuZXcgRmxvYXQobmV3VmFsKSkgCgp3aGlsZSB0aGVyZSBleGlzdGVkIGFub3RoZXIgdmFsdWUgYXQgaSBwb3NpdGlvbiBpbiB0aGUgQXJyYXlMaXN0LgpJIHRoZW4gY2hhbmdlZCB0aGUgbG9naWMgdG8gYWRkIHRoZSB2YWx1ZSBhZnRlciBpdGggcG9zaXRpb24sIGl0IHN0b3BwZWQgZ2l2aW5nIHRoZSBvdXQgb2YgbWVtb3J5IGVycm9yLgoKVGhlcmUgc2VlbXMgdG8gYmUgc29tZSBlcnJvciABMAEBAQE- X-Mailer: YahooMailWebService/0.8.203.696 References: <1411145274.16481.YahooMailNeo@web163603.mail.gq1.yahoo.com> Message-ID: <1411147851.40306.YahooMailNeo@web163603.mail.gq1.yahoo.com> Date: Fri, 19 Sep 2014 10:30:51 -0700 From: Puneet Agarwal Reply-To: Puneet Agarwal Subject: Re: java.lang.OutOfMemoryError: Java heap space To: "user@giraph.apache.org" In-Reply-To: <1411145274.16481.YahooMailNeo@web163603.mail.gq1.yahoo.com> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="-1090023523-765242058-1411147851=:40306" X-Virus-Checked: Checked by ClamAV on apache.org ---1090023523-765242058-1411147851=:40306 Content-Type: text/plain; charset=us-ascii It got solved. I was using the following api arrayListVar.add(i, new Float(newVal)) while there existed another value at i position in the ArrayList. I then changed the logic to add the value after ith position, it stopped giving the out of memory error. There seems to be some error message issue here, the error said out of memory error, but the error is not of memory but something else. Few, I came out of this error for now. Thanks anyway. Regards Puneet Agarwal IIT Delhi On Friday, September 19, 2014 10:17 PM, Puneet Agarwal wrote: Hi, I wrote a code on Giraph 1.0.0 and using it with Hadoop 1.0.0 My program, uses an Aggregator to find the top-K vertices in some manner. I am running this program only on 11 vertices. I have written my own Aggregator class, which extends BasicAggregator I have declared two instance variables in this class, i.e., there are two ArrayLists inside the class and outside method bodies. The logic is to keep adding the values received in these ArrayLists, until top-K values are found. when I add second value in these ArrayLists, I get the error java.lang.OutOfMemoryError: Java heap space I have tried to increase heap-size, to 4gb by modifying the mapred-site.xml, but no respite. Please help. Regards Puneet Agarwal IIT Delhi ---1090023523-765242058-1411147851=:40306 Content-Type: text/html; charset=us-ascii
It got solved.

I was using the following api 

arrayListVar.add(i, new Float(newVal)) 

while there existed another value at i position in the ArrayList.
I then changed the logic to add the value after ith position, it stopped giving the out of memory error.

There seems to be some error message issue here, the error said out of memory error, but the error is not of memory but something else.

Few, I came out of this error for now.

Thanks anyway.

Regards
Puneet Agarwal
IIT Delhi


On Friday, September 19, 2014 10:17 PM, Puneet Agarwal <puagarwal@yahoo.com> wrote:


Hi,
I wrote a code on Giraph 1.0.0 and using it with Hadoop 1.0.0

My program, uses an Aggregator to find the top-K vertices in some manner.
I am running this program only on 11 vertices.

I have written my own Aggregator class, which extends BasicAggregator<Text> 
I have declared two instance variables in this class, i.e., there are two ArrayLists inside the class and outside method bodies.

The logic is to keep adding the values received in these ArrayLists, until top-K values are found.
when I add second value in these ArrayLists, I get the error java.lang.OutOfMemoryError: Java heap space

I have tried to increase heap-size, to 4gb by modifying the mapred-site.xml, but no respite.

Please help.


Regards
Puneet Agarwal
IIT Delhi


---1090023523-765242058-1411147851=:40306--