Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id DD7F1200C2B for ; Thu, 2 Mar 2017 17:02:23 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id DC18D160B6F; Thu, 2 Mar 2017 16:02:23 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 09D93160B61 for ; Thu, 2 Mar 2017 17:02:22 +0100 (CET) Received: (qmail 22128 invoked by uid 500); 2 Mar 2017 16:02:22 -0000 Mailing-List: contact user-help@giraph.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@giraph.apache.org Delivered-To: mailing list user@giraph.apache.org Received: (qmail 22118 invoked by uid 99); 2 Mar 2017 16:02:22 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Mar 2017 16:02:22 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id AF0E3C2080 for ; Thu, 2 Mar 2017 16:02:21 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.804 X-Spam-Level: ** X-Spam-Status: No, score=2.804 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, SUBJ_ALL_CAPS=1.625] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id Eb_zwyzamvTC for ; Thu, 2 Mar 2017 16:02:20 +0000 (UTC) Received: from mail-qk0-f174.google.com (mail-qk0-f174.google.com [209.85.220.174]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 7004F5F23D for ; Thu, 2 Mar 2017 16:02:20 +0000 (UTC) Received: by mail-qk0-f174.google.com with SMTP id 1so11362071qkl.3 for ; Thu, 02 Mar 2017 08:02:20 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:date:message-id:in-reply-to:references:from:to:subject; bh=xteuCd7OPViit/TtjmnR/DL0luusuYkvvTKShh/dN8w=; b=L/GG1wg+9DYS4ddM97XCdaGfAKXnkemoAZdqTdsWGoFcmjddf/57+71/IsMIKwxbyC 0FQ4xiNvU/vAQeOUXyJNyetIzpV7ucKgfnFb1YNyDQkY0fAWQL4Gi6exAVnqyvDg5c+5 fvP+M52MtpH7XulmFzVniOL3ZDGWvWbZ1pxeXIBDAB0pxX5EtLLDY1aocyeT0GIS90Ku Y5pzyMwdKzZ4GibADWkILl/36CFIdFNiGuKZRZzsv2HNCovy/TtopmU4HO6ZzPdkqFdz yzqi7UbSphtrpgpOU7jbKlsQiW+PeRnA1sTvPQQ4zis6elhDIfRrPGshlLtUWKvHDEbW JqFA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:date:message-id:in-reply-to :references:from:to:subject; bh=xteuCd7OPViit/TtjmnR/DL0luusuYkvvTKShh/dN8w=; b=MpQN8LPz5fI+tQb9geAPZblezDDwzkCXLkOaK4jdP9A9uNov6IV1NLwBChgAkLrH78 GXiYSOkkI2A0m7NQzOC+jdnG6Kisr2UQurmg3KmHs8+NZfO4PmqnN09xQLiYWXKRjWib lGXQomoFR8oiq/SDNeRZeQrG67Xv6XZ/iBCVCGlefZAArcP2iNb/GroYoWlr9M8ozNr/ C20Si2qclea1Rg1+2lqLQO18tHkgzGLaGb6R3jLjwxaECf+xS1oSTFkH6ELtvr2DApkf Ci7g3gXbLtIlyWHHDNZg3kcrGGjNdm2U/kQ4kEyvF1YowM9xzJbNqOSezzmnQdhKRb6R DQKA== X-Gm-Message-State: AMke39nSf4i7En1DWk1iNQPHpL5OLUKrk2j0eiO1109lKDqPtNKHSrtK/NSLpaGkSfeFow== X-Received: by 10.200.45.135 with SMTP id p7mr17529199qta.141.1488470536127; Thu, 02 Mar 2017 08:02:16 -0800 (PST) Received: from [127.0.0.1] (ec2-52-2-28-246.compute-1.amazonaws.com. [52.2.28.246]) by smtp.gmail.com with ESMTPSA id j4sm5603720qkc.40.2017.03.02.08.02.15 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 02 Mar 2017 08:02:15 -0800 (PST) MIME-Version: 1.0 X-Mailer: Cloze (717e99; +http://www.cloze.com/) Date: Thu, 02 Mar 2017 21:32:11 +0530 Message-Id: X-Cloze-Date: 1488470531000 In-Reply-To: References: X-Originating-Ip: [14.139.86.52] From: "Sai Ganesh Muthuraman" To: user@giraph.apache.org Subject: Re: RELATION BETWEEN THE NUMBER OF GIRAPH WORKERS AND THE PROBLEM SIZE Content-Type: multipart/alternative; boundary="----Cloze-717e99-?=_1-1488470535493" archived-at: Thu, 02 Mar 2017 16:02:24 -0000 ------Cloze-717e99-?=_1-1488470535493 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Hi, I am still using Giraph-1.1.0 and I will upgrade soon. Thanks a lot for your suggestions. This is the exact command I used hadoop jar myjar.jar org.apache.giraph.GiraphRunner MyBetweenness.= BetweennessComputation -vif MyBetweenness.VertexDataInputFormat -vip = /user/$USER/inputbc/wiki-Vote -vof MyBetweenness.VertexDataOutputFormat -op= /user/$USER/outputBC 1.0 -w 2 -yj myjar.jar -ca giraph.= useOutOfCoreMessages=3Dtrue -ca giraph.maxMessagesInMemory=3D10000 -ca = giraph.useOutOfCoreGraph=3Dtrue -ca giraph.waitTaskDoneTimeoutMs=3D450000 = -ca giraph.logLevel=3Ddebug -ca giraph.isStatic=3Dtrue I checked the memory information. After Superstep -1, =C2=A0Free memory is = 907mb, Total is 987 mb.=C2=A0 mapreduce.map.memory.mb is 10240mb. Sai Ganesh ------Cloze-717e99-?=_1-1488470535493 Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: quoted-printable Hi,

I am still using = Giraph-1.1.0 and I will upgrade soon.
Thanks a lot for your suggestions.= This is the exact command I used

hadoop jar myjar.= jar org.apache.giraph.GiraphRunner MyBetweenness.BetweennessComputation = -vif MyBetweenness.VertexDataInputFormat -vip /user/$USER/inputbc/wiki-Vote= -vof MyBetweenness.VertexDataOutputFormat -op /user/$USER/outputBC 1.0 -w = 2 -yj myjar.jar -ca giraph.useOutOfCoreMessages=3Dtrue -ca giraph.= maxMessagesInMemory=3D10000 -ca giraph.useOutOfCoreGraph=3Dtrue -ca giraph.= waitTaskDoneTimeoutMs=3D450000 -ca giraph.logLevel=3Ddebug -ca giraph.= isStatic=3Dtrue

I checked the memory = information. After Superstep -1,  Free memory is 907mb, Total is 987 = mb. 
mapreduce.map.memory.mb is 10240mb.=


Sai Ganesh

------Cloze-717e99-?=_1-1488470535493--