Mailing-List: contact user-help@giraph.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@giraph.apache.org
Received-SPF: pass (athena.apache.org: domain of amani.alonazi@kaust.edu.sa
 designates 209.85.210.180 as permitted sender)
MIME-Version: 1.0
Date: Wed, 22 Aug 2012 08:12:25 +0300
Message-ID: 
 <CAHkPyA7DjKffgHmt0nRL0j2R37brFhemoHbn_NFcBdGHp57sQw@mail.gmail.com>
Subject: Giraph Job "Task attempt_* failed to report status" Problem
From: Amani Alonazi <amani.alonazi@kaust.edu.sa>
To: user@giraph.apache.org, dev@giraph.apache.org
Content-Type: multipart/alternative; boundary=14dae9399c2fd7a72704c7d3c9a9

--14dae9399c2fd7a72704c7d3c9a9
Content-Type: text/plain; charset=US-ASCII

Hi all,

I'm running a minimum spanning tree compute function on Hadoop cluster (20
machines). After certain supersteps (e.g. superstep 47 for a graph of
4,194,304 vertices and 181,566,970 edges), the execution time increased
dramatically. This is not the only problem, the job has been killed "Task
attempt_* failed to report status for 601 seconds. Killing! "

I disabled the checkpoint feature by setting the
"CHECKPOINT_FREQUENCY_DEFAULT = 0" in GiraphJob.java. I don't need to write
any data to disk neither snapshots nor output. I tested the algorithm on
sample graph of 7 vertices and it works well.

Is there any way to profile or debug Giraph job?
In the Giraph Stats the "Aggregate finished vertices" counter is it for the
vertices which voted to halt? Also the "sent messages" counter, is it per
each superstep or the total msgs?
If a vertex vote to halt, will it be activated upon receiving messages?

Thanks a lot!

Best,
Amani AlOnazi
MSc Computer Science
King Abdullah University of Science and Technology
Kingdom of Saudi Arabia

-- 

------------------------------
This message and its contents, including attachments are intended solely 
for the original recipient. If you are not the intended recipient or have 
received this message in error, please notify me immediately and delete 
this message from your computer system. Any unauthorized use or 
distribution is prohibited. Please consider the environment before printing 
this email.

--14dae9399c2fd7a72704c7d3c9a9
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi all,<br><br>I&#39;m running a minimum spanning tree com=
pute function on Hadoop cluster (20 machines). After certain supersteps (e.=
g. superstep 47 for a graph of 4,194,304 vertices and 181,566,970 edges), t=
he execution time increased dramatically. This is not the only problem, the=
 job has been killed &quot;Task attempt_* failed to report status for 601 s=
econds. Killing! &quot;<br>
<br>I disabled the checkpoint feature by setting the &quot;CHECKPOINT_FREQU=
ENCY_DEFAULT =3D 0&quot; in GiraphJob.java. I don&#39;t need to write any d=
ata to disk neither snapshots nor output. I tested the algorithm on sample =
graph of 7 vertices and it works well. <br>
<br>Is there any way to profile or debug Giraph job? <br>In the Giraph Stat=
s the &quot;Aggregate finished vertices&quot; counter is it for the vertice=
s which voted to halt? Also the &quot;sent messages&quot; counter, is it pe=
r each superstep or the total msgs? <br>
If a vertex vote to halt, will it be activated upon receiving messages?=A0 =
<br> <br>Thanks a lot!<br><br clear=3D"all">Best,<br><div dir=3D"ltr"><span=
 style=3D"color:rgb(51,51,51)">Amani AlOnazi</span><br style=3D"color:rgb(5=
1,51,51)">
<span style=3D"color:rgb(51,51,51)">MSc Computer Science </span><br style=
=3D"color:rgb(51,51,51)"><span style=3D"color:rgb(51,51,51)">
King Abdullah University of Science and Technology</span><br style=3D"color=
:rgb(51,51,51)"><span style=3D"color:rgb(51,51,51)">Kingdom of Saudi Arabia=
</span><span style=3D"color:rgb(51,51,51)"><br></span></div><br>
</div>

<br>
<div><hr></div><font face=3D"Arial" size=3D"1">This message and its content=
s, including attachments are intended solely for the original recipient. If=
 you are not the intended recipient or have received this message in error,=
 please notify me immediately and delete this message from your computer sy=
stem. Any unauthorized use or distribution is prohibited. Please consider t=
he environment before printing this email.</font>
--14dae9399c2fd7a72704c7d3c9a9--