giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Panagiotis Eustratiadis <ep.pan....@gmail.com>
Subject Giraph 1.0 | Computation stuck at map 100% - reduce 0% for my algorithm only, at multi-node cluster
Date Tue, 30 Sep 2014 06:53:54 GMT
Good morning,

I have been having a problem the past few days which sadly I can't solve.

First of all I set up a Hadoop 0.20.203.0 cluster of two nodes a master and
a slave. I followed this tutorial for the settings:
http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/

Then I set up Giraph, and I built it properly with maven. When I run the
SimpleShortestPathVertex with number of workers = 2 it runs properly, and
gives me results which I can view from any of the two nodes. Also the
jobtracker at master:50030 and slave:50030 and everything else is working
as expected.

However, when I try to run my own algorithm it hangs at map 100% reduce 0%
forever. I looked at SimpleShortestPathVertex for any configurations and it
has none. And the weird part is: the jobs at the jobtracker have no logs at
stdout or stderr. The only thing readable is the map task info:

task_201409300940_0001_m_000000 | 100.00% - MASTER_ZOOKEEPER_ONLY | 1
finished out of 2 on superstep -1
task_201409300940_0001_m_000001 | 100.00% | startSuperstep: WORKER_ONLY -
Attempt=0, Superstep=-1
task_201409300940_0001_m_000002 | 100.00% | startSuperstep: WORKER_ONLY -
Attempt=0, Superstep=-1

Is there anything I'm overlooking? I have Googled the obvious stack
overflow solutions for two days now. Has anyone encountered anything
similar?

Regards,
Panagiotis Eustratiadis.

Mime
View raw message