giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From shaurya rohatgi <shau...@gmail.com>
Subject Job Taking too much time to Compute
Date Thu, 30 Apr 2015 09:01:02 GMT
Hi all,

I am new to giraph. My goal is to set the edge weight as the average
of the degree of the 2 vertices.

My dataset follows a power lognormal distribution.

My algorithm is simple. In superstep 0 and 1 I am able to set the
degree of the vertices as their value.
In the next superstep i.e 2nd, I set the edge weight using
setEdgeValue(Target VertexID, Edge Weight).

Everything runs smoothly.

The problem is that it takes hours to compute on vertices with a
degree of the order 100,000. With vertices having degrees in millions,
it is taking too long.(by too long I mean 6 hours on a single vertex).

What should I do?

Should I improve my algorithm?

OR

Is there some configuration in Giraph so that I can improve the
performance of the computation.

Thanks,
Shaurya

Mime
View raw message