giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Claudio Martella <>
Subject Re: Out of core execution has no effect on GC crash
Date Sat, 07 Sep 2013 14:47:44 GMT
OOC is used also at input superstep. try to decrease the number of
partitions kept in memory.

On Sat, Sep 7, 2013 at 1:37 AM, Alexander Asplund <>wrote:

> Hi,
> I'm trying to process a graph that is about 3 times the size of
> available memory. On the other hand, there is plenty of disk space. I
> have enabled the giraph.useOutOfCoreGraph property, but it still
> crashes with outOfMemoryError: GC limit exceeded when I try running my
> job.
> I'm wondering of the spilling is supposed to work during the input
> step. If so, are there any additional steps that must be taken to
> ensure it functions?
> Regards,
> Alexander Asplund

   Claudio Martella

View raw message