giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Claudio Martella <claudio.marte...@gmail.com>
Subject Re: Out of core execution has no effect on GC crash
Date Sat, 07 Sep 2013 14:47:44 GMT
OOC is used also at input superstep. try to decrease the number of
partitions kept in memory.


On Sat, Sep 7, 2013 at 1:37 AM, Alexander Asplund <alexasplund@gmail.com>wrote:

> Hi,
>
> I'm trying to process a graph that is about 3 times the size of
> available memory. On the other hand, there is plenty of disk space. I
> have enabled the giraph.useOutOfCoreGraph property, but it still
> crashes with outOfMemoryError: GC limit exceeded when I try running my
> job.
>
> I'm wondering of the spilling is supposed to work during the input
> step. If so, are there any additional steps that must be taken to
> ensure it functions?
>
> Regards,
> Alexander Asplund
>



-- 
   Claudio Martella
   claudio.martella@gmail.com

Mime
View raw message