flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From otherwise777 <wou...@onzichtbaar.net>
Subject Executing graph algorithms on Gelly that are larger then memmory
Date Mon, 28 Nov 2016 20:43:51 GMT
I read somewhere that Flink and Gelly should be able to handle graph
algorithms that require more space then the available memory, i'm currently
getting java OutOfMemoryError heap space and if it would use disk space that
wouldn't happen.
Currently my algorithms use dense graphs with 10m edges, the algorithms that
i use are on my github [1], i did get the same heap space errors when using
the Gelly algorithms, i also tried playing with setting the parallelism but
it mostly gives the same error

Can anyone help me with some methods on how to solve this so that i can
scale up to bigger graphs?

[1] https://github.com/otherwise777/Temporal_Graph_library/



--
View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Executing-graph-algorithms-on-Gelly-that-are-larger-then-memmory-tp10358.html
Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Mime
View raw message