flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ovidiu-Cristian MARCU <ovidiu-cristian.ma...@inria.fr>
Subject Memory ran out PageRank
Date Mon, 14 Mar 2016 15:55:27 GMT
Hi,

While running PageRank on a synthetic graph I run into this problem: 
Any advice on how should I proceed to overcome this memory issue?

IterationHead(Vertex-centric iteration (org.apache.flink.graph.library.PageRank$VertexRankUpdater@7712cae0
| org.apache.flink.graph.library.PageRank$RankMesseng$
java.lang.RuntimeException: Memory ran out. Compaction failed. numPartitions: 32 minPartition:
24 maxPartition: 25 number of overflow segments: 328 bucketSize: 638 Overall memory: 115539968
Partition memory: 50659328 Message: Index: 25, Size: 24
        at org.apache.flink.runtime.operators.hash.CompactingHashTable.insertRecordIntoPartition(CompactingHashTable.java:469)
        at org.apache.flink.runtime.operators.hash.CompactingHashTable.insertOrReplaceRecord(CompactingHashTable.java:414)
        at org.apache.flink.runtime.operators.hash.CompactingHashTable.buildTableWithUniqueKey(CompactingHashTable.java:325)
        at org.apache.flink.runtime.iterative.task.IterationHeadTask.readInitialSolutionSet(IterationHeadTask.java:212)
        at org.apache.flink.runtime.iterative.task.IterationHeadTask.run(IterationHeadTask.java:273)
        at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:354)
        at org.apache.flink.runtime.taskmanager.Task.run(Task.java:584)
        at java.lang.Thread.run(Thread.java:745)

Thanks!

Best,
Ovidiu
Mime
View raw message