flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mihail Vieru <vi...@informatik.hu-berlin.de>
Subject Re: Memory in local setting
Date Wed, 17 Jun 2015 07:35:07 GMT
Hi,

I had the same problem and setting the solution set to unmanaged helped:

VertexCentricConfiguration parameters = new VertexCentricConfiguration();
parameters.setSolutionSetUnmanagedMemory(false);

runVertexCentricIteration(..., parameters);

Best,
Mihail

On 17.06.2015 07:01, Sebastian wrote:
> Hi,
>
> Flink has memory problems when I run an algorithm from my local IDE on 
> a 2GB graph. Is there any way that I can increase the memory given to 
> Flink?
>
> Best,
> Sebastian
>
> Caused by: java.lang.RuntimeException: Memory ran out. numPartitions: 
> 32 minPartition: 4 maxPartition: 4 number of overflow segments: 151 
> bucketSize: 146 Overall memory: 14024704 Partition memory: 4194304
>     at 
> org.apache.flink.runtime.operators.hash.CompactingHashTable.getNextBuffer(CompactingHashTable.java:784)
>     at 
> org.apache.flink.runtime.operators.hash.CompactingHashTable.insertBucketEntryFromSearch(CompactingHashTable.java:668)
>     at 
> org.apache.flink.runtime.operators.hash.CompactingHashTable.insertOrReplaceRecord(CompactingHashTable.java:538)
>     at 
> org.apache.flink.runtime.operators.hash.CompactingHashTable.buildTableWithUniqueKey(CompactingHashTable.java:347)
>     at 
> org.apache.flink.runtime.iterative.task.IterationHeadPactTask.readInitialSolutionSet(IterationHeadPactTask.java:209)
>     at 
> org.apache.flink.runtime.iterative.task.IterationHeadPactTask.run(IterationHeadPactTask.java:270)
>     at 
> org.apache.flink.runtime.operators.RegularPactTask.invoke(RegularPactTask.java:362)
>     at org.apache.flink.runtime.taskmanager.Task.run(Task.java:559)
>     at java.lang.Thread.run(Thread.java:745)


Mime
View raw message