flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From TechnoMage <mla...@technomage.com>
Subject State management and heap usage
Date Wed, 11 Apr 2018 21:04:35 GMT
I am pretty new to flink and have an initial streaming job working both locally and remotely.
 But, both ways if the data volume is too high it runs out of heap.  I am using RichMapFunction
to process multiple streams of data.  I assumed Flink would manage keeping state in ram when
possible, and spill to RocksDB when it exceeded heap.

Is this correct?  If so are there configs I need to set to enable or tune this so it can run
within a fixed memory size?

Michael
Mime
View raw message