flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Maximilian Michels <...@apache.org>
Subject Re: Flink Scala performance
Date Thu, 16 Jul 2015 08:16:43 GMT
HI Vinh,

If you run your program locally, then Flink uses the local execution mode
which allocates only little managed memory. Managed memory is used by Flink
to perform operations on serialized data. These operations can get slow if
too little memory gets allocated because data needs to be spilled to disk.
That would of course be different in a cluster environment where you
configure the memory explicitly.

When the task manager starts, it tells you how much memory it allocates.
For example, in my case:

10:12:37,655 INFO
org.apache.flink.runtime.taskmanager.TaskManager              - Using 1227
MB for Flink managed memory.

How does that look in your case?


On Thu, Jul 16, 2015 at 8:54 AM, Vinh June <hoangthevinh.htv@gmail.com>

> I ran it on local, from terminal.
> And it's the Word Count example so it's small
> --
> View this message in context:
> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-Scala-performance-tp2065p2074.html
> Sent from the Apache Flink User Mailing List archive. mailing list archive
> at Nabble.com.

View raw message