flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bhupesh Chawda <bhup...@apache.org>
Subject Scheduling of Flink jobs
Date Mon, 29 Aug 2016 14:04:29 GMT

I am running Flink on a cluster of 5 nodes.
Here is my config:

*taskmanager.numberOfTaskSlots: 1parallelism.default: 1*
My Flink dashboard shows the following:

*Task Managers: 5*

*Task Slots: 5*

*Available Task Slots: 5*
I have the following questions:

   1. Why does a job with 8 tasks occupy only 2 task slots (3 slots remain
   free as seen from the UI)? As per my understanding, since the number of
   Task Slots as shown above is just 5, perhaps this job may not get enough
   resources (task slots).
   2. I notice that most of the tasks (operators) in the job run on just
   one of the nodes. The other nodes are idle and free. Is there any way to
   distribute the tasks among other nodes more evenly?

Please advice.


~ Bhupesh

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message