flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stefano Bortoli <s.bort...@gmail.com>
Subject Re: granular configuration of cluster
Date Fri, 28 Nov 2014 16:40:15 GMT
sweet! so it does not have to be consistent across all nodes! then each
taskmanager will report to the job manager, that will understand the
distribution of the work accordingly. I guess.

thanks a lot!

2014-11-28 17:12 GMT+01:00 Stephan Ewen <sewen@apache.org>:

> Sure that's possible. You need different configurations for each node, so
> instead of having one config directory shared across all nodes, give each
> node an individual config.
> The nodes that should do more work need to see a config with a larger JVM
> heap and more task slots, the nodes that should have fewer load need to
> have a config with smaller heap and fewer slots.
> On Fri, Nov 28, 2014 at 4:57 PM, Stefano Bortoli <s.bortoli@gmail.com>
> wrote:
>> Hi all,
>> is it possible to configure a cluster with different number of task
>> manager per node?
>> for example, I have a cluster where I am using a global index, and the
>> nodes where the global index in running should not be overloaded. However,
>> the other nodes could run more than 4 task manager per node.
>> To have such features would be very helpful to fine tune processes on
>> small clusters.
>> thanks a lot for your support!
>> saluti,
>> Stefano

View raw message