flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Till Rohrmann <trohrm...@apache.org>
Subject Re: Task managers run on separate nodes in a cluster
Date Fri, 14 Sep 2018 16:45:27 GMT
Hi Martin,

Flink supports the mesos.constraints.hard.hostattribute to specify task
constraints based on agent attributes [1]. I think you could use them to
control the task placement.

[1]
https://ci.apache.org/projects/flink/flink-docs-stable/ops/config.html#mesos-constraints-hard-hostattribute

Cheers,
Till

On Fri, Sep 14, 2018 at 3:08 PM Martin Eden <martineden131@gmail.com> wrote:

> Thanks Vino!
>
> On Fri, Sep 14, 2018 at 3:37 AM vino yang <yanghua1127@gmail.com> wrote:
>
>> Hi Martin,
>>
>> Till has done most of the work of Flink on Mesos. Ping Till for you.
>>
>> Thanks, vino.
>>
>> Martin Eden <martineden131@gmail.com> 于2018年9月12日周三 下午11:21写道:
>>
>>> Hi all,
>>>
>>> We're using Flink 1.3.2 with DCOS / Mesos.
>>>
>>> We have a 3 node cluster and are running the Flink DCOS package (Flink
>>> Mesos framework) configured with 3 Task Managers.
>>>
>>> Our goal is to run each of them on separate hosts for better load
>>> balancing but it seems the task managers end up running on the same host.
>>>
>>> Looked around the docs and DCOS Flink package but could not find any
>>> placement policy or anything of the sorts.
>>>
>>> Is there anything like that?
>>>
>>> We are also planning to upgrade to the latest Flink version. Is
>>> something like that supported in this newer version?
>>>
>>> Thanks,
>>> M
>>>
>>

Mime
View raw message