flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Francisco Gonzalez Barea <Francisco.Gonza...@piksel.com>
Subject Problem in Flink 1.3.2 with Mesos task managers offers
Date Tue, 19 Sep 2017 15:58:44 GMT
Hello guys,

We have a flink 1.3.2 session deployed from Marathon json to Mesos with some of the following
parameters as environment variables:


"flink_mesos.initial-tasks": "8",
"flink_mesos.resourcemanager.tasks.mem": "4096",

And other environment variables including zookeeper, etc.

The mesos cluster is used for diferents applications (kafka, ad-hoc...), and have fragmentation
into the agents. Our problem is that the flink session is getting all offers, even small ones.
In case there are not enough offers to suit that configuration, it gets all of them, so there
are no resources and offers free for other applications.

So the question would be what is the right configuration in these cases to avoid using all
resources for the same flink session.

Thanks in advance.
Regards

This message is private and confidential. If you have received this message in error, please
notify the sender or servicedesk@piksel.com and remove it from your system.

Piksel Inc is a company registered in the United States, 2100 Powers Ferry Road SE, Suite
400, Atlanta, GA 30339

Mime
View raw message