flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ufuk Celebi <...@apache.org>
Subject Re: Isolate Tasks - Run Distinct Tasks in Different Task Managers
Date Wed, 08 Mar 2017 13:31:47 GMT
Internally, Flink defines through SlotSharingGroup which tasks may
share a task manager slot. By configuring each TaskManager to have a
single slot and configuring the slot sharing groups accordingly, you
can get the desired behaviour.

You can specify the slot sharing group for an operator like map by
calling slotSharingGroup(String). You would have you set a different
slot sharing group for the window/apply part.

Does this help?


On Wed, Mar 8, 2017 at 10:44 AM, PedroMrChaves
<pedro.mr.chaves@gmail.com> wrote:
> Hello,
>
> Assuming that I have the following Job Graph,
>
> (Source) -> (map) -> (KeyBy | Window | apply) -> (Sink)
>
> Is there a way to assure that the map operator (and all its subtasks) run on
> a different
> task manager than the operator (map | window | apply)?
>
> This would allow JVM memory isolation without using YARN.
>
> Regards,
> Pedro
>
>
>
>
>
> -----
> Best Regards,
> Pedro Chaves
> --
> View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Isolate-Tasks-Run-Distinct-Tasks-in-Different-Task-Managers-tp12104.html
> Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Mime
View raw message