flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kurt Young <ykt...@gmail.com>
Subject Re: parallelism and slots allocated
Date Sat, 11 Feb 2017 08:25:16 GMT

The first answer is "yes", 3 unchained operator will use at least 3 slots,
except if these 3 operators are blocking operators and you are running a
batch job, the operators will use the same slot one after another.

Regarding to you second question, if you want to start 3 operators with
parallelism of 1, Flink will chain these operators and execute them on the
same slot. But if you disabled chaining, they do need 3 slots.


On Sat, Feb 11, 2017 at 2:35 AM, bwong247 <bwong@247-inc.com> wrote:

> Hi Kurt,
> Thanks for the reply.
> Does this mean that if my job has 3 operators (not chained), it will use at
> least 3 slots?  I thought parallelism was task based.  You can define it at
> an operator level, but that only  means that the tasks for that operator
> are
> distributed across that many slots.    Shouldn't I be able to start the 3
> operator job with a parallelism of 1 where all the operators run on the
> same
> single slot?
> Regards,
> Bernard
> --
> View this message in context: http://apache-flink-user-
> mailing-list-archive.2336050.n4.nabble.com/parallelism-and-
> slots-allocated-tp11534p11578.html
> Sent from the Apache Flink User Mailing List archive. mailing list archive
> at Nabble.com.

View raw message