flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sayat Satybaldiyev <saya...@gmail.com>
Subject Re: Flink Task Allocation on Nodes
Date Wed, 24 Oct 2018 13:17:16 GMT
Flink Cluster in standalone with HA configuration. It has 6 Task managers
and each has 8 slots. Overall, 48 slots for the cluster.

>>If you cluster only have one task manager with one slot in each node,
then the job should be spread evenly.
Agree, this will solve the issue. However, the cluster is running other
jobs and in this case it won't have hardware resource for other jobs.

On Wed, Oct 24, 2018 at 2:20 PM Kien Truong <duckientruong@gmail.com> wrote:

> Hi,
>
> How are your task managers deploy ?
>
> If you cluster only have one task manager with one slot in each node,
> then the job should be spread evenly.
>
> Regards,
>
> Kien
>
> On 10/24/2018 4:35 PM, Sayat Satybaldiyev wrote:
> > Is there any way to indicate flink not to allocate all parallel tasks
> > on one node?  We have a stateless flink job that reading from 10
> > partition topic and have a parallelism of 6. Flink job manager
> > allocates all 6 parallel operators to one machine, causing all traffic
> > from Kafka allocated to only one machine. We have a cluster of 6 nodes
> > and ideal to spread one parallel operator to one machine. Is there a
> > way to do than in Flink?
>

Mime
View raw message