flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Márton Balassi <balassi.mar...@gmail.com>
Subject Re: Adjusting numberOfSubtasks at runtime
Date Tue, 19 Aug 2014 10:43:57 GMT
Hey,

Any comments on this please? :)

Thanks.


On Tue, Aug 12, 2014 at 8:10 AM, Márton Balassi <balassi.marton@gmail.com>
wrote:

> Hi,
>
> Apache Storm has this cool feature that one can "rebalance a topology"
> during runtime to handle the changes in the streaming workload. Practically
> this means adjusting the number of worker machines and the parallelism of
> the spouts and bolts.
>
> Translated to Flink terms this would mean changing the numberOfSubtasks
> field of the AbstractJobVertices of the JobGraph during runtime (amongst
> others, e.g. updating the numberOfOutputChannels in the partitioners
> accordingly).
>
> Is there any support for achieving this currently?
>
> Cheers,
>
> Marton
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message