flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Zhangrucong <zhangruc...@huawei.com>
Subject re: Flink HA mode
Date Wed, 09 Sep 2015 00:48:42 GMT
In order to discover new JM,I think must use ZK. ZK has the ability to find a new node or the
content of node changed.
First JM must create node in ZK, and write IP and port in node. TMs watch this node. When
TMs find the node content change, TMs reconnect the new JM.

Thanks.

发件人: Emmanuel [mailto:eleroy@msn.com]
发送时间: 2015年9月9日 7:59
收件人: user@flink.apache.org
主题: Flink HA mode

Looking at Flink HA mode.

Why do you need to have the list of masters in the config if zookeeper is used to keep track
of them?
In an environment like Google Cloud or Container Engine, the JM may come back up but will
likely have another IP address.

Is the masters config file only for bootstrapping or is it effectively to keep track of JM
nodes?
Is it what TM nodes use to know their JobManager? Or do they query Zookeeper?

In the scenario above (2 JMs, one fails, and comes back up as another instance, with different
IP) how does the JM join the cluster and how do TMs know about the new JM?

Thanks
E

Mime
View raw message