flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Fabian Hueske (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-2366) HA Without ZooKeeper
Date Thu, 16 Jul 2015 10:02:04 GMT

    [ https://issues.apache.org/jira/browse/FLINK-2366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629515#comment-14629515
] 

Fabian Hueske commented on FLINK-2366:
--------------------------------------

Besides being a distributed data processing engine, Flink offers an embedded mode which executes
Flink programs on Java collections. 
Is this what you refer to? If yes, this mode does not require HA. It runs in the same JVM
process as your application and is not meant for large data sets. If that process goes down,
you don't need HA anymore. I don't see another option than this mode to use Flink "as a library".

Except for the embedded collection execution mode, Flink runs as a distributed system for
which HA is a very useful feature. As [~senorcarbone] pointed out, HA in a distributed system
means leader election, Paxos, etc. ZK provides all of this and reimplementing that in Flink
is not an option, IMO.

> HA Without ZooKeeper
> --------------------
>
>                 Key: FLINK-2366
>                 URL: https://issues.apache.org/jira/browse/FLINK-2366
>             Project: Flink
>          Issue Type: Improvement
>            Reporter: Suminda Dharmasena
>            Priority: Minor
>
> Please provide a way to do HA without having to use ZK.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message