flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Konstantin Knauf <konstantin.kn...@tngtech.com>
Subject JobManager HA without Distributed FileSystem
Date Tue, 23 Aug 2016 16:36:06 GMT
Hi all,

the documenation of JobManager HA [1] explains that HA is only possible
with the FS state backend as Job Manager metadata is saved there.

What are the particular problems using JobManager HA with the
MemoryStatebackend?

As I understand it, the state is checkpointed to all JobManagers
(leaders + standy) when using the MemoryStateBackend or am I wrong here?

Follow Up Question: Is it generally possible to setup a highly
available, at-least-once (source: Kafka) pipeline without a distributed
filesystem (only local FS and Zookeeper) for the checkpoints?

Cheers,

Konstantin


[1]
https://ci.apache.org/projects/flink/flink-docs-master/setup/jobmanager_high_availability.html

-- 
Konstantin Knauf * konstantin.knauf@tngtech.com * +49-174-3413182
TNG Technology Consulting GmbH, Betastr. 13a, 85774 Unterföhring
Geschäftsführer: Henrik Klagges, Christoph Stock, Dr. Robert Dahlke
Sitz: Unterföhring * Amtsgericht München * HRB 135082


Mime
View raw message