flink-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From u..@apache.org
Subject flink git commit: [FLINK-3653] [docs] Add recovery.zookeeper.storageDir docs to config page
Date Thu, 24 Mar 2016 10:55:04 GMT
Repository: flink
Updated Branches:
  refs/heads/master b8299bf92 -> 27dfd8651

[FLINK-3653] [docs] Add recovery.zookeeper.storageDir docs to config page

This closes #1828.

Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/27dfd865
Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/27dfd865
Diff: http://git-wip-us.apache.org/repos/asf/flink/diff/27dfd865

Branch: refs/heads/master
Commit: 27dfd8651b92598fdbf528d4faedbf05e3857ca6
Parents: b8299bf
Author: Stefano Baghino <stefano.baghino@radicalbit.io>
Authored: Tue Mar 22 17:17:32 2016 +0100
Committer: Ufuk Celebi <uce@apache.org>
Committed: Thu Mar 24 11:54:43 2016 +0100

 docs/setup/config.md | 6 +++++-
 1 file changed, 5 insertions(+), 1 deletion(-)

diff --git a/docs/setup/config.md b/docs/setup/config.md
index 2bf0c07..ce2ad13 100644
--- a/docs/setup/config.md
+++ b/docs/setup/config.md
@@ -119,7 +119,9 @@ If you are on YARN, then it is sufficient to authenticate the client with
    -  `jobmanager`: In-memory state, backup to JobManager's/ZooKeeper's memory. Should be
used only for minimal state (Kafka offsets) or testing and local debugging.
    -  `filesystem`: State is in-memory on the TaskManagers, and state snapshots are stored
in a file system. Supported are all filesystems supported by Flink, for example HDFS, S3,
-- `state.backend.fs.checkpointdir`: Directory for storing checkpoints in a flink supported
filesystem Note: State backend must be accessible from the JobManager, use file:// only for
local setups.
+- `state.backend.fs.checkpointdir`: Directory for storing checkpoints in a Flink supported
filesystem. Note: State backend must be accessible from the JobManager, use `file://` only
for local setups.
+- `recovery.zookeeper.storageDir`: Required for HA. Directory for storing JobManager metadata;
this is persisted in the state backend and only a pointer to this state is stored in ZooKeeper.
Exactly like the checkpoint directory it must be accessible from the JobManager and a local
filesystem should only be used for local deployments.
 - `blob.storage.directory`: Directory for storing blobs (such as user jar's) on the TaskManagers.
@@ -261,6 +263,8 @@ For example when running Flink on YARN on an environment with a restrictive
 - `recovery.zookeeper.path.leader`: (Default '/leader') Defines the znode of the leader which
contains the URL to the leader and the current leader session ID
+- `recovery.zookeeper.storageDir`: Defines the directory in the state backend where the JobManager
metadata will be stored (ZooKeeper only keeps pointers to it). Required for HA.
 - `recovery.zookeeper.client.session-timeout`: (Default '60000') Defines the session timeout
for the ZooKeeper session in ms.
 - `recovery.zookeeper.client.connection-timeout`: (Default '15000') Defines the connection
timeout for ZooKeeper in ms.

View raw message