flink-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From u..@apache.org
Subject flink git commit: [FLINK-3653] [docs] Add recovery.zookeeper.storageDir docs to config page
Date Thu, 24 Mar 2016 10:55:29 GMT
Repository: flink
Updated Branches:
  refs/heads/release-1.0 1ca4f36d0 -> 5357ebe03


[FLINK-3653] [docs] Add recovery.zookeeper.storageDir docs to config page

This closes #1828.


Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/5357ebe0
Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/5357ebe0
Diff: http://git-wip-us.apache.org/repos/asf/flink/diff/5357ebe0

Branch: refs/heads/release-1.0
Commit: 5357ebe03683ed1ca61597b5860a6cf99a9bf2c8
Parents: 1ca4f36
Author: Stefano Baghino <stefano.baghino@radicalbit.io>
Authored: Tue Mar 22 17:17:32 2016 +0100
Committer: Ufuk Celebi <uce@apache.org>
Committed: Thu Mar 24 11:55:17 2016 +0100

----------------------------------------------------------------------
 docs/setup/config.md | 6 +++++-
 1 file changed, 5 insertions(+), 1 deletion(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/flink/blob/5357ebe0/docs/setup/config.md
----------------------------------------------------------------------
diff --git a/docs/setup/config.md b/docs/setup/config.md
index 28b1429..9469247 100644
--- a/docs/setup/config.md
+++ b/docs/setup/config.md
@@ -119,7 +119,9 @@ If you are on YARN, then it is sufficient to authenticate the client with
Kerber
    -  `jobmanager`: In-memory state, backup to JobManager's/ZooKeeper's memory. Should be
used only for minimal state (Kafka offsets) or testing and local debugging.
    -  `filesystem`: State is in-memory on the TaskManagers, and state snapshots are stored
in a file system. Supported are all filesystems supported by Flink, for example HDFS, S3,
...
 
-- `state.backend.fs.checkpointdir`: Directory for storing checkpoints in a flink supported
filesystem Note: State backend must be accessible from the JobManager, use file:// only for
local setups.
+- `state.backend.fs.checkpointdir`: Directory for storing checkpoints in a Flink supported
filesystem. Note: State backend must be accessible from the JobManager, use `file://` only
for local setups.
+
+- `recovery.zookeeper.storageDir`: Required for HA. Directory for storing JobManager metadata;
this is persisted in the state backend and only a pointer to this state is stored in ZooKeeper.
Exactly like the checkpoint directory it must be accessible from the JobManager and a local
filesystem should only be used for local deployments.
 
 - `blob.storage.directory`: Directory for storing blobs (such as user jar's) on the TaskManagers.
 
@@ -261,6 +263,8 @@ For example when running Flink on YARN on an environment with a restrictive
fire
 
 - `recovery.zookeeper.path.leader`: (Default '/leader') Defines the znode of the leader which
contains the URL to the leader and the current leader session ID
 
+- `recovery.zookeeper.storageDir`: Defines the directory in the state backend where the JobManager
metadata will be stored (ZooKeeper only keeps pointers to it). Required for HA.
+
 - `recovery.zookeeper.client.session-timeout`: (Default '60000') Defines the session timeout
for the ZooKeeper session in ms.
 
 - `recovery.zookeeper.client.connection-timeout`: (Default '15000') Defines the connection
timeout for ZooKeeper in ms.


Mime
View raw message