flink-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From mbala...@apache.org
Subject [1/3] flink git commit: [FLINK-2221] [docs] Docs for not using local filesystem on the cluster as state backup
Date Tue, 16 Jun 2015 11:08:12 GMT
Repository: flink
Updated Branches:
  refs/heads/release-0.9 d147c71a4 -> 2359b49f5


[FLINK-2221] [docs] Docs for not using local filesystem on the cluster as state backup

This is just a clear documentation of the problem for the 0.9 release.

Closes #839


Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/ccaa0b07
Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/ccaa0b07
Diff: http://git-wip-us.apache.org/repos/asf/flink/diff/ccaa0b07

Branch: refs/heads/release-0.9
Commit: ccaa0b07de4d633760e5ffff2d79e10ec6b2e003
Parents: d147c71
Author: mbalassi <mbalassi@apache.org>
Authored: Mon Jun 15 18:53:08 2015 +0200
Committer: mbalassi <mbalassi@apache.org>
Committed: Tue Jun 16 13:07:19 2015 +0200

----------------------------------------------------------------------
 docs/apis/streaming_guide.md                  | 4 ++--
 flink-dist/src/main/resources/flink-conf.yaml | 2 ++
 2 files changed, 4 insertions(+), 2 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/flink/blob/ccaa0b07/docs/apis/streaming_guide.md
----------------------------------------------------------------------
diff --git a/docs/apis/streaming_guide.md b/docs/apis/streaming_guide.md
index 0a7a486..9c32903 100644
--- a/docs/apis/streaming_guide.md
+++ b/docs/apis/streaming_guide.md
@@ -1194,7 +1194,7 @@ For example when implementing a rolling count over the stream Flink
gives you th
 
 Checkpointing can be enabled from the `StreamExecutionEnvironment` using the `enableCheckpointing(…)`
where additional parameters can be passed to modify the default 5 second checkpoint interval.
 
-By default state checkpoints will be stored in-memory at the JobManager. Flink also supports
storing the checkpoints on any flink-supported file system (such as HDFS or Tachyon) which
can be set in the flink-conf.yaml. 
+By default state checkpoints will be stored in-memory at the JobManager. Flink also supports
storing the checkpoints on any flink-supported file system (such as HDFS or Tachyon) which
can be set in the flink-conf.yaml. Note that the state backend must be accessible from the
JobManager, use `file://` only for local setups.
 
 For example let us write a reduce function that besides summing the data it also counts have
many elements it has seen.
 
@@ -1210,7 +1210,7 @@ public class CounterSum implements ReduceFunction<Long>, CheckpointedAsynchronou
         return value1 + value2;
     }
 
-    // regurarly persists state during normal operation 
+    // regularly persists state during normal operation
     @Override
     public Serializable snapshotState(long checkpointId, long checkpointTimestamp) throws
Exception {
         return new Long(counter);

http://git-wip-us.apache.org/repos/asf/flink/blob/ccaa0b07/flink-dist/src/main/resources/flink-conf.yaml
----------------------------------------------------------------------
diff --git a/flink-dist/src/main/resources/flink-conf.yaml b/flink-dist/src/main/resources/flink-conf.yaml
index f0c0d56..a258815 100644
--- a/flink-dist/src/main/resources/flink-conf.yaml
+++ b/flink-dist/src/main/resources/flink-conf.yaml
@@ -59,6 +59,8 @@ webclient.port: 8080
 state.backend: jobmanager
 
 # Directory for storing checkpoints in a flink supported filesystem
+# Note: State backend must be accessible from the JobManager, use file://
+# only for local setups. 
 #
 # state.backend.fs.checkpointdir: hdfs://checkpoints
 


Mime
View raw message