spark-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From yli...@apache.org
Subject spark git commit: [MINOR][DOC] Add missing call of `update()` in examples of PeriodicGraphCheckpointer & PeriodicRDDCheckpointer
Date Thu, 14 Sep 2017 06:05:11 GMT
Repository: spark
Updated Branches:
  refs/heads/master 8d8641f12 -> 66cb72d7b


[MINOR][DOC] Add missing call of `update()` in examples of PeriodicGraphCheckpointer &
PeriodicRDDCheckpointer

## What changes were proposed in this pull request?
forgot to call `update()` with `graph1` & `rdd1` in examples for `PeriodicGraphCheckpointer`
& `PeriodicRDDCheckpoin`
## How was this patch tested?
existing tests

Author: Zheng RuiFeng <ruifengz@foxmail.com>

Closes #19198 from zhengruifeng/fix_doc_checkpointer.


Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/66cb72d7
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/66cb72d7
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/66cb72d7

Branch: refs/heads/master
Commit: 66cb72d7b9178774ba253e244bb2eddb1345b21f
Parents: 8d8641f
Author: Zheng RuiFeng <ruifengz@foxmail.com>
Authored: Thu Sep 14 14:04:43 2017 +0800
Committer: Yanbo Liang <ybliang8@gmail.com>
Committed: Thu Sep 14 14:04:43 2017 +0800

----------------------------------------------------------------------
 .../scala/org/apache/spark/rdd/util/PeriodicRDDCheckpointer.scala   | 1 +
 .../org/apache/spark/graphx/util/PeriodicGraphCheckpointer.scala    | 1 +
 2 files changed, 2 insertions(+)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/spark/blob/66cb72d7/core/src/main/scala/org/apache/spark/rdd/util/PeriodicRDDCheckpointer.scala
----------------------------------------------------------------------
diff --git a/core/src/main/scala/org/apache/spark/rdd/util/PeriodicRDDCheckpointer.scala b/core/src/main/scala/org/apache/spark/rdd/util/PeriodicRDDCheckpointer.scala
index ab72add..facbb83 100644
--- a/core/src/main/scala/org/apache/spark/rdd/util/PeriodicRDDCheckpointer.scala
+++ b/core/src/main/scala/org/apache/spark/rdd/util/PeriodicRDDCheckpointer.scala
@@ -50,6 +50,7 @@ import org.apache.spark.util.PeriodicCheckpointer
  * {{{
  *  val (rdd1, rdd2, rdd3, ...) = ...
  *  val cp = new PeriodicRDDCheckpointer(2, sc)
+ *  cp.update(rdd1)
  *  rdd1.count();
  *  // persisted: rdd1
  *  cp.update(rdd2)

http://git-wip-us.apache.org/repos/asf/spark/blob/66cb72d7/graphx/src/main/scala/org/apache/spark/graphx/util/PeriodicGraphCheckpointer.scala
----------------------------------------------------------------------
diff --git a/graphx/src/main/scala/org/apache/spark/graphx/util/PeriodicGraphCheckpointer.scala
b/graphx/src/main/scala/org/apache/spark/graphx/util/PeriodicGraphCheckpointer.scala
index fda501a..539b66f 100644
--- a/graphx/src/main/scala/org/apache/spark/graphx/util/PeriodicGraphCheckpointer.scala
+++ b/graphx/src/main/scala/org/apache/spark/graphx/util/PeriodicGraphCheckpointer.scala
@@ -50,6 +50,7 @@ import org.apache.spark.util.PeriodicCheckpointer
  * {{{
  *  val (graph1, graph2, graph3, ...) = ...
  *  val cp = new PeriodicGraphCheckpointer(2, sc)
+ *  cp.updateGraph(graph1)
  *  graph1.vertices.count(); graph1.edges.count()
  *  // persisted: graph1
  *  cp.updateGraph(graph2)


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org


Mime
View raw message