spark-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From r...@apache.org
Subject git commit: SPARK-1976: fix the misleading part in streaming docs
Date Sat, 31 May 2014 05:07:00 GMT
Repository: spark
Updated Branches:
  refs/heads/branch-1.0 4b12737af -> 3faa084ff


SPARK-1976: fix the misleading part in  streaming docs

Spark streaming requires at least two working threads, but the document gives the example
like

import org.apache.spark.api.java.function._
import org.apache.spark.streaming._
import org.apache.spark.streaming.api._
// Create a StreamingContext with a local master
val ssc = new StreamingContext("local", "NetworkWordCount", Seconds(1))
http://spark.apache.org/docs/latest/streaming-programming-guide.html

Author: CodingCat <zhunansjtu@gmail.com>

Closes #924 from CodingCat/master and squashes the following commits:

bb89f20 [CodingCat] update streaming docs

(cherry picked from commit 41bfdda3cc53b44b0fb2105533b7c0e1a69eb3bb)
Signed-off-by: Reynold Xin <rxin@apache.org>


Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/3faa084f
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/3faa084f
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/3faa084f

Branch: refs/heads/branch-1.0
Commit: 3faa084fffdae559839af13a6c0e4c39ac81338f
Parents: 4b12737
Author: CodingCat <zhunansjtu@gmail.com>
Authored: Fri May 30 22:06:08 2014 -0700
Committer: Reynold Xin <rxin@apache.org>
Committed: Fri May 30 22:06:52 2014 -0700

----------------------------------------------------------------------
 docs/streaming-programming-guide.md | 3 ++-
 1 file changed, 2 insertions(+), 1 deletion(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/spark/blob/3faa084f/docs/streaming-programming-guide.md
----------------------------------------------------------------------
diff --git a/docs/streaming-programming-guide.md b/docs/streaming-programming-guide.md
index b95f818..bbee67f 100644
--- a/docs/streaming-programming-guide.md
+++ b/docs/streaming-programming-guide.md
@@ -80,7 +80,8 @@ import org.apache.spark.api.java.function._
 import org.apache.spark.streaming._
 import org.apache.spark.streaming.api._
 // Create a StreamingContext with a local master
-val ssc = new StreamingContext("local", "NetworkWordCount", Seconds(1))
+// Spark Streaming needs at least two working thread
+val ssc = new StreamingContext("local[2]", "NetworkWordCount", Seconds(1))
 {% endhighlight %}
 
 Using this context, we then create a new DStream


Mime
View raw message