spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From dimoes <dim...@gmail.com>
Subject How should I interpret Spark's toDebugString()?
Date Thu, 02 Jun 2016 04:27:39 GMT
This may be a dumb question, but can someone explain how I should interpret
this DAG?

Please ignore the types of RDDs. Specifically, what do 2 parallel lines
(e.g. B) mean? What does a single parallel line with no previous single
parallel line (e.g.: A) signify?

(N) MappedRDD[3] 
 |  ShuffledRDD[2] 
 +-(N) MappedRDD[1] 
    |  ParallelCollectionRDD[0]       
    |  ParallelCollectionRDD[0]   
 |  ShuffledRDD[2]                      (A)
 +-(N) MappedRDD[1] 
 |  |  ParallelCollectionRDD[0]      (B)
 |  |  ParallelCollectionRDD[0]
 |  ShuffledRDD[2] 



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-should-I-interpret-Spark-s-toDebugString-tp27073.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message