tinkerpop-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From dkupp...@apache.org
Subject incubator-tinkerpop git commit: added a paragraph about Spark's storage levels
Date Thu, 31 Mar 2016 15:58:44 GMT
Repository: incubator-tinkerpop
Updated Branches:
  refs/heads/TINKERPOP-1177 [created] 2ce087f65


added a paragraph about Spark's storage levels


Project: http://git-wip-us.apache.org/repos/asf/incubator-tinkerpop/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-tinkerpop/commit/2ce087f6
Tree: http://git-wip-us.apache.org/repos/asf/incubator-tinkerpop/tree/2ce087f6
Diff: http://git-wip-us.apache.org/repos/asf/incubator-tinkerpop/diff/2ce087f6

Branch: refs/heads/TINKERPOP-1177
Commit: 2ce087f65d9d54cd5f9855e9b75acb152e8259cc
Parents: 92f6157
Author: Daniel Kuppitz <daniel_kuppitz@hotmail.com>
Authored: Thu Mar 31 17:57:58 2016 +0200
Committer: Daniel Kuppitz <daniel_kuppitz@hotmail.com>
Committed: Thu Mar 31 17:57:58 2016 +0200

----------------------------------------------------------------------
 docs/src/reference/implementations-hadoop.asciidoc | 8 ++++++++
 1 file changed, 8 insertions(+)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/incubator-tinkerpop/blob/2ce087f6/docs/src/reference/implementations-hadoop.asciidoc
----------------------------------------------------------------------
diff --git a/docs/src/reference/implementations-hadoop.asciidoc b/docs/src/reference/implementations-hadoop.asciidoc
index 54ed776..7a15faa 100644
--- a/docs/src/reference/implementations-hadoop.asciidoc
+++ b/docs/src/reference/implementations-hadoop.asciidoc
@@ -333,6 +333,14 @@ If the `InputRDD` does not have a registered partitioner, `SparkGraphComputer`
w
 a `org.apache.spark.HashPartitioner` with the number of partitions being either the number
of existing partitions in the input (e.g. input splits)
 or the user specified number of `GraphComputer.workers()`.
 
+Storage Levels
+++++++++++++++
+
+The `SparkGraphComputer` uses `MEMORY_ONLY` to cache the input graph and the output graph
by default. Users should be aware of the impact of
+different storage levels, since the default settings can quickly lead to memory issues on
larger graphs. An overview about Spark's persistence
+settings is provided in link:http://spark.apache.org/docs/latest/programming-guide.html#rdd-persistence[Spark's
programming guide].
+
+
 Using a Persisted Context
 +++++++++++++++++++++++++
 


Mime
View raw message