spark-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From pwend...@apache.org
Subject [49/50] git commit: Update documentation for externalSorting
Date Sat, 11 Jan 2014 00:26:06 GMT
Update documentation for externalSorting


Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/2e393cd5
Tree: http://git-wip-us.apache.org/repos/asf/incubator-spark/tree/2e393cd5
Diff: http://git-wip-us.apache.org/repos/asf/incubator-spark/diff/2e393cd5

Branch: refs/heads/master
Commit: 2e393cd5fdfbf3a85fced370b5c42315e86dad49
Parents: e4c51d2
Author: Andrew Or <andrewor14@gmail.com>
Authored: Fri Jan 10 15:45:38 2014 -0800
Committer: Andrew Or <andrewor14@gmail.com>
Committed: Fri Jan 10 15:45:38 2014 -0800

----------------------------------------------------------------------
 docs/configuration.md | 5 ++---
 1 file changed, 2 insertions(+), 3 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/incubator-spark/blob/2e393cd5/docs/configuration.md
----------------------------------------------------------------------
diff --git a/docs/configuration.md b/docs/configuration.md
index c115849..40a57c4 100644
--- a/docs/configuration.md
+++ b/docs/configuration.md
@@ -391,9 +391,8 @@ Apart from these, the following properties are also available, and may
be useful
   <td>spark.shuffle.externalSorting</td>
   <td>true</td>
   <td>
-    If set to "true", spills in-memory maps used for shuffles to disk when a memory threshold
is reached. This
-    threshold is specified by <code>spark.shuffle.memoryFraction</code>. Enable
this especially for memory-intensive
-    applications.
+    If set to "true", limits the amount of memory used during reduces by spilling data out
to disk. This spilling
+    threshold is specified by <code>spark.shuffle.memoryFraction</code>.
   </td>
 </tr>
 <tr>


Mime
View raw message