spark-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From andrewo...@apache.org
Subject spark git commit: [SPARK-11670] Fix incorrect kryo buffer default value in docs
Date Thu, 12 Nov 2015 23:47:33 GMT
Repository: spark
Updated Branches:
  refs/heads/master 74c30049a -> cf38fc755


[SPARK-11670] Fix incorrect kryo buffer default value in docs

<img width="931" alt="screen shot 2015-11-11 at 1 53 21 pm" src="https://cloud.githubusercontent.com/assets/2133137/11108261/35d183d4-889a-11e5-9572-85e9d6cebd26.png">

Author: Andrew Or <andrew@databricks.com>

Closes #9638 from andrewor14/fix-kryo-docs.


Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/cf38fc75
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/cf38fc75
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/cf38fc75

Branch: refs/heads/master
Commit: cf38fc7551f4743958c2fdc7931affd672755e68
Parents: 74c3004
Author: Andrew Or <andrew@databricks.com>
Authored: Thu Nov 12 15:47:29 2015 -0800
Committer: Andrew Or <andrew@databricks.com>
Committed: Thu Nov 12 15:47:29 2015 -0800

----------------------------------------------------------------------
 docs/tuning.md | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/spark/blob/cf38fc75/docs/tuning.md
----------------------------------------------------------------------
diff --git a/docs/tuning.md b/docs/tuning.md
index 6936912..879340a 100644
--- a/docs/tuning.md
+++ b/docs/tuning.md
@@ -61,8 +61,8 @@ The [Kryo documentation](https://github.com/EsotericSoftware/kryo) describes
mor
 registration options, such as adding custom serialization code.
 
 If your objects are large, you may also need to increase the `spark.kryoserializer.buffer`
-config property. The default is 2, but this value needs to be large enough to hold the *largest*
-object you will serialize.
+[config](configuration.html#compression-and-serialization). This value needs to be large
enough
+to hold the *largest* object you will serialize.
 
 Finally, if you don't register your custom classes, Kryo will still work, but it will have
to store
 the full class name with each object, which is wasteful.


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org


Mime
View raw message