spark-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
Subject spark git commit: [SPARK-4652][DOCS] Add docs about spark-git-repo option
Date Thu, 04 Dec 2014 23:25:48 GMT
Repository: spark
Updated Branches:
  refs/heads/branch-1.1 e98aa5476 -> bf637e041

[SPARK-4652][DOCS] Add docs about spark-git-repo option

There might be some cases when WIPS spark version need to be run
on EC2 cluster. In order to setup this type of cluster more easily,
add --spark-git-repo option description to ec2 documentation.

Author: lewuathe <>
Author: Josh Rosen <>

Closes #3513 from Lewuathe/doc-for-development-spark-cluster and squashes the following commits:

6dae8ee [lewuathe] Wrap consistent with other descriptions
cfaf9be [lewuathe] Add docs about spark-git-repo option

(Editing / cleanup by Josh Rosen)

(cherry picked from commit ab8177da2defab1ecd8bc0cd5a21f07be5b8d2c5)
Signed-off-by: Josh Rosen <>


Branch: refs/heads/branch-1.1
Commit: bf637e0414fb6a59d4b2462cf3ece6937ae591fe
Parents: e98aa54
Author: lewuathe <>
Authored: Thu Dec 4 15:14:36 2014 -0800
Committer: Josh Rosen <>
Committed: Thu Dec 4 15:25:41 2014 -0800

 docs/ | 5 +++++
 1 file changed, 5 insertions(+)
diff --git a/docs/ b/docs/
index 156a727..1a588ad 100644
--- a/docs/
+++ b/docs/
@@ -76,6 +76,11 @@ another.
      specified version of Spark. VERSION can be a version number
      (e.g. "0.7.3") or a specific git hash. By default, a recent
      version will be used.
+-    `--spark-git-repo=<repository url>` will let you run a custom version of
+     Spark that is built from the given git repository. By default, the
+     [Apache Github mirror]( will be used.
+     When using a custom Spark version, `--spark-version` must be set to git
+     commit hash, such as 317e114, instead of a version number.
 -    If one of your launches fails due to e.g. not having the right
 permissions on your private key file, you can run `launch` with the
 `--resume` option to restart the setup process on an existing cluster.

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message