spark-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From joshro...@apache.org
Subject spark git commit: [SPARK-4652][DOCS] Add docs about spark-git-repo option
Date Thu, 04 Dec 2014 23:25:48 GMT
Repository: spark
Updated Branches:
  refs/heads/branch-1.1 e98aa5476 -> bf637e041


[SPARK-4652][DOCS] Add docs about spark-git-repo option

There might be some cases when WIPS spark version need to be run
on EC2 cluster. In order to setup this type of cluster more easily,
add --spark-git-repo option description to ec2 documentation.

Author: lewuathe <lewuathe@me.com>
Author: Josh Rosen <joshrosen@databricks.com>

Closes #3513 from Lewuathe/doc-for-development-spark-cluster and squashes the following commits:

6dae8ee [lewuathe] Wrap consistent with other descriptions
cfaf9be [lewuathe] Add docs about spark-git-repo option

(Editing / cleanup by Josh Rosen)

(cherry picked from commit ab8177da2defab1ecd8bc0cd5a21f07be5b8d2c5)
Signed-off-by: Josh Rosen <joshrosen@databricks.com>


Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/bf637e04
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/bf637e04
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/bf637e04

Branch: refs/heads/branch-1.1
Commit: bf637e0414fb6a59d4b2462cf3ece6937ae591fe
Parents: e98aa54
Author: lewuathe <lewuathe@me.com>
Authored: Thu Dec 4 15:14:36 2014 -0800
Committer: Josh Rosen <joshrosen@databricks.com>
Committed: Thu Dec 4 15:25:41 2014 -0800

----------------------------------------------------------------------
 docs/ec2-scripts.md | 5 +++++
 1 file changed, 5 insertions(+)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/spark/blob/bf637e04/docs/ec2-scripts.md
----------------------------------------------------------------------
diff --git a/docs/ec2-scripts.md b/docs/ec2-scripts.md
index 156a727..1a588ad 100644
--- a/docs/ec2-scripts.md
+++ b/docs/ec2-scripts.md
@@ -76,6 +76,11 @@ another.
      specified version of Spark. VERSION can be a version number
      (e.g. "0.7.3") or a specific git hash. By default, a recent
      version will be used.
+-    `--spark-git-repo=<repository url>` will let you run a custom version of
+     Spark that is built from the given git repository. By default, the
+     [Apache Github mirror](https://github.com/apache/spark) will be used.
+     When using a custom Spark version, `--spark-version` must be set to git
+     commit hash, such as 317e114, instead of a version number.
 -    If one of your launches fails due to e.g. not having the right
 permissions on your private key file, you can run `launch` with the
 `--resume` option to restart the setup process on an existing cluster.


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org


Mime
View raw message