spark-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From sro...@apache.org
Subject spark git commit: Provide same info as in spark-submit --help
Date Thu, 28 Jan 2016 10:50:57 GMT
Repository: spark
Updated Branches:
  refs/heads/master 4a0912321 -> c2204436a


Provide same info as in spark-submit --help

this is stated for --packages and --repositories. Without stating it for --jars, people expect
a standard java classpath to work, with expansion and using a different delimiter than a comma.
Currently this is only state in the --help for spark-submit "Comma-separated list of local
jars to include on the driver and executor classpaths."

Author: James Lohse <jimlohse@users.noreply.github.com>

Closes #10890 from jimlohse/patch-1.


Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c2204436
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/c2204436
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/c2204436

Branch: refs/heads/master
Commit: c2204436a15838f2dce44e3cfb0fe58236ef6196
Parents: 4a09123
Author: James Lohse <jimlohse@users.noreply.github.com>
Authored: Thu Jan 28 10:50:50 2016 +0000
Committer: Sean Owen <sowen@cloudera.com>
Committed: Thu Jan 28 10:50:50 2016 +0000

----------------------------------------------------------------------
 docs/submitting-applications.md | 5 +++--
 1 file changed, 3 insertions(+), 2 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/spark/blob/c2204436/docs/submitting-applications.md
----------------------------------------------------------------------
diff --git a/docs/submitting-applications.md b/docs/submitting-applications.md
index acbb0f2..413532f 100644
--- a/docs/submitting-applications.md
+++ b/docs/submitting-applications.md
@@ -177,8 +177,9 @@ debugging information by running `spark-submit` with the `--verbose` option.
 
 # Advanced Dependency Management
 When using `spark-submit`, the application jar along with any jars included with the `--jars`
option
-will be automatically transferred to the cluster. Spark uses the following URL scheme to
allow
-different strategies for disseminating jars:
+will be automatically transferred to the cluster. URLs supplied after `--jars` must be separated
by commas. That list is included on the driver and executor classpaths. Directory expansion
does not work with `--jars`.
+
+Spark uses the following URL scheme to allow different strategies for disseminating jars:
 
 - **file:** - Absolute paths and `file:/` URIs are served by the driver's HTTP file server,
and
   every executor pulls the file from the driver HTTP server.


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org


Mime
View raw message