spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From chutium <teng....@gmail.com>
Subject Re: spark-shell is broken! (bad option: '--master')
Date Fri, 08 Aug 2014 21:14:30 GMT
maybe this commit is the reason?
https://github.com/apache/spark/commit/a6cd31108f0d73ce6823daafe8447677e03cfd13

i fand some discuss in its PR: https://github.com/apache/spark/pull/1801

important is what vanzin said:
https://github.com/apache/spark/pull/1801#issuecomment-51545117

i tried to use this:
bin/spark-class org.apache.spark.deploy.SparkSubmit --class
org.apache.spark.repl.Main spark-shell --master local[2]

also
bad option: '--master'


but this works

bin/spark-class org.apache.spark.deploy.SparkSubmit --master local[2]
--class org.apache.spark.repl.Main spark-shell





and some more try out:

~/tachyon/spark$ bin/spark-class org.apache.spark.deploy.SparkSubmit
--master local[2] --class org.apache.spark.repl.Main spark-shell --foo bar
Spark assembly has been built with Hive, including Datanucleus jars on
classpath
bad option: '--foo'

~/tachyon/spark$ bin/spark-class org.apache.spark.deploy.SparkSubmit
--master local[2] --foo bar --class org.apache.spark.repl.Main spark-shell
Spark assembly has been built with Hive, including Datanucleus jars on
classpath
Error: Unrecognized option '--foo'.
Run with --help for usage help or --verbose for debug output



god... no test suite for those shell scripts?

such a issue is really awful~




--
View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/spark-shell-is-broken-bad-option-master-tp7778p7779.html
Sent from the Apache Spark Developers List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org


Mime
View raw message