spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nicholas Chammas (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-5298) Spark not starting on EC2 using spark-ec2
Date Sat, 17 Jan 2015 22:06:34 GMT

    [ https://issues.apache.org/jira/browse/SPARK-5298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14281575#comment-14281575
] 

Nicholas Chammas commented on SPARK-5298:
-----------------------------------------

Yes, {{mesos/spark-ec2}} is the official repo. You'll see that {{spark-ec2}} from the main
Spark repository points to it.

> Spark not starting on EC2 using spark-ec2
> -----------------------------------------
>
>                 Key: SPARK-5298
>                 URL: https://issues.apache.org/jira/browse/SPARK-5298
>             Project: Spark
>          Issue Type: Bug
>    Affects Versions: 1.2.0
>         Environment: I use Spark 1.2.0 + this PR https://github.com/mesos/spark-ec2/pull/76
from my fork https://github.com/grzegorz-dubicki/spark and v4 Spark EC2 script with the same
fix from https://github.com/grzegorz-dubicki/spark-ec2
>            Reporter: Grzegorz Dubicki
>
> Spark doesn't start after creating it with:
> {noformat}
> ./spark-ec2 -k * -i * -s 1 --region=eu-west-1 --instance-type=t2.micro --spark-version=1.2.0
launch test2
> {noformat}
> (Output: https://gist.github.com/grzegorz-dubicki/f15caf9ff6c96ec69fee)
> ..or after stopping the instances on EC2 via AWS Console and starting the cluster with:
> {noformat}
> ./spark-ec2 -k * -i * --region=eu-west-1 start test2
> {noformat}
> (Output: https://gist.github.com/grzegorz-dubicki/8b87192b3aa4e0ed028c)
> Please note these errors in launch output:
> {noformat}
> ~/spark-ec2
> Initializing spark
> ~ ~/spark-ec2
> ERROR: Unknown Spark version
> Initializing shark
> ~ ~/spark-ec2 ~/spark-ec2
> ERROR: Unknown Shark version
> {noformat}
> ..and then these in start output:
> {noformat}
> ./spark-standalone/setup.sh: line 26: /root/spark/sbin/stop-all.sh: Nie ma takiego pliku
ani katalogu
> ./spark-standalone/setup.sh: line 31: /root/spark/sbin/start-master.sh: Nie ma takiego
pliku ani katalogu
> ./spark-standalone/setup.sh: line 37: /root/spark/sbin/start-slaves.sh: Nie ma takiego
pliku ani katalogu
> {noformat}
> (the error message is "No such file or directory", in Polish)
> It seems to be related with http://mail-archives.us.apache.org/mod_mbox/spark-user/201412.mbox/%3cCAJ5A9B_U=mDCXYftDkbk+sLJzBCdPcb0qQS83u0grOzfgkcEow@mail.gmail.com%3e
- I also have almost empty Spark and Shark dirs on the master of test2 cluster:
> {noformat}
> root@ip-172-31-7-179 ~]$ ls spark
> conf  work
> root@ip-172-31-7-179 ~]$ ls shark/
> conf
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message