spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rohith Parameshwara <>
Subject Unable to run applications on spark in standalone cluster mode
Date Mon, 19 Oct 2015 12:05:51 GMT
Hi all,
                I am doing some experiments on spark standalone cluster setup and I am facing
the following issue:
I have a 4 node cluster setup. As per
I tried to start the cluster with the scripts but, the slaves did not start and gave permission
denied error....My conf/slaves had a list of IP addresses of the slaves... But Then I was
able to start the worker nodes by going to the respective slave machine and running the
script with the master IP as parameter.... The webui showed the all the 3 worker nodes running
as :

The application when submitted to the cluster will show in all the work nodes in the webui....
But in the command line where is spark-submit command was run, it gives this error periodically
and continuously....
ERROR NettyTransport: failed to bind to /, shutting down Netty transport
15/10/19 11:59:38 WARN Utils: Service 'sparkDriver' could not bind on port 7077. Attempting
port 7078.
15/10/19 11:59:38 WARN AppClient$ClientActor: Could not connect to akka.tcp://sparkMaster@localhost:7077:
akka.remote.InvalidAssociation: Invalid address: akka.tcp://sparkMaster@localhost:7077....

My conf/ has:

And I have also put this in all the slave nodes too....

The applications are running fine in -master local mode but in -master spark://masterip:7077,
it is not working....
Any type of help would be appreciated..... Thanks in advance

View raw message