spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nicholas Chammas <>
Subject SPARK_MASTER_IP actually expects a DNS name, not IP address
Date Thu, 15 Oct 2015 02:10:41 GMT
I’m setting the Spark master address via the SPARK_MASTER_IP environment
variable in, like spark-ec2 does

The funny thing is that Spark seems to accept this only if the value of
SPARK_MASTER_IP is a DNS name and not an IP address.

When I provide an IP address, I get errors in the log when starting the

15/10/15 01:47:31 ERROR NettyTransport: failed to bind to
/54.210.XX.XX:7077, shutting down Netty transport

(XX is my redaction of the full IP address.)

Am I misunderstanding something about how to use this environment variable?

The template indicates that either an IP address or a hostname
should work
but my testing shows that only hostnames work.


View raw message