Mailing-List: contact user-help@mesos.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@mesos.apache.org
MIME-Version: 1.0
In-Reply-To: 
 <CACTd3c9vjAMXk=bFOtj5LJZFRH5u7ix-ghppFqKnVg9mkKctjg@mail.gmail.com>
References: 
 <CACTd3c9vjAMXk=bFOtj5LJZFRH5u7ix-ghppFqKnVg9mkKctjg@mail.gmail.com>
Date: Thu, 22 Oct 2015 12:07:06 -0700
Message-ID: 
 <CAE+DoR3g31UbW2=Rb+YhPCgAG--F2hakrH-hVtcW8PK3errbvA@mail.gmail.com>
Subject: Re: spark on mesos with docker issue
From: Elizabeth Lingg <elizabeth@mesosphere.io>
To: user <user@mesos.apache.org>
Content-Type: multipart/alternative; boundary=001a1141e25673bc8b0522b6332d

--001a1141e25673bc8b0522b6332d
Content-Type: text/plain; charset=UTF-8

Are you using Bridge or Host Networking?

-Elizabeth


On Thu, Oct 22, 2015 at 12:02 PM, Stavros Kontopoulos <
st.kontopoulos@gmail.com> wrote:

> Hi,
>
> Im using spark on mesos on docker. I have linked my slaves to the master
> and a
> spark repl works fine inside the master container.
>
> If i try to crate the same spark repl form the host i get stuck at the
> point when the framework tries to register to the mesos master (here the
> framework is the spark repl itself).
> I can ping the container from my host and vice versa. So networking its
> not the problem.
> What i noticed form the logs is that mesos does not resolve the correct ip:
>
> Framework failover timeout, removing framework
> b3605c33-f573-4d40-806f-b9b0abee2e32-0012 (Spark shell) at
> scheduler-b6dbe4f8-4760-4cbe-bb5e-a991e35aba1b@127.0.1.1:40186
>
> docker0 interface is on 172.17.x.x and my host is one such ip so i didnt
> expect there to see
> 127.0.1.1. I have tried several things like spark.driver.host,
> SPARK_LOCAL_IP to be set correctly but with no result...
> I suspect this is a mesos problem on docker...
>
> Thnx,
>
> S.
>

--001a1141e25673bc8b0522b6332d
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div>Are you using Bridge or Host Networking?<br></div><di=
v><br></div><div>-Elizabeth</div><div><br></div><div><br></div></div><div c=
lass=3D"gmail_extra"><br><div class=3D"gmail_quote">On Thu, Oct 22, 2015 at=
 12:02 PM, Stavros Kontopoulos <span dir=3D"ltr">&lt;<a href=3D"mailto:st.k=
ontopoulos@gmail.com" target=3D"_blank">st.kontopoulos@gmail.com</a>&gt;</s=
pan> wrote:<br><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex=
;border-left:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr"><div><div><d=
iv><div>Hi,<br><br></div>Im using spark on mesos on docker. I have linked m=
y slaves to the master and a<br></div>spark repl works fine inside the mast=
er container.<br><br></div>If i try to crate the same spark repl form the h=
ost i get stuck at the point when the framework tries to register to the me=
sos master (here the framework is the spark repl itself).<br></div><div>I c=
an ping the container from my host and vice versa. So networking its not th=
e problem.<br></div><div>What i noticed form the logs is that mesos does no=
t resolve the correct ip:<br><br>Framework failover timeout, removing frame=
work b3605c33-f573-4d40-806f-b9b0abee2e32-0012 (Spark shell) at <a href=3D"=
http://scheduler-b6dbe4f8-4760-4cbe-bb5e-a991e35aba1b@127.0.1.1:40186" targ=
et=3D"_blank">scheduler-b6dbe4f8-4760-4cbe-bb5e-a991e35aba1b@127.0.1.1:4018=
6</a><br><br></div><div>docker0 interface is on 172.17.x.x and my host is o=
ne such ip so i didnt expect there to see <br></div><div>127.0.1.1. I have =
tried several things like spark.driver.host, SPARK_LOCAL_IP to be set corre=
ctly but with no result...<br></div><div>I suspect this is a mesos problem =
on docker...<br></div><div><br></div><div>Thnx,<br><br></div>S.<br></div>
</blockquote></div><br></div>

--001a1141e25673bc8b0522b6332d--