Mailing-List: contact dev-help@spark.apache.org; run by ezmlm
Precedence: bulk
MIME-Version: 1.0
In-Reply-To: <SIXPR03MB0607AD76151BE4E77C3E58B3B5BC0@SIXPR03MB0607.apcprd03.prod.outlook.com>
References: <SIXPR03MB0607AD76151BE4E77C3E58B3B5BC0@SIXPR03MB0607.apcprd03.prod.outlook.com>
From: Joseph Wu <joseph@mesosphere.io>
Date: Mon, 14 Nov 2016 11:40:21 -0800
Message-ID: <CAGxaGb0SxD3AyUjz7d7q8LEjkFOTNqD=nEkYAY9O6wN4OCyyjw@mail.gmail.com>
Subject: Re: Two questions about running spark on mesos
To: dev <dev@mesos.apache.org>
Cc: dev <dev@spark.apache.org>
Content-Type: multipart/alternative; boundary=001a114717b6adcb3105414802a7
archived-at: Mon, 14 Nov 2016 19:44:18 -0000

--001a114717b6adcb3105414802a7
Content-Type: text/plain; charset=UTF-8

1) You should read through this page:
https://spark.apache.org/docs/latest/running-on-mesos.html
I (Mesos person) can't answer any questions that aren't already answered on
that page :)

2) Your normal spark commands (whatever they are) should still work
regardless of the backend.

On Mon, Nov 14, 2016 at 2:58 AM, Yu Wei <yu2003w@hotmail.com> wrote:

> Hi Guys,
>
>
> Two questions about running spark on mesos.
>
> 1, Does spark configuration of conf/slaves still work when running spark
> on mesos?
>
>     According to my observations, it seemed that conf/slaves still took
> effect when running spark-shell.
>
>     However, it doesn't take effect when deploying in cluster mode.
>
>     Is this expected behavior?
>
>    Or did I miss anything?
>
>
> 2, Could I kill submitted jobs when running spark on mesos in cluster mode?
>
>     I launched spark on mesos in cluster mode. Then submitted a long
> running job succeeded.
>
>     Then I want to kill the job.
>
>     How could I do that? Is there any similar commands as launching spark
> on yarn?
>
>
>
>
> Thanks,
>
> Jared, (??)
> Software developer
> Interested in open source software, big data, Linux
>

--001a114717b6adcb3105414802a7
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div>1) You should read through this page: <a href=3D"http=
s://spark.apache.org/docs/latest/running-on-mesos.html">https://spark.apach=
e.org/docs/latest/running-on-mesos.html</a><br></div><div>I (Mesos person) =
can&#39;t answer any questions that aren&#39;t already answered on that pag=
e :)<br></div><div><br></div><div>2) Your normal spark commands (whatever t=
hey are) should still work regardless of the backend.<br></div></div><div c=
lass=3D"gmail_extra"><br><div class=3D"gmail_quote">On Mon, Nov 14, 2016 at=
 2:58 AM, Yu Wei <span dir=3D"ltr">&lt;<a href=3D"mailto:yu2003w@hotmail.co=
m" target=3D"_blank">yu2003w@hotmail.com</a>&gt;</span> wrote:<br><blockquo=
te class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc so=
lid;padding-left:1ex">Hi Guys,<br>
<br>
<br>
Two questions about running spark on mesos.<br>
<br>
1, Does spark configuration of conf/slaves still work when running spark on=
 mesos?<br>
<br>
=C2=A0 =C2=A0 According to my observations, it seemed that conf/slaves stil=
l took effect when running spark-shell.<br>
<br>
=C2=A0 =C2=A0 However, it doesn&#39;t take effect when deploying in cluster=
 mode.<br>
<br>
=C2=A0 =C2=A0 Is this expected behavior?<br>
<br>
=C2=A0 =C2=A0Or did I miss anything?<br>
<br>
<br>
2, Could I kill submitted jobs when running spark on mesos in cluster mode?=
<br>
<br>
=C2=A0 =C2=A0 I launched spark on mesos in cluster mode. Then submitted a l=
ong running job succeeded.<br>
<br>
=C2=A0 =C2=A0 Then I want to kill the job.<br>
<br>
=C2=A0 =C2=A0 How could I do that? Is there any similar commands as launchi=
ng spark on yarn?<br>
<br>
<br>
<br>
<br>
Thanks,<br>
<br>
Jared, (??)<br>
Software developer<br>
Interested in open source software, big data, Linux<br>
</blockquote></div><br></div>

--001a114717b6adcb3105414802a7--