spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Joseph Wu <jos...@mesosphere.io>
Subject Re: Two questions about running spark on mesos
Date Mon, 14 Nov 2016 19:40:21 GMT
1) You should read through this page:
https://spark.apache.org/docs/latest/running-on-mesos.html
I (Mesos person) can't answer any questions that aren't already answered on
that page :)

2) Your normal spark commands (whatever they are) should still work
regardless of the backend.

On Mon, Nov 14, 2016 at 2:58 AM, Yu Wei <yu2003w@hotmail.com> wrote:

> Hi Guys,
>
>
> Two questions about running spark on mesos.
>
> 1, Does spark configuration of conf/slaves still work when running spark
> on mesos?
>
>     According to my observations, it seemed that conf/slaves still took
> effect when running spark-shell.
>
>     However, it doesn't take effect when deploying in cluster mode.
>
>     Is this expected behavior?
>
>    Or did I miss anything?
>
>
> 2, Could I kill submitted jobs when running spark on mesos in cluster mode?
>
>     I launched spark on mesos in cluster mode. Then submitted a long
> running job succeeded.
>
>     Then I want to kill the job.
>
>     How could I do that? Is there any similar commands as launching spark
> on yarn?
>
>
>
>
> Thanks,
>
> Jared, (??)
> Software developer
> Interested in open source software, big data, Linux
>

Mime
View raw message