Mailing-List: contact user-help@mesos.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@mesos.apache.org
Received-SPF: pass (nike.apache.org: domain of kellrott@soe.ucsc.edu
 designates 209.85.213.50 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <6FF9438C-6891-43D5-AE6E-7EC393592F85@gmail.com>
References: 
 <CAK5eLPSVJ-6M00_YmTm_esHnT9dRmr72C6iBzbDZOvXWyDNN7A@mail.gmail.com>
	<6FF9438C-6891-43D5-AE6E-7EC393592F85@gmail.com>
Date: Wed, 3 Dec 2014 18:31:36 -0800
Message-ID: 
 <CAKXMip1-Qii6afCF8aORN_QrVmwWPMYthoXs5-Dtd=6wHppdcQ@mail.gmail.com>
Subject: Re: dockerized spark executor on mesos?
From: Kyle Ellrott <kellrott@soe.ucsc.edu>
To: Matei Zaharia <matei.zaharia@gmail.com>
Cc: Dick Davies <dick@hellooperator.net>, user <user@spark.apache.org>,
	"user@mesos.apache.org" <user@mesos.apache.org>
Content-Type: multipart/alternative; boundary=089e01634d6c5e4de305095ac263

--089e01634d6c5e4de305095ac263
Content-Type: text/plain; charset=UTF-8

I'd like to tag a question onto this; has anybody attempted to deploy spark
under Kubernetes
https://github.com/googlecloudplatform/kubernetes or Kubernetes mesos (
https://github.com/mesosphere/kubernetes-mesos ) .
On Wednesday, December 3, 2014, Matei Zaharia <matei.zaharia@gmail.com>
wrote:

> I'd suggest asking about this on the Mesos list (CCed). As far as I know,
> there was actually some ongoing work for this.
>
> Matei
>
> > On Dec 3, 2014, at 9:46 AM, Dick Davies <dick@hellooperator.net
> <javascript:;>> wrote:
> >
> > Just wondered if anyone had managed to start spark
> > jobs on mesos wrapped in a docker container?
> >
> > At present (i.e. very early testing) I'm able to submit executors
> > to mesos via spark-submit easily enough, but they fall over
> > as we don't have a JVM on our slaves out of the box.
> >
> > I can push one out via our CM system if push comes to shove,
> > but it'd be nice to have that as part of the job (I'm thinking it might
> > be a way to get some of the dependencies deployed too).
> >
> > bear in mind I'm a total clueless newbie at this so please be gentle
> > if I'm doing this completely wrong.
> >
> > Thanks!
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: user-unsubscribe@spark.apache.org <javascript:;>
> > For additional commands, e-mail: user-help@spark.apache.org
> <javascript:;>
> >
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org <javascript:;>
> For additional commands, e-mail: user-help@spark.apache.org <javascript:;>
>
>

--089e01634d6c5e4de305095ac263
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

I&#39;d like to tag a question onto this; has anybody attempted to deploy s=
park under Kubernetes<br><a href=3D"https://github.com/googlecloudplatform/=
kubernetes">https://github.com/googlecloudplatform/kubernetes</a>=C2=A0or K=
ubernetes mesos (=C2=A0<a href=3D"https://github.com/mesosphere/kubernetes-=
mesos">https://github.com/mesosphere/kubernetes-mesos</a>=C2=A0) .<div>On W=
ednesday, December 3, 2014, Matei Zaharia &lt;<a href=3D"mailto:matei.zahar=
ia@gmail.com">matei.zaharia@gmail.com</a>&gt; wrote:<br><blockquote class=
=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padd=
ing-left:1ex">I&#39;d suggest asking about this on the Mesos list (CCed). A=
s far as I know, there was actually some ongoing work for this.<br>
<br>
Matei<br>
<br>
&gt; On Dec 3, 2014, at 9:46 AM, Dick Davies &lt;<a href=3D"javascript:;" o=
nclick=3D"_e(event, &#39;cvml&#39;, &#39;dick@hellooperator.net&#39;)">dick=
@hellooperator.net</a>&gt; wrote:<br>
&gt;<br>
&gt; Just wondered if anyone had managed to start spark<br>
&gt; jobs on mesos wrapped in a docker container?<br>
&gt;<br>
&gt; At present (i.e. very early testing) I&#39;m able to submit executors<=
br>
&gt; to mesos via spark-submit easily enough, but they fall over<br>
&gt; as we don&#39;t have a JVM on our slaves out of the box.<br>
&gt;<br>
&gt; I can push one out via our CM system if push comes to shove,<br>
&gt; but it&#39;d be nice to have that as part of the job (I&#39;m thinking=
 it might<br>
&gt; be a way to get some of the dependencies deployed too).<br>
&gt;<br>
&gt; bear in mind I&#39;m a total clueless newbie at this so please be gent=
le<br>
&gt; if I&#39;m doing this completely wrong.<br>
&gt;<br>
&gt; Thanks!<br>
&gt;<br>
&gt; ---------------------------------------------------------------------<=
br>
&gt; To unsubscribe, e-mail: <a href=3D"javascript:;" onclick=3D"_e(event, =
&#39;cvml&#39;, &#39;user-unsubscribe@spark.apache.org&#39;)">user-unsubscr=
ibe@spark.apache.org</a><br>
&gt; For additional commands, e-mail: <a href=3D"javascript:;" onclick=3D"_=
e(event, &#39;cvml&#39;, &#39;user-help@spark.apache.org&#39;)">user-help@s=
park.apache.org</a><br>
&gt;<br>
<br>
<br>
---------------------------------------------------------------------<br>
To unsubscribe, e-mail: <a href=3D"javascript:;" onclick=3D"_e(event, &#39;=
cvml&#39;, &#39;user-unsubscribe@spark.apache.org&#39;)">user-unsubscribe@s=
park.apache.org</a><br>
For additional commands, e-mail: <a href=3D"javascript:;" onclick=3D"_e(eve=
nt, &#39;cvml&#39;, &#39;user-help@spark.apache.org&#39;)">user-help@spark.=
apache.org</a><br>
<br>
</blockquote></div>

--089e01634d6c5e4de305095ac263--