Mailing-List: contact dev-help@spark.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@spark.apache.org
Received-SPF: pass (athena.apache.org: domain of tstclair@redhat.com
 designates 209.132.183.37 as permitted sender)
Date: Tue, 13 May 2014 12:27:34 -0400 (EDT)
From: Tim St Clair <tstclair@redhat.com>
To: dev@spark.apache.org
Cc: Dave Lester <dlester@twitter.com>
Message-ID: <1864015053.4704303.1399998454391.JavaMail.zimbra@redhat.com>
In-Reply-To: <95FAD9DA-C2A9-42E6-BDF3-9577B92E9B3A@gmail.com>
References: 
 <CA+-p3AGGAKA05e9MpvOgQpmj=opOgvw+zXVZVojYU8Yo9XZ4tg@mail.gmail.com>
 <CABPQxsvrhG5FX2d5VuBPZ3T5CuyBms5f+E5SFVOo2bzmB9Ay9A@mail.gmail.com>
 <CA+-p3AG7VUZB45TadPJRvqCt=X6zY4Zip-7UogsyVCswsjkQFw@mail.gmail.com>
 <CAMc-71=z5eAvdEJ+O2FgbzxNCRDzZWWg9-ZrRKHA-wUOB2dGmQ@mail.gmail.com>
 <95FAD9DA-C2A9-42E6-BDF3-9577B92E9B3A@gmail.com>
Subject: Re: Updating docs for running on Mesos
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Thread-Topic: Updating docs for running on Mesos
Thread-Index: gw7sV2GdqT4iGNTSeL5V6ofxFQ230g==

Perhaps linking to a Mesos page, which then can list the various package in=
cantations.=20

Cheers,
Tim

----- Original Message -----
> From: "Matei Zaharia" <matei.zaharia@gmail.com>
> To: dev@spark.apache.org
> Sent: Tuesday, May 13, 2014 2:59:42 AM
> Subject: Re: Updating docs for running on Mesos
>=20
> I=E2=80=99ll ask the Mesos folks about this. Unfortunately it might be to=
ugh to link
> only to a company=E2=80=99s builds; but we can perhaps include them in ad=
dition to
> instructions for building Mesos from Apache.
>=20
> Matei
>=20
> On May 12, 2014, at 11:55 PM, Gerard Maas <gerard.maas@gmail.com> wrote:
>=20
> > Andrew,
> >=20
> > Mesosphere has binary releases here:
> > http://mesosphere.io/downloads/
> >=20
> > (Anecdote: I actually burned a CPU building Mesos from source. No kiddi=
ng -
> > it was coming, as the laptop was crashing from time to time, but the me=
sos
> > build was that one drop too much)
> >=20
> > kr, Gerard.
> >=20
> >=20
> >=20
> > On Tue, May 13, 2014 at 6:57 AM, Andrew Ash <andrew@andrewash.com> wrot=
e:
> >=20
> >> As far as I know, the upstream doesn't release binaries, only source c=
ode.
> >> The downloads page <https://mesos.apache.org/downloads/> for 0.18.0 on=
ly
> >> has a source tarball.  Is there a binary release somewhere from Mesos =
that
> >> I'm missing?
> >>=20
> >>=20
> >> On Sun, May 11, 2014 at 2:16 PM, Patrick Wendell <pwendell@gmail.com>
> >> wrote:
> >>=20
> >>> Andrew,
> >>>=20
> >>> Updating these docs would be great! I think this would be a welcome
> >> change.
> >>>=20
> >>> In terms of packaging, it would be good to mention the binaries
> >>> produced by the upstream project as well, in addition to Mesosphere.
> >>>=20
> >>> - Patrick
> >>>=20
> >>> On Thu, May 8, 2014 at 12:51 AM, Andrew Ash <andrew@andrewash.com>
> >> wrote:
> >>>> The docs for how to run Spark on Mesos have changed very little sinc=
e
> >>>> 0.6.0, but setting it up is much easier now than then.  Does it make
> >>> sense
> >>>> to revamp with the below changes?
> >>>>=20
> >>>>=20
> >>>> You no longer need to build mesos yourself as pre-built versions are
> >>>> available from Mesosphere: http://mesosphere.io/downloads/
> >>>>=20
> >>>> And the instructions guide you towards compiling your own distributi=
on
> >> of
> >>>> Spark, when you can use the prebuilt versions of Spark as well.
> >>>>=20
> >>>>=20
> >>>> I'd like to split that portion of the documentation into two section=
s,
> >> a
> >>>> build-from-scratch section and a use-prebuilt section.  The new outl=
ine
> >>>> would look something like this:
> >>>>=20
> >>>>=20
> >>>> *Running Spark on Mesos*
> >>>>=20
> >>>> Installing Mesos
> >>>> - using prebuilt (recommended)
> >>>> - pointer to mesosphere's packages
> >>>> - from scratch
> >>>> - (similar to current)
> >>>>=20
> >>>>=20
> >>>> Connecting Spark to Mesos
> >>>> - loading distribution into an accessible location
> >>>> - Spark settings
> >>>>=20
> >>>> Mesos Run Modes
> >>>> - (same as current)
> >>>>=20
> >>>> Running Alongside Hadoop
> >>>> - (trim this down)
> >>>>=20
> >>>>=20
> >>>>=20
> >>>> Does that work for people?
> >>>>=20
> >>>>=20
> >>>> Thanks!
> >>>> Andrew
> >>>>=20
> >>>>=20
> >>>> PS Basically all the same:
> >>>>=20
> >>>> http://spark.apache.org/docs/0.6.0/running-on-mesos.html
> >>>> http://spark.apache.org/docs/0.6.2/running-on-mesos.html
> >>>> http://spark.apache.org/docs/0.7.3/running-on-mesos.html
> >>>> http://spark.apache.org/docs/0.8.1/running-on-mesos.html
> >>>> http://spark.apache.org/docs/0.9.1/running-on-mesos.html
> >>>>=20
> >>>=20
> >> https://people.apache.org/~pwendell/spark-1.0.0-rc3-docs/running-on-me=
sos.html
> >>>=20
> >>=20
>=20
>=20

--=20
Cheers,
Tim
Freedom, Features, Friends, First -> Fedora
https://fedoraproject.org/wiki/SIGs/bigdata