reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Markus Weimer <mar...@weimo.de>
Subject Re: [jira] [Commented] (REEF-1791) Implement reef-runtime-spark
Date Mon, 08 May 2017 20:48:50 GMT
> As I'm working on the design for this JIRA I was wondering if we should
> include the ability to spin up a spark cluster either on top of mesos
> and/or yarn in the user's dev environment for running the reef tasks on the
> spark executors, thoughts on this?

I don't think that is needed. The assumption here is that a user has a
Spark job they'd like to launch a REEF job from, not the other way
around.

Markus

Mime
View raw message