spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Timothy Chen (JIRA)" <>
Subject [jira] [Created] (SPARK-2691) Allow Spark on Mesos to be launched with Docker
Date Fri, 25 Jul 2014 18:31:39 GMT
Timothy Chen created SPARK-2691:

             Summary: Allow Spark on Mesos to be launched with Docker
                 Key: SPARK-2691
             Project: Spark
          Issue Type: Improvement
          Components: Mesos
            Reporter: Timothy Chen

Currently to launch Spark with Mesos one must upload a tarball and specifiy the executor URI
to be passed in that is to be downloaded on each slave or even each execution depending coarse
mode or not.

We want to make Spark able to support launching Executors via a Docker image that utilizes
the recent Docker and Mesos integration work. 

With the recent integration Spark can simply specify a Docker image and options that is needed
and it should continue to work as-is.

This message was sent by Atlassian JIRA

View raw message