spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael Gummelt (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-19703) Add Suppress/Revive support to the Mesos Spark Driver
Date Wed, 22 Feb 2017 23:28:44 GMT
Michael Gummelt created SPARK-19703:
---------------------------------------

             Summary: Add Suppress/Revive support to the Mesos Spark Driver
                 Key: SPARK-19703
                 URL: https://issues.apache.org/jira/browse/SPARK-19703
             Project: Spark
          Issue Type: New Feature
          Components: Mesos
    Affects Versions: 2.1.0
            Reporter: Michael Gummelt


Due to the problem described here: https://issues.apache.org/jira/browse/MESOS-6112, Running
> 5 Mesos frameworks concurrently can result in starvation.  For example, running 10 jobs
could result in 5 of them getting all the offers, even after they've launched all their executors.
 This leads to starvation of the other jobs.  We must implement explicit SUPPRESS and REVIVE
calls in the Spark Dispatcher to solve this problem.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message