spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Imran Rashid (JIRA)" <>
Subject [jira] [Created] (SPARK-17911) Scheduler does not messageScheduler for ResubmitFailedStages
Date Thu, 13 Oct 2016 15:25:20 GMT
Imran Rashid created SPARK-17911:

             Summary: Scheduler does not messageScheduler for ResubmitFailedStages
                 Key: SPARK-17911
             Project: Spark
          Issue Type: Improvement
          Components: Scheduler
    Affects Versions: 2.0.0
            Reporter: Imran Rashid

Its not totally clear what the purpose of the {{messageScheduler}} is in {{DAGScheduler}}.
 It can perhaps be eliminated completely; or perhaps we should just clearly document its purpose.

This comes from a long discussion w/ [~markhamstra] on an unrelated PR here:

But its tricky so breaking it out here for archiving the discussion.

Note: this issue requires a decision on what to do before a code change, so lets just discuss
it on jira first.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message