spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Rosen (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-8606) Exceptions in RDD.getPreferredLocations() and getPartitions() should not be able to crash DAGScheduler
Date Wed, 24 Jun 2015 22:17:06 GMT
Josh Rosen created SPARK-8606:
---------------------------------

             Summary: Exceptions in RDD.getPreferredLocations() and getPartitions() should
not be able to crash DAGScheduler
                 Key: SPARK-8606
                 URL: https://issues.apache.org/jira/browse/SPARK-8606
             Project: Spark
          Issue Type: Bug
          Components: Scheduler
    Affects Versions: 1.4.0, 1.3.0, 1.2.0, 1.5.0
            Reporter: Josh Rosen
            Assignee: Josh Rosen
            Priority: Critical


RDD.getPreferredLocations() and RDD.getPartitions() may throw exceptions but the DAGScheduler
does not guard against this, leaving it vulnerable to crashing and stopping the SparkContext
if exceptions occur there.

We should fix this by adding more try blocks around these calls in DAGScheduler.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message