spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From mengxr <...@git.apache.org>
Subject [GitHub] spark pull request #22001: [SPARK-24819][CORE] Fail fast when no enough slot...
Date Fri, 10 Aug 2018 15:18:24 GMT
Github user mengxr commented on a diff in the pull request:

    https://github.com/apache/spark/pull/22001#discussion_r209275201
  
    --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ---
    @@ -929,6 +955,28 @@ class DAGScheduler(
           // HadoopRDD whose underlying HDFS files have been deleted.
           finalStage = createResultStage(finalRDD, func, partitions, jobId, callSite)
         } catch {
    +      case e: Exception if e.getMessage ==
    +          DAGScheduler.ERROR_MESSAGE_BARRIER_REQUIRE_MORE_SLOTS_THAN_CURRENT_TOTAL_NUMBER
=>
    +        logWarning("The job requires to run a barrier stage that requires more slots
than the " +
    --- End diff --
    
    Please include jobId, stageId, request slots, and total slots in the log message.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Mime
View raw message