spark-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From sro...@apache.org
Subject spark git commit: [SPARK-12755][CORE] Stop the event logger before the DAG scheduler
Date Mon, 25 Jan 2016 09:51:47 GMT
Repository: spark
Updated Branches:
  refs/heads/master d8e480521 -> 4ee8191e5


[SPARK-12755][CORE] Stop the event logger before the DAG scheduler

[SPARK-12755][CORE] Stop the event logger before the DAG scheduler to avoid a race condition
where the standalone master attempts to build the app's history UI before the event log is
stopped.

This contribution is my original work, and I license this work to the Spark project under
the project's open source license.

Author: Michael Allman <michael@videoamp.com>

Closes #10700 from mallman/stop_event_logger_first.


Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/4ee8191e
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/4ee8191e
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/4ee8191e

Branch: refs/heads/master
Commit: 4ee8191e57cb823a23ceca17908af86e70354554
Parents: d8e4805
Author: Michael Allman <michael@videoamp.com>
Authored: Mon Jan 25 09:51:41 2016 +0000
Committer: Sean Owen <sowen@cloudera.com>
Committed: Mon Jan 25 09:51:41 2016 +0000

----------------------------------------------------------------------
 core/src/main/scala/org/apache/spark/SparkContext.scala | 12 ++++++------
 1 file changed, 6 insertions(+), 6 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/spark/blob/4ee8191e/core/src/main/scala/org/apache/spark/SparkContext.scala
----------------------------------------------------------------------
diff --git a/core/src/main/scala/org/apache/spark/SparkContext.scala b/core/src/main/scala/org/apache/spark/SparkContext.scala
index d7c605a..fa8c0f5 100644
--- a/core/src/main/scala/org/apache/spark/SparkContext.scala
+++ b/core/src/main/scala/org/apache/spark/SparkContext.scala
@@ -1675,12 +1675,6 @@ class SparkContext(config: SparkConf) extends Logging with ExecutorAllocationCli
     Utils.tryLogNonFatalError {
       _executorAllocationManager.foreach(_.stop())
     }
-    if (_dagScheduler != null) {
-      Utils.tryLogNonFatalError {
-        _dagScheduler.stop()
-      }
-      _dagScheduler = null
-    }
     if (_listenerBusStarted) {
       Utils.tryLogNonFatalError {
         listenerBus.stop()
@@ -1690,6 +1684,12 @@ class SparkContext(config: SparkConf) extends Logging with ExecutorAllocationCli
     Utils.tryLogNonFatalError {
       _eventLogger.foreach(_.stop())
     }
+    if (_dagScheduler != null) {
+      Utils.tryLogNonFatalError {
+        _dagScheduler.stop()
+      }
+      _dagScheduler = null
+    }
     if (env != null && _heartbeatReceiver != null) {
       Utils.tryLogNonFatalError {
         env.rpcEnv.stop(_heartbeatReceiver)


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org


Mime
View raw message