spark-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From gurwls...@apache.org
Subject spark git commit: [MINOR][CORE] Show block manager id when remove RDD/Broadcast fails.
Date Tue, 03 Apr 2018 13:26:55 GMT
Repository: spark
Updated Branches:
  refs/heads/master 8020f66fc -> 7cf9fab33


[MINOR][CORE] Show block manager id when remove RDD/Broadcast fails.

## What changes were proposed in this pull request?

Address https://github.com/apache/spark/pull/20924#discussion_r177987175, show block manager
id when remove RDD/Broadcast fails.

## How was this patch tested?

N/A

Author: Xingbo Jiang <xingbo.jiang@databricks.com>

Closes #20960 from jiangxb1987/bmid.


Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/7cf9fab3
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/7cf9fab3
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/7cf9fab3

Branch: refs/heads/master
Commit: 7cf9fab33457ccc9b2d548f15dd5700d5e8d08ef
Parents: 8020f66
Author: Xingbo Jiang <xingbo.jiang@databricks.com>
Authored: Tue Apr 3 21:26:49 2018 +0800
Committer: hyukjinkwon <gurwls223@apache.org>
Committed: Tue Apr 3 21:26:49 2018 +0800

----------------------------------------------------------------------
 .../org/apache/spark/storage/BlockManagerMasterEndpoint.scala  | 6 ++++--
 1 file changed, 4 insertions(+), 2 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/spark/blob/7cf9fab3/core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala
----------------------------------------------------------------------
diff --git a/core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala
b/core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala
index 56b95c3..8e8f7d1 100644
--- a/core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala
+++ b/core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala
@@ -164,7 +164,8 @@ class BlockManagerMasterEndpoint(
     val futures = blockManagerInfo.values.map { bm =>
       bm.slaveEndpoint.ask[Int](removeMsg).recover {
         case e: IOException =>
-          logWarning(s"Error trying to remove RDD $rddId", e)
+          logWarning(s"Error trying to remove RDD $rddId from block manager ${bm.blockManagerId}",
+            e)
           0 // zero blocks were removed
       }
     }.toSeq
@@ -195,7 +196,8 @@ class BlockManagerMasterEndpoint(
     val futures = requiredBlockManagers.map { bm =>
       bm.slaveEndpoint.ask[Int](removeMsg).recover {
         case e: IOException =>
-          logWarning(s"Error trying to remove broadcast $broadcastId", e)
+          logWarning(s"Error trying to remove broadcast $broadcastId from block manager "
+
+            s"${bm.blockManagerId}", e)
           0 // zero blocks were removed
       }
     }.toSeq


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org


Mime
View raw message