spark-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
Subject spark git commit: [SPARK-16953] Make requestTotalExecutors public Developer API to be consistent with requestExecutors/killExecutors
Date Mon, 08 Aug 2016 19:52:26 GMT
Repository: spark
Updated Branches:
  refs/heads/branch-2.0 69e278ebc -> 9748a2928

[SPARK-16953] Make requestTotalExecutors public Developer API to be consistent with requestExecutors/killExecutors

## What changes were proposed in this pull request?

RequestExecutors and killExecutor are public developer APIs for managing the number of executors
allocated to the SparkContext. For consistency, requestTotalExecutors should also be a public
Developer API, as it provides similar functionality. In fact, using requestTotalExecutors
is more convenient that requestExecutors as the former is idempotent and the latter is not.

Author: Tathagata Das <>

Closes #14541 from tdas/SPARK-16953.

(cherry picked from commit 8650239050ade91689ffa0672ea094de2594e37c)
Signed-off-by: Tathagata Das <>


Branch: refs/heads/branch-2.0
Commit: 9748a29289cf35a739854f17e72d039009abedbe
Parents: 69e278e
Author: Tathagata Das <>
Authored: Mon Aug 8 12:52:04 2016 -0700
Committer: Tathagata Das <>
Committed: Mon Aug 8 12:52:22 2016 -0700

 core/src/main/scala/org/apache/spark/SparkContext.scala | 3 ++-
 1 file changed, 2 insertions(+), 1 deletion(-)
diff --git a/core/src/main/scala/org/apache/spark/SparkContext.scala b/core/src/main/scala/org/apache/spark/SparkContext.scala
index d3e8de3..699dc51 100644
--- a/core/src/main/scala/org/apache/spark/SparkContext.scala
+++ b/core/src/main/scala/org/apache/spark/SparkContext.scala
@@ -1472,7 +1472,8 @@ class SparkContext(config: SparkConf) extends Logging with ExecutorAllocationCli
    *                             This includes running, pending, and completed tasks.
    * @return whether the request is acknowledged by the cluster manager.
-  private[spark] override def requestTotalExecutors(
+  @DeveloperApi
+  override def requestTotalExecutors(
       numExecutors: Int,
       localityAwareTasks: Int,
       hostToLocalTaskCount: scala.collection.immutable.Map[String, Int]

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message