Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id A2291200B59 for ; Mon, 8 Aug 2016 21:52:27 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id A0E2E160A91; Mon, 8 Aug 2016 19:52:27 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id E6437160A77 for ; Mon, 8 Aug 2016 21:52:26 +0200 (CEST) Received: (qmail 51235 invoked by uid 500); 8 Aug 2016 19:52:26 -0000 Mailing-List: contact commits-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list commits@spark.apache.org Received: (qmail 51225 invoked by uid 99); 8 Aug 2016 19:52:26 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 08 Aug 2016 19:52:26 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 0DE42DFC56; Mon, 8 Aug 2016 19:52:26 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: tdas@apache.org To: commits@spark.apache.org Message-Id: X-Mailer: ASF-Git Admin Mailer Subject: spark git commit: [SPARK-16953] Make requestTotalExecutors public Developer API to be consistent with requestExecutors/killExecutors Date: Mon, 8 Aug 2016 19:52:26 +0000 (UTC) archived-at: Mon, 08 Aug 2016 19:52:27 -0000 Repository: spark Updated Branches: refs/heads/branch-2.0 69e278ebc -> 9748a2928 [SPARK-16953] Make requestTotalExecutors public Developer API to be consistent with requestExecutors/killExecutors ## What changes were proposed in this pull request? RequestExecutors and killExecutor are public developer APIs for managing the number of executors allocated to the SparkContext. For consistency, requestTotalExecutors should also be a public Developer API, as it provides similar functionality. In fact, using requestTotalExecutors is more convenient that requestExecutors as the former is idempotent and the latter is not. Author: Tathagata Das Closes #14541 from tdas/SPARK-16953. (cherry picked from commit 8650239050ade91689ffa0672ea094de2594e37c) Signed-off-by: Tathagata Das Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/9748a292 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/9748a292 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/9748a292 Branch: refs/heads/branch-2.0 Commit: 9748a29289cf35a739854f17e72d039009abedbe Parents: 69e278e Author: Tathagata Das Authored: Mon Aug 8 12:52:04 2016 -0700 Committer: Tathagata Das Committed: Mon Aug 8 12:52:22 2016 -0700 ---------------------------------------------------------------------- core/src/main/scala/org/apache/spark/SparkContext.scala | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/9748a292/core/src/main/scala/org/apache/spark/SparkContext.scala ---------------------------------------------------------------------- diff --git a/core/src/main/scala/org/apache/spark/SparkContext.scala b/core/src/main/scala/org/apache/spark/SparkContext.scala index d3e8de3..699dc51 100644 --- a/core/src/main/scala/org/apache/spark/SparkContext.scala +++ b/core/src/main/scala/org/apache/spark/SparkContext.scala @@ -1472,7 +1472,8 @@ class SparkContext(config: SparkConf) extends Logging with ExecutorAllocationCli * This includes running, pending, and completed tasks. * @return whether the request is acknowledged by the cluster manager. */ - private[spark] override def requestTotalExecutors( + @DeveloperApi + override def requestTotalExecutors( numExecutors: Int, localityAwareTasks: Int, hostToLocalTaskCount: scala.collection.immutable.Map[String, Int] --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org For additional commands, e-mail: commits-help@spark.apache.org