From reviews-return-626628-archive-asf-public=cust-asf.ponee.io@spark.apache.org Tue Mar 20 18:18:37 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 5215218064A for ; Tue, 20 Mar 2018 18:18:37 +0100 (CET) Received: (qmail 26594 invoked by uid 500); 20 Mar 2018 17:18:36 -0000 Mailing-List: contact reviews-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list reviews@spark.apache.org Received: (qmail 26579 invoked by uid 99); 20 Mar 2018 17:18:35 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 20 Mar 2018 17:18:35 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id ACBA1F3536; Tue, 20 Mar 2018 17:18:35 +0000 (UTC) From: jcuquemelle To: reviews@spark.apache.org Reply-To: reviews@spark.apache.org References: In-Reply-To: Subject: [GitHub] spark pull request #19881: [SPARK-22683][CORE] Add tasksPerExecutorSlot para... Content-Type: text/plain Message-Id: <20180320171835.ACBA1F3536@git1-us-west.apache.org> Date: Tue, 20 Mar 2018 17:18:35 +0000 (UTC) Github user jcuquemelle commented on a diff in the pull request: https://github.com/apache/spark/pull/19881#discussion_r175852840 --- Diff: docs/configuration.md --- @@ -1795,6 +1796,19 @@ Apart from these, the following properties are also available, and may be useful Lower bound for the number of executors if dynamic allocation is enabled. + + spark.dynamicAllocation.fullParallelismDivisor + 1 + + By default, the dynamic allocation will request enough executors to maximize the + parallelism according to the number of tasks to process. While this minimizes the + latency of the job, with small tasks this setting wastes a lot of resources due to --- End diff -- done --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org For additional commands, e-mail: reviews-help@spark.apache.org