hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From w...@apache.org
Subject hadoop git commit: YARN-6851. Capacity Scheduler: document configs for controlling # containers allowed to be allocated per node heartbeat.
Date Wed, 29 Nov 2017 22:47:54 GMT
Repository: hadoop
Updated Branches:
  refs/heads/branch-2 6fd9d1117 -> 5bb632921


YARN-6851. Capacity Scheduler: document configs for controlling # containers allowed to be
allocated per node heartbeat.

(cherry picked from commit 333ef303ff0caf9adfd378652a8f966377901768)


Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/5bb63292
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/5bb63292
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/5bb63292

Branch: refs/heads/branch-2
Commit: 5bb632921560e9131b1d1e9bcc2f33f5cdf85c0f
Parents: 6fd9d11
Author: Wei Yan <weiy@apache.org>
Authored: Wed Nov 29 14:37:57 2017 -0800
Committer: Wei Yan <weiy@apache.org>
Committed: Wed Nov 29 14:46:47 2017 -0800

----------------------------------------------------------------------
 .../src/site/markdown/CapacityScheduler.md                | 10 ++++++++++
 1 file changed, 10 insertions(+)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/hadoop/blob/5bb63292/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md
----------------------------------------------------------------------
diff --git a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md
index 4754c94..0449e88 100644
--- a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md
+++ b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md
@@ -282,6 +282,16 @@ The `ReservationSystem` is integrated with the `CapacityScheduler` queue
hierach
 |:---- |:---- |
 | `yarn.scheduler.capacity.node-locality-delay` | Number of missed scheduling opportunities
after which the CapacityScheduler attempts to schedule rack-local containers. Typically, this
should be set to number of nodes in the cluster. By default is setting approximately number
of nodes in one rack which is 40. Positive integer value is expected. |
 
+  * Container Allocation per NodeManager Heartbeat
+
+  The `CapacityScheduler` supports the following parameters to control how many containers
can be allocated in each NodeManager heartbeat.
+
+| Property | Description |
+|:---- |:---- |
+| `yarn.scheduler.capacity.per-node-heartbeat.multiple-assignments-enabled` | Whether to
allow multiple container assignments in one NodeManager heartbeat. Defaults to true. |
+| `yarn.scheduler.capacity.per-node-heartbeat.maximum-container-assignments` | If `multiple-assignments-enabled`
is true, the maximum amount of containers that can be assigned in one NodeManager heartbeat.
Defaults to -1, which sets no limit. |
+| `yarn.scheduler.capacity.per-node-heartbeat.maximum-offswitch-assignments` | If `multiple-assignments-enabled`
is true, the maximum amount of off-switch containers that can be assigned in one NodeManager
heartbeat. Defaults to 1, which represents only one off-switch allocation allowed in one heartbeat.
|
+
 ###Reviewing the configuration of the CapacityScheduler
 
   Once the installation and configuration is completed, you can review it after starting
the YARN cluster from the web-ui.


---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org


Mime
View raw message