hadoop-yarn-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From jeag...@apache.org
Subject svn commit: r1577779 - in /hadoop/common/branches/branch-2/hadoop-yarn-project: CHANGES.txt hadoop-yarn/hadoop-yarn-site/src/site/apt/CapacityScheduler.apt.vm
Date Sat, 15 Mar 2014 04:11:40 GMT
Author: jeagles
Date: Sat Mar 15 04:11:39 2014
New Revision: 1577779

URL: http://svn.apache.org/r1577779
Log:
YARN-1520. update capacity scheduler docs to include necessary parameters (Chen He via jeagles)

Modified:
    hadoop/common/branches/branch-2/hadoop-yarn-project/CHANGES.txt
    hadoop/common/branches/branch-2/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/CapacityScheduler.apt.vm

Modified: hadoop/common/branches/branch-2/hadoop-yarn-project/CHANGES.txt
URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-2/hadoop-yarn-project/CHANGES.txt?rev=1577779&r1=1577778&r2=1577779&view=diff
==============================================================================
--- hadoop/common/branches/branch-2/hadoop-yarn-project/CHANGES.txt (original)
+++ hadoop/common/branches/branch-2/hadoop-yarn-project/CHANGES.txt Sat Mar 15 04:11:39 2014
@@ -23,6 +23,9 @@ Release 2.5.0 - UNRELEASED
     YARN-1833. TestRMAdminService Fails in trunk and branch-2 (Mit Desais via
     jeagles)
 
+    YARN-1520. update capacity scheduler docs to include necessary parameters
+    (Chen He via jeagles)
+
   OPTIMIZATIONS
 
   BUG FIXES 

Modified: hadoop/common/branches/branch-2/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/CapacityScheduler.apt.vm
URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-2/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/CapacityScheduler.apt.vm?rev=1577779&r1=1577778&r2=1577779&view=diff
==============================================================================
--- hadoop/common/branches/branch-2/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/CapacityScheduler.apt.vm
(original)
+++ hadoop/common/branches/branch-2/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/CapacityScheduler.apt.vm
Sat Mar 15 04:11:39 2014
@@ -297,18 +297,48 @@ Hadoop MapReduce Next Generation - Capac
     <Note:> An <ACL> is of the form <user1>, <user2><space><group1>,
<group2>.
     The special value of <<*>> implies <anyone>. The special value of <space>
     implies <no one>. The default is <<*>> for the root queue if not specified.
-     
-    * Reviewing the configuration of the CapacityScheduler
+
+  * Other Properties
+
+    * Resource Calculator
+
+
+*--------------------------------------+--------------------------------------+
+|| Property                            || Description                         |
+*--------------------------------------+--------------------------------------+
+| <<<yarn.scheduler.capacity.resource-calculator>>> | |
+| | The ResourceCalculator implementation to be used to compare Resources in the |
+| | scheduler. The default i.e. org.apache.hadoop.yarn.util.resource.DefaultResourseCalculator
|
+| | only uses Memory while DominantResourceCalculator uses Dominant-resource |
+| | to compare multi-dimensional resources such as Memory, CPU etc. A Java |
+| | ResourceCalculator class name is expected. |
+*--------------------------------------+--------------------------------------+
+
+
+    * Data Locality
+
+*--------------------------------------+--------------------------------------+
+|| Property                            || Description                         |
+*--------------------------------------+--------------------------------------+
+| <<<yarn.scheduler.capacity.node-locality-delay>>> | |
+| | Number of missed scheduling opportunities after which the CapacityScheduler |
+| | attempts to schedule rack-local containers. Typically, this should be set to |
+| | number of nodes in the cluster. By default is setting approximately number |
+| | of nodes in one rack which is 40. Positive integer value is expected.|
+*--------------------------------------+--------------------------------------+
+
+
+  * Reviewing the configuration of the CapacityScheduler
 
       Once the installation and configuration is completed, you can review it 
       after starting the YARN cluster from the web-ui.
 
-      * Start the YARN cluster in the normal manner.
+    * Start the YARN cluster in the normal manner.
 
-      * Open the <<<ResourceManager>>> web UI.
+    * Open the <<<ResourceManager>>> web UI.
 
-      * The </scheduler> web-page should show the resource usages of individual 
-        queues.
+    * The </scheduler> web-page should show the resource usages of individual 
+      queues.
       
       []
       



Mime
View raw message