drill-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From tshi...@apache.org
Subject [48/50] [abbrv] drill git commit: minor edits
Date Fri, 01 May 2015 18:08:44 GMT
minor edits


Project: http://git-wip-us.apache.org/repos/asf/drill/repo
Commit: http://git-wip-us.apache.org/repos/asf/drill/commit/c9749065
Tree: http://git-wip-us.apache.org/repos/asf/drill/tree/c9749065
Diff: http://git-wip-us.apache.org/repos/asf/drill/diff/c9749065

Branch: refs/heads/gh-pages
Commit: c9749065631d2260b541b999fecb0b6a9545a706
Parents: c010ca8
Author: Kristine Hahn <khahn@maprtech.com>
Authored: Fri May 1 10:51:26 2015 -0700
Committer: Kristine Hahn <khahn@maprtech.com>
Committed: Fri May 1 10:51:26 2015 -0700

----------------------------------------------------------------------
 ...nfiguring-dfferent-workloads-introduction.md |  2 +-
 .../015-configuring-drill-in-a-cluster.md       | 38 +++++++++++---------
 2 files changed, 22 insertions(+), 18 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/drill/blob/c9749065/_docs/manage-drill/013-configuring-dfferent-workloads-introduction.md
----------------------------------------------------------------------
diff --git a/_docs/manage-drill/013-configuring-dfferent-workloads-introduction.md b/_docs/manage-drill/013-configuring-dfferent-workloads-introduction.md
index fe87179..737ef79 100644
--- a/_docs/manage-drill/013-configuring-dfferent-workloads-introduction.md
+++ b/_docs/manage-drill/013-configuring-dfferent-workloads-introduction.md
@@ -19,4 +19,4 @@ You need to plan and configure these resources for use with Drill and other
work
 * [CPU]({{site.baseurl}}/docs/configuring-drill-in-a-cluster#how-to-manage-drill-cpu-resources)
 
 * Disk  
 
-Configure, memory, queues, and parallelization ["when users share a Drillbit"]({{site.baseurl}}/docs/configuring-resources-for-a-shared-drillbit).
\ No newline at end of file
+Configure, memory, queues, and parallelization when users [share a Drillbit]({{site.baseurl}}/docs/configuring-resources-for-a-shared-drillbit).
\ No newline at end of file

http://git-wip-us.apache.org/repos/asf/drill/blob/c9749065/_docs/manage-drill/015-configuring-drill-in-a-cluster.md
----------------------------------------------------------------------
diff --git a/_docs/manage-drill/015-configuring-drill-in-a-cluster.md b/_docs/manage-drill/015-configuring-drill-in-a-cluster.md
index a5c124b..9e46732 100644
--- a/_docs/manage-drill/015-configuring-drill-in-a-cluster.md
+++ b/_docs/manage-drill/015-configuring-drill-in-a-cluster.md
@@ -1,29 +1,28 @@
----
+    ---
 title: "Configuring Resources in a Mixed Cluster"
 parent: "Configuring Different Workloads"
 ---
-Drill operations are memory and CPU-intensive. You need to statically partition the cluster
to designate which partition handles which workload. 
+Drill operations are memory and CPU-intensive. You need to statically partition the cluster
to designate which partition handles which workload. To configure resources for Drill in a
MapR cluster, modify one or more of the following files in `/opt/mapr/conf/conf.d` that the
installation process creates. 
 
-## Configuring Drill Memory in a Mixed Cluster
+* `warden.drill-bits.conf`
+* `warden.nodemanager.conf`
+* `warden.resourcemanager.conf`
 
-To configure memory resources for Drill, you modify the `warden.drill-bits.conf` file in
`/opt/mapr/conf/conf.d`. This file is created automatically when you install Drill on a node.

+Configure Drill memory by modifying `warden.drill-bits.conf` in YARN and non-YARN clusters.
Configure other resources by modifying `warden.nodemanager.conf `and `warden.resourcemanager.conf
`in a YARN-enabled cluster.
 
-    [root@centos23 conf.d]# pwd
-    /opt/mapr/conf/conf.d
-    [root@centos23 conf.d]# ls
-    warden.drill-bits.conf  warden.nodemanager.conf  warden.resourcemanager.conf
+## Configuring Drill Memory in a Mixed Cluster
 
-You add the following lines to the wardens.drill-bits.conf file to configure memory resources
for Drill:
+Add the following lines to the `warden.drill-bits.conf` file to configure memory resources
for Drill:
 
     service.heapsize.min=<some value in MB>
     service.heapsize.max=<some value in MB>
     service.heapsize.percent=<a whole number>
 
-This service.heapsize.percent is the percentage of memory for the service bounded by min
and max values.
+The service.heapsize.percent is the percentage of memory for the service bounded by minimum
and maximum values.
 
 ## Configuring Drill in a YARN-enabled MapR Cluster
 
-To add Drill to a YARN-enabled cluster, you change memory resources depending on your application.
For example, you have 120G of available memory that you allocate to following workloads in
a Yarn-enabled cluster:
+To add Drill to a YARN-enabled cluster, change memory resources to suit your application.
For example, you have 120G of available memory that you allocate to following workloads in
a Yarn-enabled cluster:
 
 File system = 20G  
 HBase = 20G  
@@ -41,23 +40,27 @@ YARN consists of two main services:
 * NodeManager  
   There is one instance per node. 
 
-Configure ResourceManager and NodeManager memory in `/opt/mapr/conf/conf.d/warden.resourcemanager.conf`
and
- `/opt/mapr/conf/conf.d/warden.nodemanager.conf`. Configure the following warden.nodemanager.conf
settings. The defaults are:
+ResourceManager and NodeManager memory in `warden.resourcemanager.conf` and
+ `warden.nodemanager.conf` are set to the following defaults. 
 
     service.heapsize.min=64
     service.heapsize.max=325
     service.heapsize.percent=2
 
-Memory allocation for NodeManager and ResourceManager is used only to calculate total memory
required for all services to run. The -Xmx option is not set, allowing memory on to grow as
needed. If you want to place an upper limit on memory set YARN_NODEMANAGER_HEAPSIZE or YARN_RESOURCEMANAGER_HEAPSIZE
environment variable in /opt/mapr/hadoop/hadoop-2.5.1/etc/hadoop/yarn-env.sh.
+Change these settings for NodeManager and ResourceManager to reconfigure the total memory
required for YARN services to run. If you want to place an upper limit on memory set YARN_NODEMANAGER_HEAPSIZE
or YARN_RESOURCEMANAGER_HEAPSIZE environment variable in /opt/mapr/hadoop/hadoop-2.5.1/etc/hadoop/yarn-env.sh.
The -Xmx option is not set, allowing memory on to grow as needed.
 
 ### MapReduce v1 Resources
 
-To configure memory for MapReduce v1 resources set mr1.memory.percent, mr1.cpu.percent and
mr1.disk.percent in warden.conf, as described in section ["Resource Allocation for Jobs and
Applications"](http://doc.mapr.com/display/MapR/Resource+Allocation+for+Jobs+and+Applications)
of the MapR documentation. Remaining memory is given to YARN applications. 
+The following default settings in /opt/mapr/conf/warden.conf control MapReduce v1 memory:
 
+    mr1.memory.percent=50
+    mr1.cpu.percent=50
+    mr1.disk.percent=50
+
+Modify these settings to reconfigure MapReduce v1 resources to suit your application needs,
as described in section ["Resource Allocation for Jobs and Applications"](http://doc.mapr.com/display/MapR/Resource+Allocation+for+Jobs+and+Applications)
of the MapR documentation. Remaining memory is given to YARN applications. 
 
-### MapReduce v2 and other Resources
 
-Similar files exist for other installed services, as described in [MapR documentation](http://doc.mapr.com/display/MapR/warden.%3Cservicename%3E.conf).

+### MapReduce v2 and other Resources
 
 You configure memory for each service by setting three values in `warden.conf`.
 
@@ -65,6 +68,7 @@ You configure memory for each service by setting three values in `warden.conf`.
     service.command.<servicename>.heapsize.max
     service.command.<servicename>.heapsize.min
 
+Configure memory for other services in the same manner, as described in [MapR documentation](http://doc.mapr.com/display/MapR/warden.%3Cservicename%3E.conf)
 
 For more information about managing memory in a MapR cluster, see the following sections
in the MapR documentation:
 * [Memory Allocation for Nodes](http://doc.mapr.com/display/MapR40x/Memory+Allocation+for+Nodes)


Mime
View raw message