drill-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From tshi...@apache.org
Subject [45/50] [abbrv] drill git commit: docs org
Date Fri, 01 May 2015 18:08:41 GMT
docs org


Project: http://git-wip-us.apache.org/repos/asf/drill/repo
Commit: http://git-wip-us.apache.org/repos/asf/drill/commit/95313815
Tree: http://git-wip-us.apache.org/repos/asf/drill/tree/95313815
Diff: http://git-wip-us.apache.org/repos/asf/drill/diff/95313815

Branch: refs/heads/gh-pages
Commit: 953138153e6402eccb579e6bfe037f6be2447eea
Parents: 53a424a
Author: Kristine Hahn <khahn@maprtech.com>
Authored: Thu Apr 30 19:04:45 2015 -0700
Committer: Kristine Hahn <khahn@maprtech.com>
Committed: Thu Apr 30 19:04:45 2015 -0700

----------------------------------------------------------------------
 _data/docs.json                                 | 246 +++++--------------
 ...-configuring-drill-in-a-dedicated-cluster.md |  30 +++
 _docs/manage-drill/011-configuring-memory.md    |  30 ---
 ...nfiguring-dfferent-workloads-introduction.md |   4 +-
 .../015-configuring-drill-in-a-cluster.md       |  14 +-
 .../015-configuring-resources-in-a-cluster.md   |  78 ------
 ...nfiguring-resources-for-a-shared-drillbit.md |  65 -----
 7 files changed, 94 insertions(+), 373 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/drill/blob/95313815/_data/docs.json
----------------------------------------------------------------------
diff --git a/_data/docs.json b/_data/docs.json
index 6cc9b8d..6805349 100644
--- a/_data/docs.json
+++ b/_data/docs.json
@@ -855,8 +855,8 @@
                         }
                     ], 
                     "children": [], 
-                    "next_title": "Configuring Resources in a Cluster", 
-                    "next_url": "/docs/configuring-resources-in-a-cluster/", 
+                    "next_title": "Configuring Resources in a Mixed Cluster", 
+                    "next_url": "/docs/configuring-resources-in-a-mixed-cluster/", 
                     "parent": "Configuring Different Workloads", 
                     "previous_title": "Configuring Different Workloads", 
                     "previous_url": "/docs/configuring-different-workloads/", 
@@ -876,56 +876,14 @@
                         }
                     ], 
                     "children": [], 
-                    "next_title": "Configuring Resources in a Cluster", 
-                    "next_url": "/docs/configuring-resources-in-a-cluster/", 
+                    "next_title": "Configuring Resources for a Shared Drillbit", 
+                    "next_url": "/docs/configuring-resources-for-a-shared-drillbit/", 
                     "parent": "Configuring Different Workloads", 
                     "previous_title": "Configuring Different Workloads Introduction", 
                     "previous_url": "/docs/configuring-different-workloads-introduction/",

                     "relative_path": "_docs/manage-drill/015-configuring-drill-in-a-cluster.md",

-                    "title": "Configuring Resources in a Cluster", 
-                    "url": "/docs/configuring-resources-in-a-cluster/"
-                }, 
-                {
-                    "breadcrumbs": [
-                        {
-                            "title": "Configuring Different Workloads", 
-                            "url": "/docs/configuring-different-workloads/"
-                        }, 
-                        {
-                            "title": "Manage Drill", 
-                            "url": "/docs/manage-drill/"
-                        }
-                    ], 
-                    "children": [], 
-                    "next_title": "Configuring Resources for a Shared Drillbit", 
-                    "next_url": "/docs/configuring-resources-for-a-shared-drillbit/", 
-                    "parent": "Configuring Different Workloads", 
-                    "previous_title": "Configuring Resources in a Cluster", 
-                    "previous_url": "/docs/configuring-resources-in-a-cluster/", 
-                    "relative_path": "_docs/manage-drill/015-configuring-resources-in-a-cluster.md",

-                    "title": "Configuring Resources in a Cluster", 
-                    "url": "/docs/configuring-resources-in-a-cluster/"
-                }, 
-                {
-                    "breadcrumbs": [
-                        {
-                            "title": "Configuring Different Workloads", 
-                            "url": "/docs/configuring-different-workloads/"
-                        }, 
-                        {
-                            "title": "Manage Drill", 
-                            "url": "/docs/manage-drill/"
-                        }
-                    ], 
-                    "children": [], 
-                    "next_title": "Configuring Resources for a Shared Drillbit", 
-                    "next_url": "/docs/configuring-resources-for-a-shared-drillbit/", 
-                    "parent": "Configuring Different Workloads", 
-                    "previous_title": "Configuring Resources in a Cluster", 
-                    "previous_url": "/docs/configuring-resources-in-a-cluster/", 
-                    "relative_path": "_docs/manage-drill/017-configuring-a-shared-drillbit.md",

-                    "title": "Configuring Resources for a Shared Drillbit", 
-                    "url": "/docs/configuring-resources-for-a-shared-drillbit/"
+                    "title": "Configuring Resources in a Mixed Cluster", 
+                    "url": "/docs/configuring-resources-in-a-mixed-cluster/"
                 }, 
                 {
                     "breadcrumbs": [
@@ -942,9 +900,9 @@
                     "next_title": "Configuration Options", 
                     "next_url": "/docs/configuration-options/", 
                     "parent": "Configuring Different Workloads", 
-                    "previous_title": "Configuring Resources for a Shared Drillbit", 
-                    "previous_url": "/docs/configuring-resources-for-a-shared-drillbit/",

-                    "relative_path": "_docs/manage-drill/017-configuring-resources-for-a-shared-drillbit.md",

+                    "previous_title": "Configuring Resources in a Mixed Cluster", 
+                    "previous_url": "/docs/configuring-resources-in-a-mixed-cluster/", 
+                    "relative_path": "_docs/manage-drill/017-configuring-a-shared-drillbit.md",

                     "title": "Configuring Resources for a Shared Drillbit", 
                     "url": "/docs/configuring-resources-for-a-shared-drillbit/"
                 }
@@ -952,8 +910,8 @@
             "next_title": "Configuring Different Workloads Introduction", 
             "next_url": "/docs/configuring-different-workloads-introduction/", 
             "parent": "Manage Drill", 
-            "previous_title": "Configuring Memory for Drill in a Drill cluster", 
-            "previous_url": "/docs/configuring-memory-for-drill-in-a-drill-cluster/", 
+            "previous_title": "Configuring Drill in a Dedicated Cluster", 
+            "previous_url": "/docs/configuring-drill-in-a-dedicated-cluster/", 
             "relative_path": "_docs/manage-drill/012-configuring-different-workloads.md",

             "title": "Configuring Different Workloads", 
             "url": "/docs/configuring-different-workloads/"
@@ -970,8 +928,8 @@
                 }
             ], 
             "children": [], 
-            "next_title": "Configuring Resources in a Cluster", 
-            "next_url": "/docs/configuring-resources-in-a-cluster/", 
+            "next_title": "Configuring Resources in a Mixed Cluster", 
+            "next_url": "/docs/configuring-resources-in-a-mixed-cluster/", 
             "parent": "Configuring Different Workloads", 
             "previous_title": "Configuring Different Workloads", 
             "previous_url": "/docs/configuring-different-workloads/", 
@@ -979,7 +937,7 @@
             "title": "Configuring Different Workloads Introduction", 
             "url": "/docs/configuring-different-workloads-introduction/"
         }, 
-        "Configuring Memory for Drill in a Drill cluster": {
+        "Configuring Drill in a Dedicated Cluster": {
             "breadcrumbs": [
                 {
                     "title": "Manage Drill", 
@@ -992,9 +950,9 @@
             "parent": "Manage Drill", 
             "previous_title": "Manage Drill Introduction", 
             "previous_url": "/docs/manage-drill-introduction/", 
-            "relative_path": "_docs/manage-drill/011-configuring-memory.md", 
-            "title": "Configuring Memory for Drill in a Drill cluster", 
-            "url": "/docs/configuring-memory-for-drill-in-a-drill-cluster/"
+            "relative_path": "_docs/manage-drill/011-configuring-drill-in-a-dedicated-cluster.md",

+            "title": "Configuring Drill in a Dedicated Cluster", 
+            "url": "/docs/configuring-drill-in-a-dedicated-cluster/"
         }, 
         "Configuring Resources for a Shared Drillbit": {
             "breadcrumbs": [
@@ -1011,13 +969,13 @@
             "next_title": "Configuration Options", 
             "next_url": "/docs/configuration-options/", 
             "parent": "Configuring Different Workloads", 
-            "previous_title": "Configuring Resources for a Shared Drillbit", 
-            "previous_url": "/docs/configuring-resources-for-a-shared-drillbit/", 
-            "relative_path": "_docs/manage-drill/017-configuring-resources-for-a-shared-drillbit.md",

+            "previous_title": "Configuring Resources in a Mixed Cluster", 
+            "previous_url": "/docs/configuring-resources-in-a-mixed-cluster/", 
+            "relative_path": "_docs/manage-drill/017-configuring-a-shared-drillbit.md", 
             "title": "Configuring Resources for a Shared Drillbit", 
             "url": "/docs/configuring-resources-for-a-shared-drillbit/"
         }, 
-        "Configuring Resources in a Cluster": {
+        "Configuring Resources in a Mixed Cluster": {
             "breadcrumbs": [
                 {
                     "title": "Configuring Different Workloads", 
@@ -1032,11 +990,11 @@
             "next_title": "Configuring Resources for a Shared Drillbit", 
             "next_url": "/docs/configuring-resources-for-a-shared-drillbit/", 
             "parent": "Configuring Different Workloads", 
-            "previous_title": "Configuring Resources in a Cluster", 
-            "previous_url": "/docs/configuring-resources-in-a-cluster/", 
-            "relative_path": "_docs/manage-drill/015-configuring-resources-in-a-cluster.md",

-            "title": "Configuring Resources in a Cluster", 
-            "url": "/docs/configuring-resources-in-a-cluster/"
+            "previous_title": "Configuring Different Workloads Introduction", 
+            "previous_url": "/docs/configuring-different-workloads-introduction/", 
+            "relative_path": "_docs/manage-drill/015-configuring-drill-in-a-cluster.md",

+            "title": "Configuring Resources in a Mixed Cluster", 
+            "url": "/docs/configuring-resources-in-a-mixed-cluster/"
         }, 
         "Connect a Data Source": {
             "breadcrumbs": [], 
@@ -3500,8 +3458,8 @@
                         }
                     ], 
                     "children": [], 
-                    "next_title": "Configuring Memory for Drill in a Drill cluster", 
-                    "next_url": "/docs/configuring-memory-for-drill-in-a-drill-cluster/",

+                    "next_title": "Configuring Drill in a Dedicated Cluster", 
+                    "next_url": "/docs/configuring-drill-in-a-dedicated-cluster/", 
                     "parent": "Manage Drill", 
                     "previous_title": "Manage Drill", 
                     "previous_url": "/docs/manage-drill/", 
@@ -3522,9 +3480,9 @@
                     "parent": "Manage Drill", 
                     "previous_title": "Manage Drill Introduction", 
                     "previous_url": "/docs/manage-drill-introduction/", 
-                    "relative_path": "_docs/manage-drill/011-configuring-memory.md", 
-                    "title": "Configuring Memory for Drill in a Drill cluster", 
-                    "url": "/docs/configuring-memory-for-drill-in-a-drill-cluster/"
+                    "relative_path": "_docs/manage-drill/011-configuring-drill-in-a-dedicated-cluster.md",

+                    "title": "Configuring Drill in a Dedicated Cluster", 
+                    "url": "/docs/configuring-drill-in-a-dedicated-cluster/"
                 }, 
                 {
                     "breadcrumbs": [
@@ -3546,8 +3504,8 @@
                                 }
                             ], 
                             "children": [], 
-                            "next_title": "Configuring Resources in a Cluster", 
-                            "next_url": "/docs/configuring-resources-in-a-cluster/", 
+                            "next_title": "Configuring Resources in a Mixed Cluster", 
+                            "next_url": "/docs/configuring-resources-in-a-mixed-cluster/",

                             "parent": "Configuring Different Workloads", 
                             "previous_title": "Configuring Different Workloads", 
                             "previous_url": "/docs/configuring-different-workloads/", 
@@ -3567,56 +3525,14 @@
                                 }
                             ], 
                             "children": [], 
-                            "next_title": "Configuring Resources in a Cluster", 
-                            "next_url": "/docs/configuring-resources-in-a-cluster/", 
+                            "next_title": "Configuring Resources for a Shared Drillbit",

+                            "next_url": "/docs/configuring-resources-for-a-shared-drillbit/",

                             "parent": "Configuring Different Workloads", 
                             "previous_title": "Configuring Different Workloads Introduction",

                             "previous_url": "/docs/configuring-different-workloads-introduction/",

                             "relative_path": "_docs/manage-drill/015-configuring-drill-in-a-cluster.md",

-                            "title": "Configuring Resources in a Cluster", 
-                            "url": "/docs/configuring-resources-in-a-cluster/"
-                        }, 
-                        {
-                            "breadcrumbs": [
-                                {
-                                    "title": "Configuring Different Workloads", 
-                                    "url": "/docs/configuring-different-workloads/"
-                                }, 
-                                {
-                                    "title": "Manage Drill", 
-                                    "url": "/docs/manage-drill/"
-                                }
-                            ], 
-                            "children": [], 
-                            "next_title": "Configuring Resources for a Shared Drillbit",

-                            "next_url": "/docs/configuring-resources-for-a-shared-drillbit/",

-                            "parent": "Configuring Different Workloads", 
-                            "previous_title": "Configuring Resources in a Cluster", 
-                            "previous_url": "/docs/configuring-resources-in-a-cluster/",

-                            "relative_path": "_docs/manage-drill/015-configuring-resources-in-a-cluster.md",

-                            "title": "Configuring Resources in a Cluster", 
-                            "url": "/docs/configuring-resources-in-a-cluster/"
-                        }, 
-                        {
-                            "breadcrumbs": [
-                                {
-                                    "title": "Configuring Different Workloads", 
-                                    "url": "/docs/configuring-different-workloads/"
-                                }, 
-                                {
-                                    "title": "Manage Drill", 
-                                    "url": "/docs/manage-drill/"
-                                }
-                            ], 
-                            "children": [], 
-                            "next_title": "Configuring Resources for a Shared Drillbit",

-                            "next_url": "/docs/configuring-resources-for-a-shared-drillbit/",

-                            "parent": "Configuring Different Workloads", 
-                            "previous_title": "Configuring Resources in a Cluster", 
-                            "previous_url": "/docs/configuring-resources-in-a-cluster/",

-                            "relative_path": "_docs/manage-drill/017-configuring-a-shared-drillbit.md",

-                            "title": "Configuring Resources for a Shared Drillbit", 
-                            "url": "/docs/configuring-resources-for-a-shared-drillbit/"
+                            "title": "Configuring Resources in a Mixed Cluster", 
+                            "url": "/docs/configuring-resources-in-a-mixed-cluster/"
                         }, 
                         {
                             "breadcrumbs": [
@@ -3633,9 +3549,9 @@
                             "next_title": "Configuration Options", 
                             "next_url": "/docs/configuration-options/", 
                             "parent": "Configuring Different Workloads", 
-                            "previous_title": "Configuring Resources for a Shared Drillbit",

-                            "previous_url": "/docs/configuring-resources-for-a-shared-drillbit/",

-                            "relative_path": "_docs/manage-drill/017-configuring-resources-for-a-shared-drillbit.md",

+                            "previous_title": "Configuring Resources in a Mixed Cluster",

+                            "previous_url": "/docs/configuring-resources-in-a-mixed-cluster/",

+                            "relative_path": "_docs/manage-drill/017-configuring-a-shared-drillbit.md",

                             "title": "Configuring Resources for a Shared Drillbit", 
                             "url": "/docs/configuring-resources-for-a-shared-drillbit/"
                         }
@@ -3643,8 +3559,8 @@
                     "next_title": "Configuring Different Workloads Introduction", 
                     "next_url": "/docs/configuring-different-workloads-introduction/", 
                     "parent": "Manage Drill", 
-                    "previous_title": "Configuring Memory for Drill in a Drill cluster",

-                    "previous_url": "/docs/configuring-memory-for-drill-in-a-drill-cluster/",

+                    "previous_title": "Configuring Drill in a Dedicated Cluster", 
+                    "previous_url": "/docs/configuring-drill-in-a-dedicated-cluster/", 
                     "relative_path": "_docs/manage-drill/012-configuring-different-workloads.md",

                     "title": "Configuring Different Workloads", 
                     "url": "/docs/configuring-different-workloads/"
@@ -3837,8 +3753,8 @@
                 }
             ], 
             "children": [], 
-            "next_title": "Configuring Memory for Drill in a Drill cluster", 
-            "next_url": "/docs/configuring-memory-for-drill-in-a-drill-cluster/", 
+            "next_title": "Configuring Drill in a Dedicated Cluster", 
+            "next_url": "/docs/configuring-drill-in-a-dedicated-cluster/", 
             "parent": "Manage Drill", 
             "previous_title": "Manage Drill", 
             "previous_url": "/docs/manage-drill/", 
@@ -10970,8 +10886,8 @@
                         }
                     ], 
                     "children": [], 
-                    "next_title": "Configuring Memory for Drill in a Drill cluster", 
-                    "next_url": "/docs/configuring-memory-for-drill-in-a-drill-cluster/",

+                    "next_title": "Configuring Drill in a Dedicated Cluster", 
+                    "next_url": "/docs/configuring-drill-in-a-dedicated-cluster/", 
                     "parent": "Manage Drill", 
                     "previous_title": "Manage Drill", 
                     "previous_url": "/docs/manage-drill/", 
@@ -10992,9 +10908,9 @@
                     "parent": "Manage Drill", 
                     "previous_title": "Manage Drill Introduction", 
                     "previous_url": "/docs/manage-drill-introduction/", 
-                    "relative_path": "_docs/manage-drill/011-configuring-memory.md", 
-                    "title": "Configuring Memory for Drill in a Drill cluster", 
-                    "url": "/docs/configuring-memory-for-drill-in-a-drill-cluster/"
+                    "relative_path": "_docs/manage-drill/011-configuring-drill-in-a-dedicated-cluster.md",

+                    "title": "Configuring Drill in a Dedicated Cluster", 
+                    "url": "/docs/configuring-drill-in-a-dedicated-cluster/"
                 }, 
                 {
                     "breadcrumbs": [
@@ -11016,8 +10932,8 @@
                                 }
                             ], 
                             "children": [], 
-                            "next_title": "Configuring Resources in a Cluster", 
-                            "next_url": "/docs/configuring-resources-in-a-cluster/", 
+                            "next_title": "Configuring Resources in a Mixed Cluster", 
+                            "next_url": "/docs/configuring-resources-in-a-mixed-cluster/",

                             "parent": "Configuring Different Workloads", 
                             "previous_title": "Configuring Different Workloads", 
                             "previous_url": "/docs/configuring-different-workloads/", 
@@ -11037,56 +10953,14 @@
                                 }
                             ], 
                             "children": [], 
-                            "next_title": "Configuring Resources in a Cluster", 
-                            "next_url": "/docs/configuring-resources-in-a-cluster/", 
+                            "next_title": "Configuring Resources for a Shared Drillbit",

+                            "next_url": "/docs/configuring-resources-for-a-shared-drillbit/",

                             "parent": "Configuring Different Workloads", 
                             "previous_title": "Configuring Different Workloads Introduction",

                             "previous_url": "/docs/configuring-different-workloads-introduction/",

                             "relative_path": "_docs/manage-drill/015-configuring-drill-in-a-cluster.md",

-                            "title": "Configuring Resources in a Cluster", 
-                            "url": "/docs/configuring-resources-in-a-cluster/"
-                        }, 
-                        {
-                            "breadcrumbs": [
-                                {
-                                    "title": "Configuring Different Workloads", 
-                                    "url": "/docs/configuring-different-workloads/"
-                                }, 
-                                {
-                                    "title": "Manage Drill", 
-                                    "url": "/docs/manage-drill/"
-                                }
-                            ], 
-                            "children": [], 
-                            "next_title": "Configuring Resources for a Shared Drillbit",

-                            "next_url": "/docs/configuring-resources-for-a-shared-drillbit/",

-                            "parent": "Configuring Different Workloads", 
-                            "previous_title": "Configuring Resources in a Cluster", 
-                            "previous_url": "/docs/configuring-resources-in-a-cluster/",

-                            "relative_path": "_docs/manage-drill/015-configuring-resources-in-a-cluster.md",

-                            "title": "Configuring Resources in a Cluster", 
-                            "url": "/docs/configuring-resources-in-a-cluster/"
-                        }, 
-                        {
-                            "breadcrumbs": [
-                                {
-                                    "title": "Configuring Different Workloads", 
-                                    "url": "/docs/configuring-different-workloads/"
-                                }, 
-                                {
-                                    "title": "Manage Drill", 
-                                    "url": "/docs/manage-drill/"
-                                }
-                            ], 
-                            "children": [], 
-                            "next_title": "Configuring Resources for a Shared Drillbit",

-                            "next_url": "/docs/configuring-resources-for-a-shared-drillbit/",

-                            "parent": "Configuring Different Workloads", 
-                            "previous_title": "Configuring Resources in a Cluster", 
-                            "previous_url": "/docs/configuring-resources-in-a-cluster/",

-                            "relative_path": "_docs/manage-drill/017-configuring-a-shared-drillbit.md",

-                            "title": "Configuring Resources for a Shared Drillbit", 
-                            "url": "/docs/configuring-resources-for-a-shared-drillbit/"
+                            "title": "Configuring Resources in a Mixed Cluster", 
+                            "url": "/docs/configuring-resources-in-a-mixed-cluster/"
                         }, 
                         {
                             "breadcrumbs": [
@@ -11103,9 +10977,9 @@
                             "next_title": "Configuration Options", 
                             "next_url": "/docs/configuration-options/", 
                             "parent": "Configuring Different Workloads", 
-                            "previous_title": "Configuring Resources for a Shared Drillbit",

-                            "previous_url": "/docs/configuring-resources-for-a-shared-drillbit/",

-                            "relative_path": "_docs/manage-drill/017-configuring-resources-for-a-shared-drillbit.md",

+                            "previous_title": "Configuring Resources in a Mixed Cluster",

+                            "previous_url": "/docs/configuring-resources-in-a-mixed-cluster/",

+                            "relative_path": "_docs/manage-drill/017-configuring-a-shared-drillbit.md",

                             "title": "Configuring Resources for a Shared Drillbit", 
                             "url": "/docs/configuring-resources-for-a-shared-drillbit/"
                         }
@@ -11113,8 +10987,8 @@
                     "next_title": "Configuring Different Workloads Introduction", 
                     "next_url": "/docs/configuring-different-workloads-introduction/", 
                     "parent": "Manage Drill", 
-                    "previous_title": "Configuring Memory for Drill in a Drill cluster",

-                    "previous_url": "/docs/configuring-memory-for-drill-in-a-drill-cluster/",

+                    "previous_title": "Configuring Drill in a Dedicated Cluster", 
+                    "previous_url": "/docs/configuring-drill-in-a-dedicated-cluster/", 
                     "relative_path": "_docs/manage-drill/012-configuring-different-workloads.md",

                     "title": "Configuring Different Workloads", 
                     "url": "/docs/configuring-different-workloads/"

http://git-wip-us.apache.org/repos/asf/drill/blob/95313815/_docs/manage-drill/011-configuring-drill-in-a-dedicated-cluster.md
----------------------------------------------------------------------
diff --git a/_docs/manage-drill/011-configuring-drill-in-a-dedicated-cluster.md b/_docs/manage-drill/011-configuring-drill-in-a-dedicated-cluster.md
new file mode 100644
index 0000000..7a3fc3f
--- /dev/null
+++ b/_docs/manage-drill/011-configuring-drill-in-a-dedicated-cluster.md
@@ -0,0 +1,30 @@
+---
+title: "Configuring Drill in a Dedicated Cluster"
+parent: "Manage Drill"
+---
+
+This section describes how to configure the amount of direct memory allocated to a Drillbit
for query processing in a dedicated Drill cluster. When you use Drill in a cluster with other
workloads, configure memory as described in section, ["Configuring Resources in a Mixed Cluster"]({{site.baseurl}}/docs/configuring-resources-in-a-cluster).

+
+The default memory for a Drillbit is 8G, but Drill prefers 16G or more
+depending on the workload. The total amount of direct memory that a Drillbit
+allocates to query operations cannot exceed the limit set.
+
+Drill mainly uses Java direct memory and performs well when executing
+operations in memory instead of storing the operations on disk. Drill does not
+write to disk unless absolutely necessary, unlike MapReduce where everything
+is written to disk during each phase of a job.
+
+The JVM’s heap memory does not limit the amount of direct memory available in
+a Drillbit. The on-heap memory for Drill is only about 4-8G, which should
+suffice because Drill avoids having data sit in heap memory.
+
+## Modifying Drillbit Memory
+
+You can modify memory for each Drillbit node in your cluster. To modify the
+memory for a Drillbit, edit the `XX:MaxDirectMemorySize` parameter in the
+Drillbit startup script located in `<drill_installation_directory>/conf/drill-
+env.sh`.
+
+{% include startnote.html %}If this parameter is not set, the limit depends on the amount
of available system memory.{% include endnote.html %}
+
+After you edit `<drill_installation_directory>/conf/drill-env.sh`, [restart the Drillbit]({{
site.baseurl }}/docs/starting-stopping-drill#starting-a-drillbit) onthe node.
\ No newline at end of file

http://git-wip-us.apache.org/repos/asf/drill/blob/95313815/_docs/manage-drill/011-configuring-memory.md
----------------------------------------------------------------------
diff --git a/_docs/manage-drill/011-configuring-memory.md b/_docs/manage-drill/011-configuring-memory.md
deleted file mode 100644
index f1921d3..0000000
--- a/_docs/manage-drill/011-configuring-memory.md
+++ /dev/null
@@ -1,30 +0,0 @@
----
-title: "Configuring Memory for Drill in a Drill cluster"
-parent: "Manage Drill"
----
-
-This section describes how to configure the amount of direct memory allocated to a Drillbit
for query processing in a dedicated Drill cluster. When you use Drill in a cluster with other
workloads, configure memory as described in section, ["Configuring Resources in a Cluster"]({{site.baseurl}}/docs/configuring-resources-in-a-cluster).

-
-The default memory for a Drillbit is 8G, but Drill prefers 16G or more
-depending on the workload. The total amount of direct memory that a Drillbit
-allocates to query operations cannot exceed the limit set.
-
-Drill mainly uses Java direct memory and performs well when executing
-operations in memory instead of storing the operations on disk. Drill does not
-write to disk unless absolutely necessary, unlike MapReduce where everything
-is written to disk during each phase of a job.
-
-The JVM’s heap memory does not limit the amount of direct memory available in
-a Drillbit. The on-heap memory for Drill is only about 4-8G, which should
-suffice because Drill avoids having data sit in heap memory.
-
-## Modifying Drillbit Memory
-
-You can modify memory for each Drillbit node in your cluster. To modify the
-memory for a Drillbit, edit the `XX:MaxDirectMemorySize` parameter in the
-Drillbit startup script located in `<drill_installation_directory>/conf/drill-
-env.sh`.
-
-{% include startnote.html %}If this parameter is not set, the limit depends on the amount
of available system memory.{% include endnote.html %}
-
-After you edit `<drill_installation_directory>/conf/drill-env.sh`, [restart the Drillbit]({{
site.baseurl }}/docs/starting-stopping-drill#starting-a-drillbit) onthe node.
\ No newline at end of file

http://git-wip-us.apache.org/repos/asf/drill/blob/95313815/_docs/manage-drill/013-configuring-dfferent-workloads-introduction.md
----------------------------------------------------------------------
diff --git a/_docs/manage-drill/013-configuring-dfferent-workloads-introduction.md b/_docs/manage-drill/013-configuring-dfferent-workloads-introduction.md
index ce1f1a6..9558039 100644
--- a/_docs/manage-drill/013-configuring-dfferent-workloads-introduction.md
+++ b/_docs/manage-drill/013-configuring-dfferent-workloads-introduction.md
@@ -15,8 +15,8 @@ Drill typically runs along side other workloads, including the following:
 
 You need to plan and configure these resources for use with Drill and other workloads: 
 
-* [Memory]({{site.baseurl}}/docs/configuring-resources-in-a-cluster)  
+* [Memory]({{site.baseurl}}/docs/configuring-resources-in-a-mixed-cluster)  
 * [CPU]({{site.baseurl}}/docs/configuring-drill-in-a-cluster#how-to-manage-drill-cpu-resources)
 
 * Disk  
 
-["How to Run Drill in a Cluster"]({{site.baseurl}}/docs/how-to-run-drill-in-a-cluster) covers
configuration for sharing a drillbit and ["How Multiple Users Share a Drillbit"]({{site.baseurl}}/docs/how-multiple-users-share-a-drillbit)
covers configuration for Drillbits running on different nodes in the cluster.
\ No newline at end of file
+Configure, memory, queues, and parallelization ["when users share a Drillbit"]({{site.baseurl}}/docs/configuring-resources-for-a-shared-drillbit)
covers configuration for Drillbits running on different nodes in the cluster.
\ No newline at end of file

http://git-wip-us.apache.org/repos/asf/drill/blob/95313815/_docs/manage-drill/015-configuring-drill-in-a-cluster.md
----------------------------------------------------------------------
diff --git a/_docs/manage-drill/015-configuring-drill-in-a-cluster.md b/_docs/manage-drill/015-configuring-drill-in-a-cluster.md
index 4ec1cf4..a5c124b 100644
--- a/_docs/manage-drill/015-configuring-drill-in-a-cluster.md
+++ b/_docs/manage-drill/015-configuring-drill-in-a-cluster.md
@@ -1,10 +1,10 @@
 ---
-title: "Configuring Resources in a Cluster"
+title: "Configuring Resources in a Mixed Cluster"
 parent: "Configuring Different Workloads"
 ---
 Drill operations are memory and CPU-intensive. You need to statically partition the cluster
to designate which partition handles which workload. 
 
-## Configuring Drill Memory in a Cluster with other Workloads
+## Configuring Drill Memory in a Mixed Cluster
 
 To configure memory resources for Drill, you modify the `warden.drill-bits.conf` file in
`/opt/mapr/conf/conf.d`. This file is created automatically when you install Drill on a node.

 
@@ -65,16 +65,6 @@ You configure memory for each service by setting three values in `warden.conf`.
     service.command.<servicename>.heapsize.max
     service.command.<servicename>.heapsize.min
 
-### Drill Memory
-You can configure the amount of direct memory allocated to a Drillbit for
-query processing, as described in the section, ["Configuring Memory"](({{site.baseurl}}/docs/configuring-memory).
-
-### Memory in a MapR Cluster
-Memory and disk for Drill and other services that are not associated with roles on a MapR
cluster are shared with other services. You manage the chunk of memory for these services
in os heap settings in `warden.conf` and in configuration files of the particular service.
The warden os heap settings are:
-
-    service.command.os.heapsize.percent
-    service.command.os.heapsize.max
-    service.command.os.heapsize.min
 
 For more information about managing memory in a MapR cluster, see the following sections
in the MapR documentation:
 * [Memory Allocation for Nodes](http://doc.mapr.com/display/MapR40x/Memory+Allocation+for+Nodes)

http://git-wip-us.apache.org/repos/asf/drill/blob/95313815/_docs/manage-drill/015-configuring-resources-in-a-cluster.md
----------------------------------------------------------------------
diff --git a/_docs/manage-drill/015-configuring-resources-in-a-cluster.md b/_docs/manage-drill/015-configuring-resources-in-a-cluster.md
deleted file mode 100644
index 7995278..0000000
--- a/_docs/manage-drill/015-configuring-resources-in-a-cluster.md
+++ /dev/null
@@ -1,78 +0,0 @@
----
-title: "Configuring Resources in a Cluster"
-parent: "Configuring Different Workloads"
----
-Drill operations are memory and CPU-intensive. You need to statically partition the cluster
to designate which partition handles which workload. 
-
-To reserve memory resources for Drill, you modify the `warden.drill-bits.conf` file in `/opt/mapr/conf/conf.d`.
This file is created automatically when you install Drill on a node. 
-
-    [root@centos23 conf.d]# pwd
-    /opt/mapr/conf/conf.d
-    [root@centos23 conf.d]# ls
-    warden.drill-bits.conf  warden.nodemanager.conf  warden.resourcemanager.conf
-
-You add the following lines to the file:
-
-    service.heapsize.min=<some value in MB>
-    service.heapsize.max=<some value in MB>
-    service.heapsize.percent=<some whole number value>
-
-## Configuring Drill in a YARN-enabled MapR Cluster
-
-For example, you have 120G of available memory that you allocate to following workloads in
a Yarn-enabled cluster:
-
-File system = 20G  
-HBase = 20G  
-Yarn = 20G  
-OS = 8G  
-
-To add Drill to the cluster, how do you change memory allocation? It depends on your application.
If Yarn does most of the work, give Drill 20G, for example, and give Yarn 60G. If you expect
a heavy query load, give Drill 60G and Drill 20G.
-
-{% include startnote.html %}Drill will execute queries within Yarn soon.{% include endnote.html
%} [DRILL-142](https://issues.apache.org/jira/browse/DRILL-142)
-
-<!-- YARN consists of 2 main services ResourceManager(one instance in cluster, more if
HA is configured) and NodeManager(one instance per node). See mr1.memory.percent, mr1.cpu.percent
and 
-mr1.disk.percent in warden.conf. Rest is given to YARN applications.
-Also see /opt/mapr/conf/conf.d/warden.resourcemanager.conf and
- /opt/mapr/conf/conf.d/warden.nodemanager.conf for resources given to ResourceManager and
NodeManager respectively.
-
-## Configuring Drill in a MapReduce V1-enabled cluster
-
-Similar files exist for other installed services, as described in [MapR documentation](http://doc.mapr.com/display/MapR/warden.%3Cservicename%3E.conf).
For example:
-## What are the memory/resource configurations set in warden in a non-YARN cluster? 
-
-Every service will have 3 values defined in warden.conf (/opt/mapr/conf)
-service.command.<servicename>.heapsize.percent
-service.command.<servicename>.heapsize.max
-service.command.<servicename>.heapsize.min
-This is percentage of memory for that service bounded by min and max values.
-
-There will also be additional files in /opt/mapr/conf/conf.d in format 
-warden.<servicename>.conf. They will have entries like
-service.heapsize.min
-service.heapsize.max
-service.heapsize.percent -->
-
-## Managing Memory
-
-To run Drill in a cluster with MapReduce, HBase, Spark, and other workloads, manage memory
according to your application needs. 
-
-To run Drill in a MapR cluster, allocate memory by configuring settings in warden.conf, as
described in the [MapR documentation]().
-
-### Drill Memory
-You can configure the amount of direct memory allocated to a Drillbit for
-query processing, as described in the section, ["Configuring Memory"](({{site.baseurl}}/docs/configuring-memory).
-
-### Memory in a MapR Cluster
-Memory and disk for Drill and other services that are not associated with roles on a MapR
cluster are shared with other services. You manage the chunk of memory for these services
in os heap settings in `warden.conf` and in configuration files of the particular service.
The warden os heap settings are:
-
-    service.command.os.heapsize.percent
-    service.command.os.heapsize.max
-    service.command.os.heapsize.min
-
-For more information about managing memory in a MapR cluster, see the following sections
in the MapR documentation:
-* [Memory Allocation for Nodes](http://doc.mapr.com/display/MapR40x/Memory+Allocation+for+Nodes)
-* [Cluster Resource Allocation](http://doc.mapr.com/display/MapR40x/Cluster+Resource+Allocation)
-* [Customizing Memory Settings for MapReduce v1](http://doc.mapr.com/display/MapR40x/Customize+Memory+Settings+for+MapReduce+v1)
-
-## How to Manage Drill CPU Resources
-Currently, you do not manage CPU resources within Drill. [Use Linux `cgroups`](http://en.wikipedia.org/wiki/Cgroups)
to manage the CPU resources.
\ No newline at end of file

http://git-wip-us.apache.org/repos/asf/drill/blob/95313815/_docs/manage-drill/017-configuring-resources-for-a-shared-drillbit.md
----------------------------------------------------------------------
diff --git a/_docs/manage-drill/017-configuring-resources-for-a-shared-drillbit.md b/_docs/manage-drill/017-configuring-resources-for-a-shared-drillbit.md
deleted file mode 100644
index 7ffe0b7..0000000
--- a/_docs/manage-drill/017-configuring-resources-for-a-shared-drillbit.md
+++ /dev/null
@@ -1,65 +0,0 @@
----
-title: "Configuring Resources for a Shared Drillbit"
-parent: "Configuring Different Workloads"
----
-To manage a cluster in which multiple users share a Drillbit, you configure Drill queuing
and parallelization.
-
-##Configuring Drill Query Queuing
-
-Set [options in sys.options]({{site.baseurl}}/docs/configuration-options-introduction/) to
enable and manage query queuing, which is turned off by default. There are two types of queues:
large and small. You configure a maximum number of queries that each queue allows by configuring
the following options in the `sys.options` table:
-
-* exec.queue.large  
-* exec.queue.small  
-
-### Example Configuration
-
-For example, you configure the queue reserved for large queries to hold a 5-query maximum.
You configure the queue reserved for small queries to hold 20 queries. Users start to run
queries, and Drill receives the following query requests in this order:
-
-* Query A (blue): 1 billion records, Drill estimates 10 million rows will be processed  
-* Query B (red): 2 billion records, Drill estimates 20 million rows will be processed  
-* Query C: 1 billion records  
-* Query D: 100 records
-
-The exec.queue.threshold default is 30 million, which is the estimated rows to be processed
by the query. Queries A and B are queued in the large queue. The estimated rows to be processed
reaches the 30 million threshold, filling the queue to capacity. The query C request arrives
and goes on the wait list, and then query D arrives. Query D is queued immediately in the
small queue because of its small size, as shown in the following diagram: 
-
-![drill queuing]({{ site.baseurl }}/docs/img/queuing.png)
-
-The Drill queuing configuration in this example tends to give many users running small queries
a rapid response. Users running a large query might experience some delay until an earlier-received
large query returns, freeing space in the large queue to process queries that are waiting.
-
-## Controlling Parallelization
-
-By default, Drill parallelizes operations when number of records manipulated within a fragment
reaches 100,000. When parallelization of operations is high, the cluster operates as fast
as possible, which is fine for a single user. In a contentious multi-tenant situation, however,
you need to reduce parallelization to levels based on user needs.
-
-### Parallelization Configuration Procedure
-
-To configure parallelization, configure the following options in the `sys.options` table:
-
-* `planner.width.max.per.node`  
-  The maximum degree of distribution of a query across cores and cluster nodes.
-* `planner.width.max.per.query`  
-  Same as max per node but applies to the query as executed by the entire cluster.
-
-Configure the `planner.width.max.per.node` to achieve fine grained, absolute control over
parallelization. 
-
-<!-- ??For example, setting the `planner.width.max.per.query` to 60 will not accelerate
Drill operations because overlapping does not occur when executing 60 queries at the same
time.??
-
-### Example of Configuring Parallelization
-
-For example, the default settings parallelize 70 percent of operations up to 1,000 cores.
If you have 30 cores per node in a 10-node cluster, or 300 cores, parallelization occurs on
approximately 210 cores. Consequently, a single user can get 70 percent usage from a cluster
and no more due to the constraints configured by the `planner.width.max.per.query`.
-
-A parallelizer in the Foreman transforms the physical plan into multiple phases. A complicated
query can have multiple, major fragments. A default parallelization of 70 percent of operations
allows some overlap of query phases. In the example, 210 ??for each core or major fragment
to a maximum of 410??.
-
-??Drill uses pipelines, blocking/nonblocking, memory is not fungible. CPU resources are fungible.
There is contention for CPUs.?? -->
-
-## Data Isolation
-
-Tenants can share data on a cluster using Drill views and impersonation. ??Link to impersonation
doc.??
-
-
-
-
-
-
-
-
-


Mime
View raw message