Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id BD807200CE7 for ; Fri, 18 Aug 2017 00:51:55 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id BBBEB16BFA6; Thu, 17 Aug 2017 22:51:55 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 0D1D916BFA3 for ; Fri, 18 Aug 2017 00:51:54 +0200 (CEST) Received: (qmail 8770 invoked by uid 500); 17 Aug 2017 22:51:54 -0000 Mailing-List: contact commits-help@drill.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: commits@drill.apache.org Delivered-To: mailing list commits@drill.apache.org Received: (qmail 8761 invoked by uid 99); 17 Aug 2017 22:51:54 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 17 Aug 2017 22:51:54 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 13A2FDFDDD; Thu, 17 Aug 2017 22:51:54 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: bridgetb@apache.org To: commits@drill.apache.org Message-Id: <598e8ed1d88d43bb98328a0f644357c3@git.apache.org> X-Mailer: ASF-Git Admin Mailer Subject: drill-site git commit: minor edit Date: Thu, 17 Aug 2017 22:51:54 +0000 (UTC) archived-at: Thu, 17 Aug 2017 22:51:55 -0000 Repository: drill-site Updated Branches: refs/heads/asf-site 7ecab1e6e -> e3d8bad1b minor edit Project: http://git-wip-us.apache.org/repos/asf/drill-site/repo Commit: http://git-wip-us.apache.org/repos/asf/drill-site/commit/e3d8bad1 Tree: http://git-wip-us.apache.org/repos/asf/drill-site/tree/e3d8bad1 Diff: http://git-wip-us.apache.org/repos/asf/drill-site/diff/e3d8bad1 Branch: refs/heads/asf-site Commit: e3d8bad1bee6b57e43da969f843218150754d3b3 Parents: 7ecab1e Author: Bridget Bevens Authored: Thu Aug 17 15:51:38 2017 -0700 Committer: Bridget Bevens Committed: Thu Aug 17 15:51:38 2017 -0700 ---------------------------------------------------------------------- docs/configuration-options-introduction/index.html | 2 +- .../index.html | 2 +- feed.xml | 4 ++-- 3 files changed, 4 insertions(+), 4 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/drill-site/blob/e3d8bad1/docs/configuration-options-introduction/index.html ---------------------------------------------------------------------- diff --git a/docs/configuration-options-introduction/index.html b/docs/configuration-options-introduction/index.html index 2808872..6be9503 100644 --- a/docs/configuration-options-introduction/index.html +++ b/docs/configuration-options-introduction/index.html @@ -1414,7 +1414,7 @@ planner.memory.max_query_memory_per_node 2147483648 bytes -Sets the maximum amount of direct memory allocated to the Sort and Hash Aggregate operators during each query on a node. This memory is split between operators. If a query plan contains multiple Sort and/or Hash Aggregate operators, the memory is divided between them. The default setting is very conservative. +Sets the maximum amount of direct memory allocated to the Sort and Hash Aggregate operators during each query on a node. This memory is split between operators. If a query plan contains multiple Sort and/or Hash Aggregate operators, the memory is divided between them. The default setting is too small for queries on large data sets and should be increased. planner.memory.non_blocking_operators_memory http://git-wip-us.apache.org/repos/asf/drill-site/blob/e3d8bad1/docs/sort-based-and-hash-based-memory-constrained-operators/index.html ---------------------------------------------------------------------- diff --git a/docs/sort-based-and-hash-based-memory-constrained-operators/index.html b/docs/sort-based-and-hash-based-memory-constrained-operators/index.html index fd10d3b..c1d1a67 100644 --- a/docs/sort-based-and-hash-based-memory-constrained-operators/index.html +++ b/docs/sort-based-and-hash-based-memory-constrained-operators/index.html @@ -1140,7 +1140,7 @@

Memory Options

The planner.memory.max_query_memory_per_node option sets the maximum amount of direct memory allocated to the Sort and Hash Aggregate operators during each query on a node. The default limit is 2147483648 bytes (2GB), which is quite conservative. This memory is split between operators. If a query plan contains multiple Sort and/or Hash Aggregate operators, the memory is divided between them.

The planner.memory.max_query_memory_per_node option sets the maximum amount of direct memory allocated to the Sort and Hash Aggregate operators during each query on a node. The default limit is set to 2147483648 bytes (2GB), which is too small for queries on large data sets and should be increased. This memory is split between operators. If a query plan contains multiple Sort and/or Hash Aggregate operators, the memory is divided between them.

When a query is parallelized, the number of operators is multiplied, which reduces the amount of memory given to each instance of the Sort and Hash Aggregate operators during a query. If you encounter memory issues when running queries with Sort and Hash Aggregate operators, calculate the memory requirements for your queries and the amount of available memory on each node. Based on the information, increase the value of the planner.memory.max_query_memory_per_node option using the ALTER SYSTEM|SESSION SET command, as shown:

ALTER SYSTEM|SESSION SET `planner.memory.max_query_memory_per_node` = <new_value>  

http://git-wip-us.apache.org/repos/asf/drill-site/blob/e3d8bad1/feed.xml
----------------------------------------------------------------------
diff --git a/feed.xml b/feed.xml
index 764491a..ed03ac0 100644
--- a/feed.xml
+++ b/feed.xml
@@ -6,8 +6,8 @@
 
     /
     
-    Thu, 17 Aug 2017 14:50:10 -0700
-    Thu, 17 Aug 2017 14:50:10 -0700
+    Thu, 17 Aug 2017 15:49:16 -0700
+    Thu, 17 Aug 2017 15:49:16 -0700
     Jekyll v2.5.2