From commits-return-22022-archive-asf-public=cust-asf.ponee.io@accumulo.apache.org Thu Aug 2 19:40:02 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 45128180629 for ; Thu, 2 Aug 2018 19:40:02 +0200 (CEST) Received: (qmail 751 invoked by uid 500); 2 Aug 2018 17:40:01 -0000 Mailing-List: contact commits-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@accumulo.apache.org Delivered-To: mailing list commits@accumulo.apache.org Received: (qmail 741 invoked by uid 99); 2 Aug 2018 17:40:01 -0000 Received: from ec2-52-202-80-70.compute-1.amazonaws.com (HELO gitbox.apache.org) (52.202.80.70) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Aug 2018 17:40:01 +0000 Received: by gitbox.apache.org (ASF Mail Server at gitbox.apache.org, from userid 33) id BE346825A8; Thu, 2 Aug 2018 17:40:00 +0000 (UTC) Date: Thu, 02 Aug 2018 17:40:00 +0000 To: "commits@accumulo.apache.org" Subject: [accumulo-website] branch asf-site updated: Jekyll build from master:7b25602 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Message-ID: <153323160070.31760.14285262051705180890@gitbox.apache.org> From: kturner@apache.org X-Git-Host: gitbox.apache.org X-Git-Repo: accumulo-website X-Git-Refname: refs/heads/asf-site X-Git-Reftype: branch X-Git-Oldrev: 54a667fd67dd1375037425f781adeddc60c8d28c X-Git-Newrev: 5545c5d2d3da047c91f5dc36e43fc0a5151fedaf X-Git-Rev: 5545c5d2d3da047c91f5dc36e43fc0a5151fedaf X-Git-NotificationType: ref_changed_plus_diff X-Git-Multimail-Version: 1.5.dev Auto-Submitted: auto-generated This is an automated email from the ASF dual-hosted git repository. kturner pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/accumulo-website.git The following commit(s) were added to refs/heads/asf-site by this push: new 5545c5d Jekyll build from master:7b25602 5545c5d is described below commit 5545c5d2d3da047c91f5dc36e43fc0a5151fedaf Author: Keith Turner AuthorDate: Thu Aug 2 13:39:29 2018 -0400 Jekyll build from master:7b25602 Add docs for scan execution hints apache/accumulo#571 (#100) --- docs/2.0/administration/scan-executors.html | 37 ++++++++++++++++++++++++++--- feed.xml | 4 ++-- redirects.json | 2 +- search_data.json | 2 +- 4 files changed, 38 insertions(+), 7 deletions(-) diff --git a/docs/2.0/administration/scan-executors.html b/docs/2.0/administration/scan-executors.html index 36a9a58..99756b2 100644 --- a/docs/2.0/administration/scan-executors.html +++ b/docs/2.0/administration/scan-executors.html @@ -374,7 +374,7 @@ tserver.scan.executors.<name>.prioritizer.opts.<key>=<value>

After creating an executor, configure table.scan.dispatcher to use it. A dispatcher is Java subclass of ScanDispatcher -that decides which scan executor should service a table. Set the following table +that decides which scan executor should service a table. Set the following table property to configure a dispatcher.

table.scan.dispatcher=<class name>
@@ -413,12 +413,15 @@ config -s tserver.scan.executors.high.threads=8
 
 
Tablet servers should be restarted after configuring scan executors, then tables can be configured.

 
-
config -t LOW1 -s table.scan.dispatcher.opts.executor=low
+
config -t LOW1 -s table.scan.dispatcher=org.apache.accumulo.core.spi.scan.SimpleScanDispatcher
+config -t LOW1 -s table.scan.dispatcher.opts.executor=low
+config -t LOW2 -s table.scan.dispatcher=org.apache.accumulo.core.spi.scan.SimpleScanDispatcher
 config -t LOW2 -s table.scan.dispatcher.opts.executor=low
+config -t HIGH -s table.scan.dispatcher=org.apache.accumulo.core.spi.scan.SimpleScanDispatcher
 config -t HIGH -s table.scan.dispatcher.opts.executor=high
 

 
-
While not necessary because its the default, it would be safer to also set
+
While not necessary because its the default, it is safer to also set
 table.scan.dispatcher=org.apache.accumulo.core.spi.scan.SimpleScanDispatcher
 for each table.  This ensures things work as expected in the case where
 table.scan.dispatcher was set at the system or namespace level.

@@ -441,6 +444,34 @@ executor.

 threads repeatedly doing small random lookups made a significant difference.
 In this test the average lookup time for the 5 threads went from 250ms to 5 ms.

 
+
Providing hints from the client side.

+
+
Scanners can provide hints to ScanDispatchers and ScanPriotizers by calling
+setExecutionHints on the Scanner.  What, if anything, is done with these
+hints depends on what is configured for the table and system.  Accumulo’s
+default configuration ignores hints. The following shell commands make it
+possible to choose an executor and set priorities from a scanner for the
+table tex.

+
+
config -s tserver.scan.executors.special.threads=8
+config -s tserver.scan.executors.special.prioritizer=org.apache.accumulo.core.spi.scan.HintScanPrioritizer
+createtable tex
+config -t tex -s table.scan.dispatcher=org.apache.accumulo.core.spi.scan.SimpleScanDispatcher
+config -t tex -s table.scan.dispatcher.opts.heed_hints=true
+

+
+
The HintScanPrioritizer honors
+hints of the form priority=<integer> to prioritize scans, with lower integers
+resulting in a higher priority. The SimpleScanDispatcher, which is the
+default dispatcher, supports the heed_hints option. By default the
+SimpleScanDispatcher ignores hints, but when heed_hints is set to true it
+will honor hints of the form executor=<executor name> when choosing an
+executor. After restarting tservers, the following command will start a scan
+that uses the executor special with a priority of 3.

+
+
scan -t tex --execution-hints priority=3,executor=special
+

+
 
 
     

diff --git a/feed.xml b/feed.xml
index 7e4737f..936cb97 100644
--- a/feed.xml
+++ b/feed.xml
@@ -6,8 +6,8 @@
 
     https://accumulo.apache.org/
     
-    Wed, 25 Jul 2018 09:24:49 -0400
-    Wed, 25 Jul 2018 09:24:49 -0400
+    Thu, 02 Aug 2018 13:39:23 -0400
+    Thu, 02 Aug 2018 13:39:23 -0400
     Jekyll v3.7.3
     
     
diff --git a/redirects.json b/redirects.json
index 2ec52c0..580f60e 100644
--- a/redirects.json
+++ b/redirects.json
@@ -1 +1 @@
-{"/release_notes/1.5.1.html":"https://accumulo.apache.org/release/accumulo-1.5.1/","/release_notes/1.6.0.html":"https://accumulo.apache.org/release/accumulo-1.6.0/","/release_notes/1.6.1.html":"https://accumulo.apache.org/release/accumulo-1.6.1/","/release_notes/1.6.2.html":"https://accumulo.apache.org/release/accumulo-1.6.2/","/release_notes/1.7.0.html":"https://accumulo.apache.org/release/accumulo-1.7.0/","/release_notes/1.5.3.html":"https://accumulo.apache.org/release/accumulo-1.5.3/" [...]
\ No newline at end of file
+{"/release_notes/1.5.1.html":"https://accumulo.apache.org/release/accumulo-1.5.1/","/release_notes/1.6.0.html":"https://accumulo.apache.org/release/accumulo-1.6.0/","/release_notes/1.6.1.html":"https://accumulo.apache.org/release/accumulo-1.6.1/","/release_notes/1.6.2.html":"https://accumulo.apache.org/release/accumulo-1.6.2/","/release_notes/1.7.0.html":"https://accumulo.apache.org/release/accumulo-1.7.0/","/release_notes/1.5.3.html":"https://accumulo.apache.org/release/accumulo-1.5.3/" [...]
\ No newline at end of file
diff --git a/search_data.json b/search_data.json
index 588cb58..b844660 100644
--- a/search_data.json
+++ b/search_data.json
@@ -65,7 +65,7 @@
   
     "docs-2-0-administration-scan-executors": {
       "title": "Scan Executors",
-      "content"	 : "Accumulo scans operate by repeatedly fetching batches of data from a tabletserver.  On the tablet server side, a thread pool fetches batches.In Java threads pools are called executors.  By default, a single executor pertablet server handles all scans in FIFO order.  For some workloads, the singleFIFO executor is suboptimal.  For example, consider many unimportant scansreading lots of data mixed with a few important scans reading small amounts ofdata.  The long scans n [...]
+      "content"	 : "Accumulo scans operate by repeatedly fetching batches of data from a tabletserver.  On the tablet server side, a thread pool fetches batches.In Java threads pools are called executors.  By default, a single executor pertablet server handles all scans in FIFO order.  For some workloads, the singleFIFO executor is suboptimal.  For example, consider many unimportant scansreading lots of data mixed with a few important scans reading small amounts ofdata.  The long scans n [...]
       "url": " /docs/2.0/administration/scan-executors",
       "categories": "administration"
     },