drill-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From bridg...@apache.org
Subject svn commit: r1673272 - in /drill/site/trunk/content/drill: docs/data-type-conversion/index.html docs/mapr-db-format/index.html docs/math-and-trig/index.html docs/overview/index.html docs/sql-functions/index.html feed.xml
Date Mon, 13 Apr 2015 20:20:51 GMT
Author: bridgetb
Date: Mon Apr 13 20:20:50 2015
New Revision: 1673272

URL: http://svn.apache.org/r1673272
Log:
DRILL-2720: SQL functions doc review comments, config options doc

Modified:
    drill/site/trunk/content/drill/docs/data-type-conversion/index.html
    drill/site/trunk/content/drill/docs/mapr-db-format/index.html
    drill/site/trunk/content/drill/docs/math-and-trig/index.html
    drill/site/trunk/content/drill/docs/overview/index.html
    drill/site/trunk/content/drill/docs/sql-functions/index.html
    drill/site/trunk/content/drill/feed.xml

Modified: drill/site/trunk/content/drill/docs/data-type-conversion/index.html
URL: http://svn.apache.org/viewvc/drill/site/trunk/content/drill/docs/data-type-conversion/index.html?rev=1673272&r1=1673271&r2=1673272&view=diff
==============================================================================
--- drill/site/trunk/content/drill/docs/data-type-conversion/index.html (original)
+++ drill/site/trunk/content/drill/docs/data-type-conversion/index.html Mon Apr 13 20:20:50
2015
@@ -77,14 +77,14 @@
 
 <h2 id="cast">CAST</h2>
 
-<p>The CAST function converts an entity having a single data value, such as a column
name, from one type to another.</p>
+<p>The CAST function converts an expression from one type to another.</p>
 
 <h3 id="syntax">Syntax</h3>
 <div class="highlight"><pre><code class="language-text" data-lang="text">cast
(&lt;expression&gt; AS &lt;data type&gt;)
 </code></pre></div>
 <p><em>expression</em></p>
 
-<p>An entity that evaluates to one or more values, such as a column name or literal</p>
+<p>A combination of one or more values, operators, and SQL functions that evaluate
to a value</p>
 
 <p><em>data type</em></p>
 
@@ -529,12 +529,8 @@ FROM tmp.`json2parquet2`;
 +------------+
 1 row selected (1.199 seconds)
 </code></pre></div></li>
-<li><p>Configure the default time zone format in the drill-override.conf. For
example:</p>
-<div class="highlight"><pre><code class="language-text" data-lang="text">drill.exec:
{
-  cluster-id: “xyz&quot;,
-  zk.connect: “abc:5181&quot;,
-  user.timezone: &quot;UTC&quot;
-}
+<li><p>Configure the default time zone format in <drill installation directory>/conf/drill-env.sh
by adding <code>-Duser.timezone=UTC</code> to DRILL_JAVA_OPTS. For example:</p>
+<div class="highlight"><pre><code class="language-text" data-lang="text">export
DRILL_JAVA_OPTS=&quot;-Xms1G -Xmx$DRILL_MAX_HEAP -XX:MaxDirectMemorySize=$DRILL_MAX_DIRECT_MEMORY
-XX:MaxPermSize=512M -XX:ReservedCodeCacheSize=1G -ea -Duser.timezone=UTC&quot;
 </code></pre></div></li>
 <li><p>Restart sqlline.</p></li>
 <li><p>Confirm that Drill is now set to UTC:</p>
@@ -592,7 +588,7 @@ use in your Drill queries as described i
 </tr>
 </tbody></table>
 
-<p>Use the ‘z’ option to identify the time zone in TO_TIMESTAMP to make sure
the timestamp has the timezone in it. Also, use the ‘z’ option to identify the time
zone in a timestamp using the TO_CHAR function. For example:</p>
+<p>You can use the ‘z’ option to identify the time zone in TO_TIMESTAMP to
make sure the timestamp has the timezone in it. Also, use the ‘z’ option to identify
the time zone in a timestamp using the TO_CHAR function. For example:</p>
 <div class="highlight"><pre><code class="language-text" data-lang="text">SELECT
TO_TIMESTAMP(&#39;2015-03-30 20:49:59.0 UTC&#39;, &#39;YYYY-MM-dd HH:mm:ss.s z&#39;)
AS Original, 
        TO_CHAR(TO_TIMESTAMP(&#39;2015-03-30 20:49:59.0 UTC&#39;, &#39;YYYY-MM-dd
HH:mm:ss.s z&#39;), &#39;z&#39;) AS TimeZone 
        FROM sys.version;

Modified: drill/site/trunk/content/drill/docs/mapr-db-format/index.html
URL: http://svn.apache.org/viewvc/drill/site/trunk/content/drill/docs/mapr-db-format/index.html?rev=1673272&r1=1673271&r2=1673272&view=diff
==============================================================================
--- drill/site/trunk/content/drill/docs/mapr-db-format/index.html (original)
+++ drill/site/trunk/content/drill/docs/mapr-db-format/index.html Mon Apr 13 20:20:50 2015
@@ -67,7 +67,7 @@
 
 </div>
 
-<div class="int_text" align="left"><p>Drill includes a <code>maprdb</code>
format plugin for handling MapR-DB and HBase data. The Drill Sandbox also includes the following
<code>maprdb</code> format plugin on a MapR node:</p>
+<div class="int_text" align="left"><p>Drill includes a <code>maprdb</code>
format plugin for accessing data stored in MapR-DB. The Drill Sandbox also includes the following
<code>maprdb</code> format plugin on a MapR node:</p>
 <div class="highlight"><pre><code class="language-text" data-lang="text">{
   &quot;type&quot;: &quot;hbase&quot;,
   &quot;config&quot;: {

Modified: drill/site/trunk/content/drill/docs/math-and-trig/index.html
URL: http://svn.apache.org/viewvc/drill/site/trunk/content/drill/docs/math-and-trig/index.html?rev=1673272&r1=1673271&r2=1673272&view=diff
==============================================================================
--- drill/site/trunk/content/drill/docs/math-and-trig/index.html (original)
+++ drill/site/trunk/content/drill/docs/math-and-trig/index.html Mon Apr 13 20:20:50 2015
@@ -227,7 +227,7 @@
 
 <p>Examples in this section use the <code>input2.json</code> file. Download
the <code>input2.json</code> file from the <a href="https://github.com/apache/drill/tree/master/exec/java-exec/src/test/resources/jsoninput">Drill
source code</a> page. </p>
 
-<p>You need to use a FROM clause in Drill queries. This document often uses the sys.version
table in the FROM clause of the query for example purposes.</p>
+<p>You need to use a FROM clause in Drill queries. In addition to using <code>input2.json</code>,
examples in this documentation often use <code>FROM sys.version</code> in the
query for example purposes.</p>
 
 <h4 id="abs-example">ABS Example</h4>
 

Modified: drill/site/trunk/content/drill/docs/overview/index.html
URL: http://svn.apache.org/viewvc/drill/site/trunk/content/drill/docs/overview/index.html?rev=1673272&r1=1673271&r2=1673272&view=diff
==============================================================================
--- drill/site/trunk/content/drill/docs/overview/index.html (original)
+++ drill/site/trunk/content/drill/docs/overview/index.html Mon Apr 13 20:20:50 2015
@@ -67,7 +67,7 @@
 
 </div>
 
-<div class="int_text" align="left"><p>The sys.options table in Drill contains
information about boot and system options described in the following tables. You configure
some of the options to tune performance. You can configure the options using the ALTER SESSION
or ALTER SYSTEM command.</p>
+<div class="int_text" align="left"><p>The sys.options table in Drill contains
information about boot and system options listed in the following tables. To tune performance,
you adjust some of the options to suit your application. Configure the options using the ALTER
SESSION or ALTER SYSTEM command.</p>
 
 <h2 id="boot-options">Boot Options</h2>
 
@@ -75,7 +75,7 @@
   <tr>
     <th>Name</th>
     <th>Default</th>
-    <th>Description</th>
+    <th>Comments</th>
   </tr>
   <tr>
     <td>drill.exec.buffer.impl</td>
@@ -193,9 +193,9 @@
 
 <table>
   <tr>
-    <th>name</th>
+    <th>Name</th>
     <th>Default</th>
-    <th>Description</th>
+    <th>Comments</th>
   </tr>
   <tr>
     <td>drill.exec.functions.cast_empty_string_to_null</td>
@@ -205,12 +205,7 @@
   <tr>
     <td>drill.exec.storage.file.partition.column.label</td>
     <td>dir</td>
-    <td></td>
-  </tr>
-  <tr>
-    <td>drill.exec.testing.exception-injections</td>
-    <td></td>
-    <td></td>
+    <td>Accepts a string input.</td>
   </tr>
   <tr>
     <td>exec.errors.verbose</td>
@@ -220,27 +215,27 @@
   <tr>
     <td>exec.java_compiler</td>
     <td>DEFAULT</td>
-    <td></td>
+    <td>Switches between DEFAULT, JDK, and JANINO mode for the current session. Uses
Janino by default for generated source code of less than exec.java_compiler_janino_maxsize;
otherwise, switches to the JDK compiler.</td>
   </tr>
   <tr>
     <td>exec.java_compiler_debug</td>
     <td>TRUE</td>
-    <td></td>
+    <td>Toggles the output of debug-level compiler error messages in runtime generated
code.</td>
   </tr>
   <tr>
     <td>exec.java_compiler_janino_maxsize</td>
     <td>262144</td>
-    <td></td>
+    <td>See the exec.java_compiler option comment. Accepts inputs of type LONG.</td>
   </tr>
   <tr>
     <td>exec.max_hash_table_size</td>
     <td>1073741824</td>
-    <td>Starting size for hash tables. Increase according to available memory to improve
performance.</td>
+    <td>Ending size for hash tables. Range: 0 - 1073741824</td>
   </tr>
   <tr>
     <td>exec.min_hash_table_size</td>
     <td>65536</td>
-    <td></td>
+    <td>Starting size for hash tables. Increase according to available memory to improve
performance. Range: 0 - 1073741824</td>
   </tr>
   <tr>
     <td>exec.queue.enable</td>
@@ -250,27 +245,22 @@
   <tr>
     <td>exec.queue.large</td>
     <td>10</td>
-    <td></td>
+    <td>Range: 0-1000</td>
   </tr>
   <tr>
     <td>exec.queue.small</td>
     <td>100</td>
-    <td></td>
+    <td>Range: 0-1001</td>
   </tr>
   <tr>
     <td>exec.queue.threshold</td>
     <td>30000000</td>
-    <td></td>
+    <td>Range: 0-9223372036854775807</td>
   </tr>
   <tr>
     <td>exec.queue.timeout_millis</td>
     <td>300000</td>
-    <td></td>
-  </tr>
-  <tr>
-    <td>org.apache.drill.exec.compile.ClassTransformer.scalar_replacement</td>
-    <td>try</td>
-    <td></td>
+    <td>Range: 0-9223372036854775807</td>
   </tr>
   <tr>
     <td>planner.add_producer_consumer</td>
@@ -280,7 +270,7 @@
   <tr>
     <td>planner.affinity_factor</td>
     <td>1.2</td>
-    <td></td>
+    <td>Accepts inputs of type DOUBLE.</td>
   </tr>
   <tr>
     <td>planner.broadcast_factor</td>
@@ -290,22 +280,22 @@
   <tr>
     <td>planner.broadcast_threshold</td>
     <td>10000000</td>
-    <td></td>
+    <td>Threshold in number of rows that triggers a broadcast join for a query if the
right side of the join contains fewer rows than the threshold. Avoids broadcasting too many
rows to join. Range: 0-2147483647</td>
   </tr>
   <tr>
     <td>planner.disable_exchanges</td>
     <td>FALSE</td>
-    <td></td>
+    <td>Toggles the state of hashing to a random exchange.</td>
   </tr>
   <tr>
     <td>planner.enable_broadcast_join</td>
     <td>TRUE</td>
-    <td></td>
+    <td>Changes the state of aggregation and join operators. Do not disable.</td>
   </tr>
   <tr>
     <td>planner.enable_demux_exchange</td>
     <td>FALSE</td>
-    <td></td>
+    <td>Toggles the state of hashing to a demulitplexed exchange.</td>
   </tr>
   <tr>
     <td>planner.enable_hash_single_key</td>
@@ -315,12 +305,12 @@
   <tr>
     <td>planner.enable_hashagg</td>
     <td>TRUE</td>
-    <td></td>
+    <td>Enable hash aggregation; otherwise, Drill does a sort-based aggregation. Does
not write to disk. Enable is recommended.</td>
   </tr>
   <tr>
     <td>planner.enable_hashjoin</td>
     <td>TRUE</td>
-    <td></td>
+    <td>Enable the memory hungry hash join. Does not write to disk.</td>
   </tr>
   <tr>
     <td>planner.enable_hashjoin_swap</td>
@@ -330,7 +320,7 @@
   <tr>
     <td>planner.enable_mergejoin</td>
     <td>TRUE</td>
-    <td></td>
+    <td>Sort-based operation. Writes to disk.</td>
   </tr>
   <tr>
     <td>planner.enable_multiphase_agg</td>
@@ -340,12 +330,12 @@
   <tr>
     <td>planner.enable_mux_exchange</td>
     <td>TRUE</td>
-    <td></td>
+    <td>Toggles the state of hashing to a multiplexed exchange.</td>
   </tr>
   <tr>
     <td>planner.enable_streamagg</td>
     <td>TRUE</td>
-    <td></td>
+    <td>Sort-based operation. Writes to disk.</td>
   </tr>
   <tr>
     <td>planner.identifier_max_length</td>
@@ -390,7 +380,7 @@
   <tr>
     <td>planner.memory.non_blocking_operators_memory</td>
     <td>64</td>
-    <td></td>
+    <td>Range: 0-2048</td>
   </tr>
   <tr>
     <td>planner.partitioner_sender_max_threads</td>
@@ -410,27 +400,27 @@
   <tr>
     <td>planner.producer_consumer_queue_size</td>
     <td>10</td>
-    <td></td>
+    <td>How much data to prefetch from disk (in record batches) out of band of query
execution</td>
   </tr>
   <tr>
     <td>planner.slice_target</td>
     <td>100000</td>
-    <td></td>
+    <td>The number of records manipulated within a fragment before Drill parallelizes
operations.</td>
   </tr>
   <tr>
     <td>planner.width.max_per_node</td>
     <td>3</td>
-    <td></td>
+    <td>The maximum degree of distribution of a query across cores and cluster nodes.</td>
   </tr>
   <tr>
     <td>planner.width.max_per_query</td>
     <td>1000</td>
-    <td></td>
+    <td>Same as planner but applies to the query as executed by the entire cluster.</td>
   </tr>
   <tr>
     <td>store.format</td>
     <td>parquet</td>
-    <td></td>
+    <td>Output format for data written to tables with the CREATE TABLE AS (CTAS) command.
Allowed values are parquet, json, or text. Allowed values: 0, -1, 1000000</td>
   </tr>
   <tr>
     <td>store.json.all_text_mode</td>
@@ -440,17 +430,17 @@
   <tr>
     <td>store.mongo.all_text_mode</td>
     <td>FALSE</td>
-    <td></td>
+    <td>Similar to store.json.all_text_mode for MongoDB.</td>
   </tr>
   <tr>
     <td>store.parquet.block-size</td>
     <td>536870912</td>
-    <td></td>
+    <td>Sets the size of a Parquet row group to the number of bytes less than or equal
to the block size of MFS, HDFS, or the file system.</td>
   </tr>
   <tr>
     <td>store.parquet.compression</td>
     <td>snappy</td>
-    <td></td>
+    <td>Compression type for storing Parquet output. Allowed values: snappy, gzip,
none</td>
   </tr>
   <tr>
     <td>store.parquet.enable_dictionary_encoding</td>
@@ -463,22 +453,14 @@
     <td></td>
   </tr>
   <tr>
-    <td>store.parquet.vector_fill_check_threshold</td>
-    <td>10</td>
-    <td></td>
-  </tr>
-  <tr>
-    <td>store.parquet.vector_fill_threshold</td>
-    <td>85</td>
-    <td></td>
-  </tr>
-  <tr>
     <td>window.enable</td>
     <td>FALSE</td>
     <td></td>
   </tr>
 </table>
 
+<h2 id="memory-allocation">Memory Allocation</h2>
+
 <p>You can configure the amount of direct memory allocated to a Drillbit for
 query processing. The default limit is 8G, but Drill prefers 16G or more
 depending on the workload. The total amount of direct memory that a Drillbit

Modified: drill/site/trunk/content/drill/docs/sql-functions/index.html
URL: http://svn.apache.org/viewvc/drill/site/trunk/content/drill/docs/sql-functions/index.html?rev=1673272&r1=1673271&r2=1673272&view=diff
==============================================================================
--- drill/site/trunk/content/drill/docs/sql-functions/index.html (original)
+++ drill/site/trunk/content/drill/docs/sql-functions/index.html Mon Apr 13 20:20:50 2015
@@ -78,6 +78,8 @@
 <li><a href="/docs/nested-data-functions/">Nested Data</a></li>
 <li><a href="/docs/functions-for-handling-nulls">Functions for Handling Nulls</a></li>
 </ul>
+
+<p>You need to use a FROM clause in Drill queries. Examples in this documentation often
use <code>FROM sys.version</code> in the query for example purposes.</p>
 </div>
 
 

Modified: drill/site/trunk/content/drill/feed.xml
URL: http://svn.apache.org/viewvc/drill/site/trunk/content/drill/feed.xml?rev=1673272&r1=1673271&r2=1673272&view=diff
==============================================================================
--- drill/site/trunk/content/drill/feed.xml (original)
+++ drill/site/trunk/content/drill/feed.xml Mon Apr 13 20:20:50 2015
@@ -6,8 +6,8 @@
 </description>
     <link>/</link>
     <atom:link href="/feed.xml" rel="self" type="application/rss+xml"/>
-    <pubDate>Tue, 07 Apr 2015 18:45:47 -0700</pubDate>
-    <lastBuildDate>Tue, 07 Apr 2015 18:45:47 -0700</lastBuildDate>
+    <pubDate>Mon, 13 Apr 2015 13:19:06 -0700</pubDate>
+    <lastBuildDate>Mon, 13 Apr 2015 13:19:06 -0700</lastBuildDate>
     <generator>Jekyll v2.5.2</generator>
     
       <item>



Mime
View raw message