drill-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From bridg...@apache.org
Subject drill-site git commit: minor updates from Kris
Date Wed, 05 Aug 2015 01:16:39 GMT
Repository: drill-site
Updated Branches:
  refs/heads/asf-site 354639303 -> 680076959


minor updates from Kris


Project: http://git-wip-us.apache.org/repos/asf/drill-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/drill-site/commit/68007695
Tree: http://git-wip-us.apache.org/repos/asf/drill-site/tree/68007695
Diff: http://git-wip-us.apache.org/repos/asf/drill-site/diff/68007695

Branch: refs/heads/asf-site
Commit: 680076959e52b29e925a0b296d19b016dd9e43bf
Parents: 3546393
Author: Bridget Bevens <bbevens@maprtech.com>
Authored: Tue Aug 4 18:16:20 2015 -0700
Committer: Bridget Bevens <bbevens@maprtech.com>
Committed: Tue Aug 4 18:16:20 2015 -0700

----------------------------------------------------------------------
 docs/file-system-storage-plugin/index.html      |  2 +-
 .../index.html                                  |  9 ++--
 docs/json-data-model/index.html                 | 19 --------
 .../index.html                                  | 51 +++++++++++---------
 feed.xml                                        |  4 +-
 5 files changed, 36 insertions(+), 49 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/drill-site/blob/68007695/docs/file-system-storage-plugin/index.html
----------------------------------------------------------------------
diff --git a/docs/file-system-storage-plugin/index.html b/docs/file-system-storage-plugin/index.html
index de434e6..4bf53e7 100644
--- a/docs/file-system-storage-plugin/index.html
+++ b/docs/file-system-storage-plugin/index.html
@@ -1014,7 +1014,7 @@ system on your machine by default. </p>
 
 <h2 id="connecting-drill-to-a-file-system">Connecting Drill to a File System</h2>
 
-<p>In a Drill cluster, you typically do not query the local file system, but instead
place files on the distributed file system. Currently, you need to use a distributed file
system when connecting multiple Drillbits to get complete, consistent query results.</p>
+<p>In a Drill cluster, you typically do not query the local file system, but instead
place files on the distributed file system. Currently, you need to use a distributed file
system when connecting multiple Drillbits to get complete, consistent query results, simulate
a distributed file system by copying files to each node, or use an NFS volume, such as Amazon
Elastic File System. </p>
 
 <p>You configure the connection property of the storage plugin workspace to connect
Drill to a distributed file system. For example, the following connection property connects
Drill to an HDFS cluster from a client:</p>
 

http://git-wip-us.apache.org/repos/asf/drill-site/blob/68007695/docs/installing-the-apache-drill-sandbox/index.html
----------------------------------------------------------------------
diff --git a/docs/installing-the-apache-drill-sandbox/index.html b/docs/installing-the-apache-drill-sandbox/index.html
index 1bf8390..70b2b68 100644
--- a/docs/installing-the-apache-drill-sandbox/index.html
+++ b/docs/installing-the-apache-drill-sandbox/index.html
@@ -1078,9 +1078,12 @@ The Import Virtual Machine dialog appears.</p></li>
 </ul></li>
 <li><p>Navigate to <a href="http://localhost:8047">localhost:8047</a>
to experience the Drill Web UI, or log in to the sandbox through the command line.  </p></li>
 </ol>
-<div class="highlight"><pre><code class="language-text" data-lang="text">
  * Login using ssh as described in [&quot;Getting to Know the Sandbox&quot;](/docs/getting-to-know-the-drill-sandbox).
When prompted, enter `mapr` as the login name and password. 
-   * Alternatively, access the command line on the VM: Press Alt+F2 on Windows or Option+F5
on Mac.  
-</code></pre></div>
+
+<ul>
+<li>Login using ssh as described in <a href="/docs/getting-to-know-the-drill-sandbox">&quot;Getting
to Know the Sandbox&quot;</a>. When prompted, enter <code>mapr</code>
as the login name and password.<br></li>
+<li>Alternatively, access the command line on the VM: Press Alt+F2 on Windows or Option+F5
on Mac.<br></li>
+</ul>
+
 <h3 id="what&#39;s-next">What&#39;s Next</h3>
 
 <p>After downloading and installing the sandbox, continue with the tutorial by

http://git-wip-us.apache.org/repos/asf/drill-site/blob/68007695/docs/json-data-model/index.html
----------------------------------------------------------------------
diff --git a/docs/json-data-model/index.html b/docs/json-data-model/index.html
index 3503e12..1282a27 100644
--- a/docs/json-data-model/index.html
+++ b/docs/json-data-model/index.html
@@ -1476,25 +1476,6 @@ FROM dfs.`/Users/mypath/example.json` t;
 <li><p><a href="/docs/kvgen/">KVGEN</a> separates objects having
more elements than optimal for querying.</p></li>
 </ul>
 
-<h3 id="nested-column-names">Nested Column Names</h3>
-
-<p>You cannot use reserved words for nested column names because Drill returns null
if you enclose n-level nested column names in back ticks. The previous example encloses the
date and time column names in back ticks because the names are reserved words. The enclosure
of column names in back ticks works because the date and time columns belong to the first
level of the JSON object.</p>
-
-<p>For example, the following object contains the reserved word key, which you need
to rename to <code>_key</code> or something other than non-reserved word:</p>
-<div class="highlight"><pre><code class="language-text" data-lang="text">{
-  &quot;type&quot;: &quot;ticket&quot;,
-  &quot;channel&quot;: 123455,
-  &quot;_month&quot;: 12,
-  &quot;_day&quot;: [ 15, 25, 28, 31 ],
-  &quot;sales&quot;: {
-    &quot;NY&quot;: 532806,
-    &quot;PA&quot;: 112889,
-    &quot;TX&quot;: 898999,
-    &quot;UT&quot;: 10875
-    &quot;key&quot;: [ 78946, 39107, 76311 ]
-  }
-}
-</code></pre></div>
 <h3 id="schema-changes">Schema changes</h3>
 
 <p>Drill cannot read JSON files containing changes in the schema. For example, attempting
to query an object having array elements of different data types cause an error:</p>

http://git-wip-us.apache.org/repos/asf/drill-site/blob/68007695/docs/tutorial-develop-a-simple-function/index.html
----------------------------------------------------------------------
diff --git a/docs/tutorial-develop-a-simple-function/index.html b/docs/tutorial-develop-a-simple-function/index.html
index 8fc1ca8..e5d7aa8 100644
--- a/docs/tutorial-develop-a-simple-function/index.html
+++ b/docs/tutorial-develop-a-simple-function/index.html
@@ -1005,22 +1005,14 @@
 
     <div class="int_text" align="left">
       
-        <p>You can create complex functions having advanced features, but for example
purposes, this tutorial covers how to create a simple MASK function. You extend the Drill
query engine using the Drill Simple Function interface:</p>
-<div class="highlight"><pre><code class="language-java" data-lang="java"><span
class="kn">package</span> <span class="n">org</span><span class="o">.</span><span
class="na">apache</span><span class="o">.</span><span class="na">drill</span><span
class="o">.</span><span class="na">contrib</span><span class="o">.</span><span
class="na">function</span><span class="o">;</span>
+        <p>You can create complex functions having advanced features, but for example
purposes, this tutorial covers how to create a simple MASK function. You extend the Drill
query engine using the <a href="https://github.com/apache/drill/blob/master/exec/java-exec/src/main/java/org/apache/drill/exec/expr/DrillSimpleFunc.java">Drill
Simple Function interface</a>:</p>
+<div class="highlight"><pre><code class="language-java" data-lang="java"><span
class="kn">package</span> <span class="n">org</span><span class="o">.</span><span
class="na">apache</span><span class="o">.</span><span class="na">drill</span><span
class="o">.</span><span class="na">exec</span><span class="o">.</span><span
class="na">expr</span><span class="o">;</span>
 
-<span class="kn">import</span> <span class="nn">org.apache.drill.exec.expr.DrillSimpleFunc</span><span
class="o">;</span>
-<span class="kn">import</span> <span class="nn">org.apache.drill.exec.expr.annotations.FunctionTemplate</span><span
class="o">;</span>
-
-<span class="nd">@FunctionTemplate</span><span class="o">(</span>
        
-  <span class="cm">/* Add annotations name, scope, and nulls */</span>      
   
-<span class="o">)</span>
-
-<span class="kd">public</span> <span class="kd">class</span> <span
class="nc">SimpleMaskFunc</span> <span class="kd">implements</span> <span
class="n">DrillSimpleFunc</span><span class="o">{</span>
+<span class="kn">import</span> <span class="nn">org.apache.drill.exec.record.RecordBatch</span><span
class="o">;</span>
 
-    <span class="kd">public</span> <span class="kt">void</span> <span
class="nf">setup</span><span class="o">()</span> <span class="o">{</span>
-    <span class="o">}</span>
-    <span class="kd">public</span> <span class="kt">void</span> <span
class="nf">eval</span><span class="o">()</span> <span class="o">{</span>
-    <span class="o">}</span>
+<span class="kd">public</span> <span class="kd">interface</span>
<span class="nc">DrillSimpleFunc</span> <span class="kd">extends</span>
<span class="n">DrillFunc</span><span class="o">{</span>
+  <span class="kd">public</span> <span class="kt">void</span> <span
class="nf">setup</span><span class="o">();</span>
+  <span class="kd">public</span> <span class="kt">void</span> <span
class="nf">eval</span><span class="o">();</span>
 <span class="o">}</span>
 </code></pre></div>
 <p>The MASK function transforms the value of a column on each row. The function masks
characters in a string, as shown by the following pseudo-code:</p>
@@ -1052,9 +1044,9 @@
 </code></pre></div>
 <hr>
 
-<h2 id="step-2:-implement-the-function-template">Step 2: Implement the function template</h2>
+<h2 id="step-2:-add-annotations-to-the-function-template">Step 2: Add annotations to
the function template</h2>
 
-<p>In the @FunctionTemplate declaration, add the following annotations:</p>
+<p>To start implementing the DrillSimpleFunc interface, add the following annotations
to the @FunctionTemplate declaration:</p>
 
 <ul>
 <li>Name of the custom function 
@@ -1065,21 +1057,32 @@
 <code>nulls = FunctionTemplate.NullHandling.NULL_IF_NULL</code></li>
 </ul>
 <div class="highlight"><pre><code class="language-java" data-lang="java"><span
class="o">.</span> <span class="o">.</span> <span class="o">.</span>
+<span class="kn">package</span> <span class="n">org</span><span
class="o">.</span><span class="na">apache</span><span class="o">.</span><span
class="na">drill</span><span class="o">.</span><span class="na">contrib</span><span
class="o">.</span><span class="na">function</span><span class="o">;</span>
+
+<span class="kn">import</span> <span class="nn">org.apache.drill.exec.expr.DrillSimpleFunc</span><span
class="o">;</span>
+<span class="kn">import</span> <span class="nn">org.apache.drill.exec.expr.annotations.FunctionTemplate</span><span
class="o">;</span>
+
 <span class="nd">@FunctionTemplate</span><span class="o">(</span>
-        <span class="n">name</span> <span class="o">=</span> <span
class="s">&quot;mask&quot;</span><span class="o">,</span>
-        <span class="n">scope</span> <span class="o">=</span> <span
class="n">FunctionTemplate</span><span class="o">.</span><span class="na">FunctionScope</span><span
class="o">.</span><span class="na">SIMPLE</span><span class="o">,</span>
+        <span class="n">name</span><span class="o">=</span><span
class="s">&quot;mask&quot;</span><span class="o">,</span>
+        <span class="n">scope</span><span class="o">=</span> <span
class="n">FunctionTemplate</span><span class="o">.</span><span class="na">FunctionScope</span><span
class="o">.</span><span class="na">SIMPLE</span><span class="o">,</span>
         <span class="n">nulls</span> <span class="o">=</span> <span
class="n">FunctionTemplate</span><span class="o">.</span><span class="na">NullHandling</span><span
class="o">.</span><span class="na">NULL_IF_NULL</span>
 <span class="o">)</span>
-
 <span class="kd">public</span> <span class="kd">class</span> <span
class="nc">SimpleMaskFunc</span> <span class="kd">implements</span> <span
class="n">DrillSimpleFunc</span><span class="o">{</span>
-<span class="o">.</span> <span class="o">.</span> <span class="o">.</span>
+
+    <span class="kd">public</span> <span class="kt">void</span> <span
class="nf">setup</span><span class="o">()</span> <span class="o">{</span>
+
+    <span class="o">}</span>
+
+    <span class="kd">public</span> <span class="kt">void</span> <span
class="nf">eval</span><span class="o">()</span> <span class="o">{</span>
+
+    <span class="o">}</span>
 <span class="o">}</span>
 </code></pre></div>
 <hr>
 
 <h2 id="step-3:-declare-input-parameters">Step 3: Declare input parameters</h2>
 
-<p>The eval() method that you implement appears to have no parameters. By examining
the simple function interface <a href="https://github.com/apache/drill/blob/master/exec/java-exec/src/main/java/org/apache/drill/exec/expr/fn/DrillSimpleFuncHolder.java#L42">source
code</a>, you can see that Drill generates the function dynamically, and in this case,
requires declaration of the following input parameters using the @Param annotation:</p>
+<p>The function will be generated dynamically, as you can see in the <a href="https://github.com/apache/drill/blob/master/exec/java-exec/src/main/java/org/apache/drill/exec/expr/fn/DrillSimpleFuncHolder.java#L42">DrillSimpleFuncHolder</a>,
and the input parameters and output holders are defined using holders by annotations. Define
the parameters using the @Param annotation. </p>
 
 <ul>
 <li>A nullable string<br></li>
@@ -1087,7 +1090,7 @@
 <li>The number of characters to replace starting from the first<br></li>
 </ul>
 
-<p>For each of these parameters, use a holder class: VarCharHolder or NullableVarCharHolder.
</p>
+<p>Use a holder classes to provide a buffer to manage larger objects in an efficient
way: VarCharHolder or NullableVarCharHolder. </p>
 <div class="highlight"><pre><code class="language-java" data-lang="java"><span
class="o">.</span> <span class="o">.</span> <span class="o">.</span>
 <span class="kd">public</span> <span class="kd">class</span> <span
class="nc">SimpleMaskFunc</span> <span class="kd">implements</span> <span
class="n">DrillSimpleFunc</span> <span class="o">{</span>
 
@@ -1111,7 +1114,7 @@
 
 <h2 id="step-4:-declare-the-return-value-type">Step 4: Declare the return value type</h2>
 
-<p>The eval() method that you implement appears to return void, but from simple function
interface, but the MASK function returns a string. To declare the return value type, use the
@Output annotation and declare the type to be of the VarCharHolder type. Also, because you
are manipulating a VarChar, you also have to inject a buffer that Drill uses for the output.
</p>
+<p>Also, using the @Output annotation, define the returned value as VarCharHolder type.
Because you are manipulating a VarChar, you also have to inject a buffer that Drill uses for
the output. </p>
 <div class="highlight"><pre><code class="language-java" data-lang="java"><span
class="kd">public</span> <span class="kd">class</span> <span class="nc">SimpleMaskFunc</span>
<span class="kd">implements</span> <span class="n">DrillSimpleFunc</span>
<span class="o">{</span>
 <span class="o">.</span> <span class="o">.</span> <span class="o">.</span>
     <span class="nd">@Output</span>
@@ -1156,7 +1159,7 @@
 <li>Creates and populates the output buffer</li>
 </ul>
 
-<p>Even to a seasoned Java developer, the eval() method might look a bit mysterious
because Drill generates the final code on the fly to fulfill a query request. This technique
leverages Java’s just-in-time (JIT) compiler for maximum speed.</p>
+<p>Even to a seasoned Java developer, the eval() method might look a bit strange because
Drill generates the final code on the fly to fulfill a query request. This technique leverages
Java’s just-in-time (JIT) compiler for maximum speed.</p>
 
 Basic Coding Rules</h2>
 

http://git-wip-us.apache.org/repos/asf/drill-site/blob/68007695/feed.xml
----------------------------------------------------------------------
diff --git a/feed.xml b/feed.xml
index aeab41d..189e383 100644
--- a/feed.xml
+++ b/feed.xml
@@ -6,8 +6,8 @@
 </description>
     <link>/</link>
     <atom:link href="/feed.xml" rel="self" type="application/rss+xml"/>
-    <pubDate>Tue, 04 Aug 2015 16:33:04 -0700</pubDate>
-    <lastBuildDate>Tue, 04 Aug 2015 16:33:04 -0700</lastBuildDate>
+    <pubDate>Tue, 04 Aug 2015 18:12:18 -0700</pubDate>
+    <lastBuildDate>Tue, 04 Aug 2015 18:12:18 -0700</lastBuildDate>
     <generator>Jekyll v2.5.2</generator>
     
       <item>


Mime
View raw message