drill-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From krish...@apache.org
Subject drill git commit: MD-643 review
Date Thu, 07 Jan 2016 18:57:30 GMT
Repository: drill
Updated Branches:
  refs/heads/gh-pages 3f0a7d609 -> f853694df


MD-643 review

address doc issue in DRILL-4130

refine 1.4 release desc

DRILL-3739 note per Rahul


Project: http://git-wip-us.apache.org/repos/asf/drill/repo
Commit: http://git-wip-us.apache.org/repos/asf/drill/commit/f853694d
Tree: http://git-wip-us.apache.org/repos/asf/drill/tree/f853694d
Diff: http://git-wip-us.apache.org/repos/asf/drill/diff/f853694d

Branch: refs/heads/gh-pages
Commit: f853694dff92680a083a114b8f664ed6a606d51c
Parents: 3f0a7d6
Author: Kris Hahn <krishahn@apache.org>
Authored: Thu Jan 7 10:41:51 2016 -0800
Committer: Kris Hahn <krishahn@apache.org>
Committed: Thu Jan 7 10:57:10 2016 -0800

----------------------------------------------------------------------
 .../plugins/070-hive-storage-plugin.md           |  4 ++--
 .../050-json-data-model.md                       |  8 ++++----
 _docs/getting-started/010-drill-introduction.md  | 19 +++++++++++++++----
 _docs/rn/007-1.4.0-rn.md                         |  4 +++-
 4 files changed, 24 insertions(+), 11 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/drill/blob/f853694d/_docs/connect-a-data-source/plugins/070-hive-storage-plugin.md
----------------------------------------------------------------------
diff --git a/_docs/connect-a-data-source/plugins/070-hive-storage-plugin.md b/_docs/connect-a-data-source/plugins/070-hive-storage-plugin.md
index 4c6b699..76cf4dc 100644
--- a/_docs/connect-a-data-source/plugins/070-hive-storage-plugin.md
+++ b/_docs/connect-a-data-source/plugins/070-hive-storage-plugin.md
@@ -35,7 +35,7 @@ metastore service communicates with the Hive database over JDBC.
 
 Follow the steps in the next section to point Drill
 to the Hive metastore service address. Provide the connection parameters
-in a Hive storage plugin configuration to configure a connection to Drill. At this point,
if you query data sources that Drill supports other than HBase (or MapR), you are finished
configuring the Hive storage plugin. If you query HBase using Hive, you need to add ZooKeeper
quorum and port properties.  The HBaseStorageHandler requires these properties. Drill discovers
HBase services using these properties. If you use the HBase storage plugin, the ZooKeeper
quorum and port properties in the Hive storage plugin are the same as those in the HBase storage
plugin, assuming you want to use the same HBase database. 
+in a Hive storage plugin configuration to configure a connection to Drill. At this point,
if you your Hive queries do not use the HBaseStorageHandler, you are finished configuring
the Hive storage plugin; otherwise, you need to add ZooKeeper quorum and port properties.
 The HBaseStorageHandler requires these properties. Drill discovers HBase services using these
properties. If you use the HBase storage plugin, use the same ZooKeeper quorum and port properties
in the Hive storage plugin and the HBase storage plugin, assuming you want the Hive query
access the same HBase source. 
 
 {% include startnote.html %}Verify that the Hive metastore service is running before you
register the Hive metastore.{% include endnote.html %}  
 
@@ -66,7 +66,7 @@ To connect Drill to a remote Hive metastore:
             }
           }
 
-6. If you do not query HBase, skip this step. If you query HBase, in the configuration window,
add the names of the ZooKeeper quorum hosts and the ZooKeeper port, for example 2181.  
+6. If you do not use the HBaseStorageHandler in your queries, skip this step; otherwise,
add the names of the ZooKeeper quorum hosts and the ZooKeeper port, for example 2181.  
 
         {
           "type": "hive",

http://git-wip-us.apache.org/repos/asf/drill/blob/f853694d/_docs/data-sources-and-file-formats/050-json-data-model.md
----------------------------------------------------------------------
diff --git a/_docs/data-sources-and-file-formats/050-json-data-model.md b/_docs/data-sources-and-file-formats/050-json-data-model.md
index 0452288..00b54e9 100644
--- a/_docs/data-sources-and-file-formats/050-json-data-model.md
+++ b/_docs/data-sources-and-file-formats/050-json-data-model.md
@@ -1,6 +1,6 @@
 ---
 title: "JSON Data Model"
-date:  
+date: 2016-01-07
 parent: "Data Sources and File Formats"
 ---
 Drill supports [JSON (JavaScript Object Notation)](http://www.json.org/), a self-describing
data format. The data itself implies its schema and has the following characteristics:
@@ -50,7 +50,7 @@ The default setting of `store.json.all_text_mode` and `store.json.read_numbers_a
 ### Handling Type Differences
 Set the `store.json.read_numbers_as_double` property to true.
 
-    ALTER SYSTEM SET `store.json.read_numbers_as_double` = true;
+    ALTER SESSION SET `store.json.read_numbers_as_double` = true;
 
 When you set this option, Drill reads all numbers from the JSON files as DOUBLE. After reading
the data, use a SELECT statement in Drill to cast data as follows:
 
@@ -230,7 +230,7 @@ FLATTEN breaks the list of key-value pairs into separate rows on which
you can a
 ### Example: Aggregate Loosely Structured Data
 Use flatten and kvgen together to aggregate the data from the [previous example]({{site.baseurl}}/docs/json-data-model/#example:-flatten-and-generate-key-values-for-complex-json).
Make sure all text mode is set to false to sum numbers. Drill returns an error if you attempt
to sum data in all text mode.
 
-    ALTER SYSTEM SET `store.json.all_text_mode` = false;
+    ALTER SESSION SET `store.json.all_text_mode` = false;
 
 Sum the ticket sales by combining the `SUM`, `FLATTEN`, and `KVGEN` functions in a single
query.
 
@@ -529,7 +529,7 @@ Drill interprets numbers that do not have a decimal point as BigInt values.
In t
 
 Workaround: Set the `store.json.read_numbers_as_double` property, described earlier, to true.
 
-    ALTER SYSTEM SET `store.json.read_numbers_as_double` = true;
+    ALTER SESSION SET `store.json.read_numbers_as_double` = true;
 
 ### Selecting all in a JSON directory query
 Drill currently returns only fields common to all the files in a [directory query]({{ site.baseurl
}}/docs/querying-directories) that selects all (SELECT *) JSON files.

http://git-wip-us.apache.org/repos/asf/drill/blob/f853694d/_docs/getting-started/010-drill-introduction.md
----------------------------------------------------------------------
diff --git a/_docs/getting-started/010-drill-introduction.md b/_docs/getting-started/010-drill-introduction.md
index 32217ce..cafcfe5 100644
--- a/_docs/getting-started/010-drill-introduction.md
+++ b/_docs/getting-started/010-drill-introduction.md
@@ -1,6 +1,6 @@
 ---
 title: "Drill Introduction"
-date:  
+date: 2016-01-07
 parent: "Getting Started"
 ---
 Drill is an Apache open-source SQL query engine for Big Data exploration.
@@ -8,10 +8,21 @@ Drill is designed from the ground up to support high-performance analysis
on
 the semi-structured and rapidly evolving data coming from modern Big Data
 applications, while still providing the familiarity and ecosystem of ANSI SQL,
 the industry-standard query language. Drill provides plug-and-play integration
-with existing Apache Hive and Apache HBase deployments. 
+with existing Apache Hive and Apache HBase deployments.  
 
-## What's New in Apache Drill 1.3 and 1.4
-These releases fix issues and add a number of enhancements, including the following ones:
+## What's New in Apache Drill 1.4
+
+Drill 1.4 introduces the following improvements:
+
+* [select with options]({{site.baseurl}}/docs/plugin-configuration-basics/#using-the-formats-attributes-as-table-function-parameters)
that you use in queries to change storage plugin settings
+* Improved behavior when parsing CSV file header names
+* A variable to set non-pretty, such as compact, printing of JSON
+* Better drillbit.log files that include query text
+
+Drill 1.4 fixes an error that occurred when using the HBaseStorageHandler in a Hive query
([DRILL-3739](https://issues.apache.org/jira/browse/DRILL-3739)). To successfully use the
HBaseStorageHandler in a Hive query, you need to configure the Hive storage plugin as described
in the [Hive storage plugin documentation]({{site.baseurl}}/docs/hive-storage-plugin/#connect-drill-to-the-hive-remote-metastore).
+
+## What's New in Apache Drill 1.3 
+This releases fix issues and add a number of enhancements, including the following ones:
 
 * [Enhanced Amazon S3 support]({{site.baseurl}}/docs/s3-storage-plugin/)  
 * Hetrogeneous types  

http://git-wip-us.apache.org/repos/asf/drill/blob/f853694d/_docs/rn/007-1.4.0-rn.md
----------------------------------------------------------------------
diff --git a/_docs/rn/007-1.4.0-rn.md b/_docs/rn/007-1.4.0-rn.md
index 717e80b..74a792c 100644
--- a/_docs/rn/007-1.4.0-rn.md
+++ b/_docs/rn/007-1.4.0-rn.md
@@ -6,6 +6,8 @@ parent: "Release Notes"
 **Release date:**  December 14, 2015
 
 Today, we're happy to announce the availability of Drill 1.4.0, providing the following bug
fixes and improvements. 
+
+Drill 1.4 fixes an error that occurred when using the HBaseStorageHandler in a Hive query
([DRILL-3739](https://issues.apache.org/jira/browse/DRILL-3739)). To successfully use the
HBaseStorageHandler in a Hive query, you need to configure the Hive storage plugin as described
in the [Hive storage plugin documentation]({{site.baseurl}}/docs/hive-storage-plugin/#connect-drill-to-the-hive-remote-metastore).
     
 <h2>        Sub-task
 </h2>
@@ -100,4 +102,4 @@ Today, we're happy to announce the availability of Drill 1.4.0, providing
the fo
 <ul>
 <li>[<a href='https://issues.apache.org/jira/browse/DRILL-3791'>DRILL-3791</a>]
-         Test JDBC plugin with MySQL
 </li>
-</ul>
\ No newline at end of file
+</ul>


Mime
View raw message