drill-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From bridg...@apache.org
Subject [2/2] drill git commit: corrections per Venki
Date Thu, 01 Oct 2015 22:44:54 GMT
corrections per Venki

hide password

wordsmithing

formatting

more formatting

code formatting

more code formatting

DRILL-2908 comments from Parth

minor edits

lower to upper case

what's new plus minor tweaks

minor edit


Project: http://git-wip-us.apache.org/repos/asf/drill/repo
Commit: http://git-wip-us.apache.org/repos/asf/drill/commit/70415f26
Tree: http://git-wip-us.apache.org/repos/asf/drill/tree/70415f26
Diff: http://git-wip-us.apache.org/repos/asf/drill/diff/70415f26

Branch: refs/heads/gh-pages
Commit: 70415f269002fdaf60a6ceb96ff24dc3c367d6bf
Parents: 118e3eb
Author: Kristine Hahn <khahn@maprtech.com>
Authored: Thu Oct 1 11:33:11 2015 -0700
Committer: Kristine Hahn <khahn@maprtech.com>
Committed: Thu Oct 1 15:38:21 2015 -0700

----------------------------------------------------------------------
 ...-configuring-web-ui-and-rest-api-security.md |   2 +-
 .../120-configuring-the-drill-shell.md          |  10 +++++++-
 .../035-plugin-configuration-basics.md          |   2 +-
 .../040-parquet-format.md                       |  24 ++++++++++++-------
 _docs/getting-started/010-drill-introduction.md |  14 +++++++++++
 _docs/img/web-ui-admin-view.png                 | Bin 45382 -> 45701 bytes
 _docs/img/web-ui.png                            | Bin 42637 -> 42297 bytes
 _docs/install/060-starting-the-web-ui.md        |  12 ++++------
 8 files changed, 44 insertions(+), 20 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/drill/blob/70415f26/_docs/configure-drill/078-configuring-web-ui-and-rest-api-security.md
----------------------------------------------------------------------
diff --git a/_docs/configure-drill/078-configuring-web-ui-and-rest-api-security.md b/_docs/configure-drill/078-configuring-web-ui-and-rest-api-security.md
index 9816a30..fcde234 100644
--- a/_docs/configure-drill/078-configuring-web-ui-and-rest-api-security.md
+++ b/_docs/configure-drill/078-configuring-web-ui-and-rest-api-security.md
@@ -82,7 +82,7 @@ The following table and subsections describe the privilege levels for accessing
 | submitQueryJSON          | /query.json                  | POST         | application/json
| Submits a query and waits until it is completed and then returns the results as one big
JSON object.                                                                             
                                                                          | ALL          
                                                                                         
      |
 | submitQuery              | /query                       | POST         | text/html    
   | Returns results from submitQueryJSON populated in a HTML table.                     
                                                                                         
                                                                             | ALL       
                                                                                         
         |
 | getMetrics               | /metrics                     | GET          | text/html    
   | Returns a page that fetches metric info from resource, status, and metrics.         
                                                                                         
                                                                             | ALL       
                                                                                         
         |
-| getMetrics               | /threads                     | GET          | text/html    
   | Returns a page that fetches metric information from resource, status, and threads.  
                                                                                         
                                                                             | ALL       
                                                                                         
         |
+| getThreads               | /threads                     | GET          | text/html    
   | Returns a page that fetches metric information from resource, status, and threads.  
                                                                                         
                                                                             | ALL       
                                                                                         
         |
 ### GET /profiles.json
 
 * ADMIN - gets all profiles on the system.  

http://git-wip-us.apache.org/repos/asf/drill/blob/70415f26/_docs/configure-drill/120-configuring-the-drill-shell.md
----------------------------------------------------------------------
diff --git a/_docs/configure-drill/120-configuring-the-drill-shell.md b/_docs/configure-drill/120-configuring-the-drill-shell.md
index 4a0e861..11b9f67 100644
--- a/_docs/configure-drill/120-configuring-the-drill-shell.md
+++ b/_docs/configure-drill/120-configuring-the-drill-shell.md
@@ -16,7 +16,7 @@ The following table lists the commands that you can run on the Drill command
lin
 | !brief        | Set verbose mode off.                                                 
                                                               |
 | !close        | Close the current connection to the database.                         
                                                               |
 | !closeall     | Close all current open connections.                                   
                                                               |
-| !connect      | Open a new connection to the database.                                
                                                               |
+| !connect      | Open a new connection to the database. Use this command to hide the password
when starting Drill in authentication mode.              |
 | !help         | Print a summary of command usage.                                     
                                                               |
 | !history      | Display the command history.                                          
                                                               |
 | !list         | List the current connections.                                         
                                                               |
@@ -32,6 +32,14 @@ The following table lists the commands that you can run on the Drill command
lin
 | !tables       | List all the tables in the database.                                  
                                                               |
 | !verbose      | Show unabbreviated error messages.                                    
                                                               |
 
+## Example of Hiding the Password When Starting Drill
+
+When starting Drill in authentication mode, you can use the **!connect** command as shown
in the section, ["User Authentication Process"]({{site.baseurl}}/docs/configuring-user-authentication/#user-authentication-process),
instead of the **sqlline**, **drill-embedded**, or **drill-distributed** commands. For example,
after running the sqlline script, you enter this command to connect to Drill:
+
+`sqlline> !connect jdbc:drill:zk=localhost:2181`  
+
+When prompted you enter a user name and password, which is hidden as you type it.
+
 ## Examples of Configuring the Drill Shell
 
 For example, quit the Drill shell:

http://git-wip-us.apache.org/repos/asf/drill/blob/70415f26/_docs/connect-a-data-source/035-plugin-configuration-basics.md
----------------------------------------------------------------------
diff --git a/_docs/connect-a-data-source/035-plugin-configuration-basics.md b/_docs/connect-a-data-source/035-plugin-configuration-basics.md
index 12cbe26..5f107e9 100644
--- a/_docs/connect-a-data-source/035-plugin-configuration-basics.md
+++ b/_docs/connect-a-data-source/035-plugin-configuration-basics.md
@@ -15,7 +15,7 @@ To create a name and new configuration:
 
 1. [Start the Drill shell]({{site.baseurl}}/docs/starting-drill-on-linux-and-mac-os-x/).
 
 2. [Start the Web Console]({{site.baseurl}}/docs/starting-the-web-console/).  
-   The storage tab appears on the Web Console if you are [authorized]({{site.baseurl}}/docs/configuring-web-console-and-rest-api-security/)
to view, update, or add storage plugins.  
+   The Storage tab appears on the Web Console if you are [authorized]({{site.baseurl}}/docs/configuring-web-console-and-rest-api-security/)
to view, update, or add storage plugins.  
 3. On the Storage tab, enter a name in **New Storage Plugin**.
    Each configuration registered with Drill must have a distinct
 name. Names are case-sensitive.  

http://git-wip-us.apache.org/repos/asf/drill/blob/70415f26/_docs/data-sources-and-file-formats/040-parquet-format.md
----------------------------------------------------------------------
diff --git a/_docs/data-sources-and-file-formats/040-parquet-format.md b/_docs/data-sources-and-file-formats/040-parquet-format.md
index 4d1ca3f..814dc42 100644
--- a/_docs/data-sources-and-file-formats/040-parquet-format.md
+++ b/_docs/data-sources-and-file-formats/040-parquet-format.md
@@ -137,15 +137,15 @@ For more examples of and information about using Parquet data, see ["Evolving
Pa
 ### SQL Data Types to Parquet
 The first table in this section maps SQL data types to Parquet data types, limited intentionally
by Parquet creators to minimize the impact on disk storage:
 
-| SQL Type | Parquet Type | Description                                   |
-|----------|--------------|-----------------------------------------------|
-| BIGINT   | INT64        | 8-byte signed integer                         |
-| BOOLEAN  | BOOLEAN      | TRUE (1) or FALSE (0)                         |
-| N/A      | BYTE_ARRAY   | Arbitrarily long byte array                   |
-| FLOAT    | FLOAT        | 4-byte single precision floating point number |
-| DOUBLE   | DOUBLE       | 8-byte double precision floating point number |
-| INTEGER  | INT32        | 4-byte signed integer                         |
-| None*    | INT96        | 12-byte signed int                            |
+| SQL Type          | Parquet Type | Description                                   |
+|-------------------|--------------|-----------------------------------------------|
+| BIGINT            | INT64        | 8-byte signed integer                         |
+| BOOLEAN           | BOOLEAN      | TRUE (1) or FALSE (0)                         |
+| N/A               | BYTE_ARRAY   | Arbitrarily long byte array                   |
+| FLOAT             | FLOAT        | 4-byte single precision floating point number |
+| DOUBLE            | DOUBLE       | 8-byte double precision floating point number |
+| INTEGER           | INT32        | 4-byte signed integer                         |
+| VARBINARY(12)*    | INT96        | 12-byte signed int                            |
 
 \* Drill 1.2 and later supports reading the Parquet INT96 type.
 
@@ -156,6 +156,12 @@ Drill 1.2 and later supports reading the Parquet INT96 type. For example,
to dec
 
 Because INT96 is supported for reads only, you cannot use the TIMESTAMP_IMPALA as a data
type argument with CONVERT_TO.
 
+You can convert a SQL TIMESTAMP to VARBINARY using the CAST function, but the resultant VARBINARY
is not the same as the INT96. For example, create a Drill table after reading an INT96 and
converting some data to a timestamp.
+
+`CREATE TABLE t2(c1) AS SELECT CONVERT_FROM(created_ts, 'TIMESTAMP_IMPALA') FROM t1 ORDER
BY 1 LIMIT 1;`
+
+t1.created_ts is an INT96 (or Hive/Impala timestamp) , t2.created_ts is a SQL timestamp.
These types are not comparable--you cannot use a condition like t1.created_ts = t2.created_ts.
+
 ### SQL Types to Parquet Logical Types
 Parquet also supports logical types, fully described on the [Apache Parquet site](https://github.com/Parquet/parquet-format/blob/master/LogicalTypes.md).
Embedded types, JSON and BSON, annotate a binary primitive type representing a JSON or BSON
document. The logical types and their mapping to SQL types are:
  

http://git-wip-us.apache.org/repos/asf/drill/blob/70415f26/_docs/getting-started/010-drill-introduction.md
----------------------------------------------------------------------
diff --git a/_docs/getting-started/010-drill-introduction.md b/_docs/getting-started/010-drill-introduction.md
index f72dc93..49264a6 100644
--- a/_docs/getting-started/010-drill-introduction.md
+++ b/_docs/getting-started/010-drill-introduction.md
@@ -9,6 +9,20 @@ applications, while still providing the familiarity and ecosystem of ANSI
SQL,
 the industry-standard query language. Drill provides plug-and-play integration
 with existing Apache Hive and Apache HBase deployments. 
 
+## What's New in Apache Drill 1.2
+
+This release of Drill fixes [many issues]() and introduces a number of enhancements, including
the following ones:
+
+* A number of new [SQL window functions]({{site.baseurl}}/docs/sql-window-functions)  
+  * [NTILE]({{site.baseurl}}/docs/ranking-window-functions/#ntile)  
+  * [LEAD and LEAD]({{site.baseurl}}/docs/value-window-functions/#lag-lead)  
+  * [FIRST_VALUE and LAST_VALUE]({{site.baseurl}}/docs/value-window-functions/#first_value-last_value)
 
+* [Security]({{site.baseurl}}/docs/configuring-web-console-and-rest-api-security/) for Web
Console and REST API operations  
+* Performance improvements for [querying HBase]({{site.baseurl}}/docs/querying-hbase/#querying-big-endian-encoded-data),
which includes leveraging [ordered byte encoding]({{site.baseurl}}/docs/querying-hbase/#leveraging-hbase-ordered-byte-encoding).
+* Parquet metadata caching for performantly reading large numbers of Parquet files
+* [Optimized reads]({{site.baseurl}}/docs/querying-hive/#optimizing-reads-of-parquet-backed-tables)
of Parquet-backed, Hive tables
+* Read support for the [Parquet INT96 type]({{site.baseurl}}/docs/parquet-format/#about-int96-support)
and a new TIMESTAMP_IMPALA type used with the [CONVERT_FROM]({{site.baseurl}}/docs/supported-data-types/#data-types-for-convert_to-and-convert_from-functions)
function decodes a timestamp from Hive or Impala.  
+
 ## What's New in Apache Drill 1.1
 
 Many enhancements in Apache Drill 1.1 include the following key features:

http://git-wip-us.apache.org/repos/asf/drill/blob/70415f26/_docs/img/web-ui-admin-view.png
----------------------------------------------------------------------
diff --git a/_docs/img/web-ui-admin-view.png b/_docs/img/web-ui-admin-view.png
index b7d8657..fbdb709 100644
Binary files a/_docs/img/web-ui-admin-view.png and b/_docs/img/web-ui-admin-view.png differ

http://git-wip-us.apache.org/repos/asf/drill/blob/70415f26/_docs/img/web-ui.png
----------------------------------------------------------------------
diff --git a/_docs/img/web-ui.png b/_docs/img/web-ui.png
index 2e14e1c..2e777c2 100644
Binary files a/_docs/img/web-ui.png and b/_docs/img/web-ui.png differ

http://git-wip-us.apache.org/repos/asf/drill/blob/70415f26/_docs/install/060-starting-the-web-ui.md
----------------------------------------------------------------------
diff --git a/_docs/install/060-starting-the-web-ui.md b/_docs/install/060-starting-the-web-ui.md
index 5e8a885..df21bc6 100644
--- a/_docs/install/060-starting-the-web-ui.md
+++ b/_docs/install/060-starting-the-web-ui.md
@@ -22,23 +22,19 @@ In Drill 1.2 and later, to open the Drill Web Console, launch a web browser,
and
 * `https://<IP address or host name>:8047`  
   Use this URL when HTTPS support is enabled.
 
-If HTTPS support is enabled, you need [authorization]({{site.baseurl}}/docs/configuring-web-console-and-rest-api-security/)
to see and use the Storage tab of the Web Console. 
-
-If [user authentication]({{site.baseurl}}/docs/configuring-user-authentication/) is not enabled,
the Web Console controls appear: 
+If [user authentication]({{site.baseurl}}/docs/configuring-user-authentication/) is not enabled,
all the Web Console controls appear to users as well as administrators:  
 
 ![Web Console]({{ site.baseurl }}/docs/img/web-ui.png)
 
-Select the Storage tab to view, update, or add a new [storage plugin configuration]({{site.baseurl}}/docs/plugin-configuration-basics/).
-
-If [user authentication]({{site.baseurl}}/docs/configuring-user-authentication/) is enabled,
Drill prompts you for a user name and password:
+If [user authentication]({{site.baseurl}}/docs/configuring-user-authentication/) is enabled,
Drill prompts you for a user name/password:
 
 ![Web Console Login]({{ site.baseurl }}/docs/img/web-ui-login.png)
 
-If an [administrator]({{ site.baseurl }}/docs/configuring-user-authentication/#administrator-privileges)
logs in, all the Web Console controls appear: Query, Profiles, Storage, Metrics, Threads,
and Options.
+If an [administrator]({{ site.baseurl }}/docs/configuring-user-authentication/#administrator-privileges)
logs in, all the Web Console controls appear: Query, Profiles, Storage, Metrics, Threads,
and Options. The Profiles page for administrators contains the profiles of all queries executed
on a cluster. Only administrators can see and use the Storage tab to view, update, or add
a new [storage plugin configuration]({{site.baseurl}}/docs/plugin-configuration-basics/).
Only administrators can see and use the Threads tab, which provides information about threads
running in Drill.
 
 ![Web Console Admin View]({{ site.baseurl }}/docs/img/web-ui-admin-view.png)
 
-If a user, who is not an administrator, logs in, the Web Console controls are limited to
Query, Metrics, and Profiles. The Profiles page for a non-administrator user contains the
profiles of all queries the user issued either through ODBC, JDBC, or the Web Console. The
Profiles pages for administrators contains the profiles of all queries executed on a cluster.
Only administrators can see and use the Storage control for managing storage plugin configurations.
+If a user, who is not an administrator, logs in, the Web Console controls are limited to
Query, Metrics, and Profiles. The Profiles tab for a non-administrator user contains the profiles
of all queries the user issued either through ODBC, JDBC, or the Web Console. 
 
 ![Web Console User View]({{ site.baseurl }}/docs/img/web-ui-user-view.png)
 


Mime
View raw message