hawq-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From yo...@apache.org
Subject [12/14] incubator-hawq-docs git commit: incorporate kavinder's comments
Date Thu, 27 Oct 2016 23:33:06 GMT
incorporate kavinder's comments

- add new section "Configure Partition Filtering Push-Down
- elaborate on Hive profile user for multiple file format types


Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/67958d62
Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/67958d62
Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/67958d62

Branch: refs/heads/develop
Commit: 67958d628c8a2b46ceeb94904ad5012191f46d72
Parents: 8ee05a3
Author: Lisa Owen <lowen@pivotal.io>
Authored: Thu Oct 27 14:08:22 2016 -0700
Committer: Lisa Owen <lowen@pivotal.io>
Committed: Thu Oct 27 14:08:22 2016 -0700

----------------------------------------------------------------------
 pxf/HivePXF.html.md.erb | 27 ++++++++++++++++++++++++---
 1 file changed, 24 insertions(+), 3 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/67958d62/pxf/HivePXF.html.md.erb
----------------------------------------------------------------------
diff --git a/pxf/HivePXF.html.md.erb b/pxf/HivePXF.html.md.erb
index 7d77bc5..d1c803b 100644
--- a/pxf/HivePXF.html.md.erb
+++ b/pxf/HivePXF.html.md.erb
@@ -176,9 +176,9 @@ Hive-plug-in-specific keywords and values used in the [CREATE EXTERNAL
TABLE](..
 
 ## <a id="profile_hive"></a>Hive Profile
 
-The `Hive` profile works with any Hive file format.
+The `Hive` profile works with any Hive file format. It can access heterogenous format data
in a single table where each partition may be stored as a different file format.
 
-While you can use the `Hive` profile to access any file format, the more specific profiles
perform better for those specific file types.
+While you can use the `Hive` profile to access any file format, the more specific profiles
perform better for those single file format types.
 
 
 ### <a id="profile_hive_using"></a>Example: Using the Hive Profile
@@ -211,7 +211,7 @@ Use the `Hive` profile to create a queryable HAWQ external table from
the Hive `
 
 ## <a id="profile_hivetext"></a>HiveText Profile
 
-Use the `HiveText` profile to query text formats. The `HiveText` profile is more performant
than the `Hive` profile.
+Use the `HiveText` profile to query text format files. The `HiveText` profile is more performant
than the `Hive` profile.
 
 **Note**: When using the `HiveText` profile, you *must* specify a delimiter option in *both*
the `LOCATION` and `FORMAT` clauses.
 
@@ -325,6 +325,13 @@ postgres=# CREATE EXTERNAL TABLE pxf_parquet_table (fname text, lname
text, cust
     FORMAT 'CUSTOM' (formatter='pxfwritable_import');
 ```
 
+And query the HAWQ external table using:
+
+``` sql
+postgres=# SELECT fname,lname FROM pxf_parquet_table;
+```
+
+
 ## <a id="profileperf"></a>Profile Performance Considerations
 
 The `HiveRC` and `HiveText` profiles are faster than the generic `Hive` profile.
@@ -561,6 +568,19 @@ To take advantage of PXF partition filtering push-down, the Hive and
PXF partiti
 
 **Note:** The Hive plug-in filters only on partition columns, not on other table attributes.
 
+### <a id="partitionfiltering_pushdowncfg"></a>Configure Partition Filtering
Push-Down
+
+PXF partition filtering push-down is enabled by default. To disable PXF partition filtering
push-down, set the `pxf_enable_filter_pushdown` HAWQ server configuration parameter to `off`:
+
+``` sql
+postgres=# show pxf_enable_filter_pushdown;
+ pxf_enable_filter_pushdown
+-----------------------------
+ on
+(1 row)
+postgres=# set pxf_enable_filter_pushdown=off;
+```
+
 ### <a id="example2"></a>Create Partitioned Hive Table
 
 Create a Hive table `sales_part` with two partition columns, `delivery_state` and `delivery_city:`
@@ -628,6 +648,7 @@ postgres=# SELECT * FROM pxf_sales_part WHERE delivery_city = 'Sacramento'
AND i
 The following HAWQ query reads all the data under `delivery_state` partition `CALIFORNIA`,
regardless of the city.
 
 ``` sql
+postgres=# set pxf_enable_filter_pushdown=on;
 postgres=# SELECT * FROM pxf_sales_part WHERE delivery_state = 'CALIFORNIA';
 ```
 


Mime
View raw message