Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id E3891200CB7 for ; Fri, 30 Jun 2017 21:38:52 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id DA5BD160BEB; Fri, 30 Jun 2017 19:38:52 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 2A3ED160BE8 for ; Fri, 30 Jun 2017 21:38:52 +0200 (CEST) Received: (qmail 8368 invoked by uid 500); 30 Jun 2017 19:38:51 -0000 Mailing-List: contact commits-help@ambari.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: ambari-dev@ambari.apache.org Delivered-To: mailing list commits@ambari.apache.org Received: (qmail 8359 invoked by uid 99); 30 Jun 2017 19:38:51 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 30 Jun 2017 19:38:51 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 63268DFFAB; Fri, 30 Jun 2017 19:38:49 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: lavjain@apache.org To: commits@ambari.apache.org Message-Id: <80afa2fcde70402098a064a02413f974@git.apache.org> X-Mailer: ASF-Git Admin Mailer Subject: ambari git commit: AMBARI-21377: Add HiveVectorizedORC and JDBC profiles to pxf-profiles.xml Date: Fri, 30 Jun 2017 19:38:49 +0000 (UTC) archived-at: Fri, 30 Jun 2017 19:38:53 -0000 Repository: ambari Updated Branches: refs/heads/branch-2.5 a55172f45 -> 5e60ea646 AMBARI-21377: Add HiveVectorizedORC and JDBC profiles to pxf-profiles.xml Project: http://git-wip-us.apache.org/repos/asf/ambari/repo Commit: http://git-wip-us.apache.org/repos/asf/ambari/commit/5e60ea64 Tree: http://git-wip-us.apache.org/repos/asf/ambari/tree/5e60ea64 Diff: http://git-wip-us.apache.org/repos/asf/ambari/diff/5e60ea64 Branch: refs/heads/branch-2.5 Commit: 5e60ea6462183984a13e09ebc8c1d22f95c86f8f Parents: a55172f Author: lavjain Authored: Fri Jun 30 12:38:38 2017 -0700 Committer: lavjain Committed: Fri Jun 30 12:38:38 2017 -0700 ---------------------------------------------------------------------- .../PXF/3.0.0/configuration/pxf-profiles.xml | 23 ++++++++++++++++++++ 1 file changed, 23 insertions(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/ambari/blob/5e60ea64/ambari-server/src/main/resources/common-services/PXF/3.0.0/configuration/pxf-profiles.xml ---------------------------------------------------------------------- diff --git a/ambari-server/src/main/resources/common-services/PXF/3.0.0/configuration/pxf-profiles.xml b/ambari-server/src/main/resources/common-services/PXF/3.0.0/configuration/pxf-profiles.xml index a3e587d..27473a1 100644 --- a/ambari-server/src/main/resources/common-services/PXF/3.0.0/configuration/pxf-profiles.xml +++ b/ambari-server/src/main/resources/common-services/PXF/3.0.0/configuration/pxf-profiles.xml @@ -74,6 +74,7 @@ under the License. This profile is suitable for using when connecting to Hive. Supports GPDBWritable output format, as specified in FORMAT header parameter. + It auto-detects actual file storage format and uses an optimized profile (HiveRC, HiveText, HiveORC) if applicable. org.apache.hawq.pxf.plugins.hive.HiveDataFragmenter @@ -132,6 +133,19 @@ under the License. + HiveVectorizedORC + This profile is same as HiveORC profile, but operates on batches of rows + instead of one row at a time, leading to faster reading and resolution phases. + + + org.apache.hawq.pxf.plugins.hive.HiveInputFormatFragmenter + org.apache.hawq.pxf.plugins.hive.HiveORCVectorizedAccessor + org.apache.hawq.pxf.plugins.hive.HiveORCVectorizedResolver + org.apache.hawq.pxf.plugins.hive.HiveMetadataFetcher + org.apache.hawq.pxf.service.io.GPDBWritable + + + HdfsTextSimple This profile is suitable for using when reading delimited single line records from plain text files on HDFS @@ -196,6 +210,15 @@ under the License. org.apache.hawq.pxf.plugins.json.JsonResolver + + Jdbc + A profile for reading data into HAWQ via JDBC + + org.apache.hawq.pxf.plugins.jdbc.JdbcPartitionFragmenter + org.apache.hawq.pxf.plugins.jdbc.JdbcReadAccessor + org.apache.hawq.pxf.plugins.jdbc.JdbcReadResolver + + ]]>