drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arina Ielchiieva (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-6331) Parquet filter pushdown does not support the native hive reader
Date Mon, 16 Apr 2018 13:09:00 GMT
Arina Ielchiieva created DRILL-6331:
---------------------------------------

             Summary: Parquet filter pushdown does not support the native hive reader
                 Key: DRILL-6331
                 URL: https://issues.apache.org/jira/browse/DRILL-6331
             Project: Apache Drill
          Issue Type: Improvement
          Components: Storage - Hive
    Affects Versions: 1.13.0
            Reporter: Arina Ielchiieva
            Assignee: Arina Ielchiieva
             Fix For: 1.14.0


Initially HiveDrillNativeParquetGroupScan was based mainly on HiveScan, the core difference
between them was
that HiveDrillNativeParquetScanBatchCreator was creating ParquetRecordReader instead of HiveReader.
This allowed to read Hive parquet files using Drill native parquet reader but did not expose
Hive data to Drill optimizations.
For example, filter push down, limit push down, count to direct scan optimizations.
Hive code had to be refactored to use the same interfaces as ParquestGroupScan in order to
be exposed to such optimizations.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message