drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Damien Profeta (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-5797) Use more often the new parquet reader
Date Sat, 16 Sep 2017 01:06:00 GMT
Damien Profeta created DRILL-5797:

             Summary: Use more often the new parquet reader
                 Key: DRILL-5797
                 URL: https://issues.apache.org/jira/browse/DRILL-5797
             Project: Apache Drill
          Issue Type: Improvement
          Components: Storage - Parquet
            Reporter: Damien Profeta

The choice of using the regular parquet reader of the optimized one is based of what type
of columns is in the file. But the columns that are read by the query doesn't matter. We can
increase a little bit the cases where the optimized reader is used by checking is the projected
column are simple or not.
This is an optimization waiting for the fast parquet reader to handle complex structure.

This message was sent by Atlassian JIRA

View raw message