flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "godfrey he (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-5859) support partition pruning on Table API & SQL
Date Tue, 21 Feb 2017 02:58:44 GMT
godfrey he created FLINK-5859:

             Summary: support partition pruning on Table API & SQL
                 Key: FLINK-5859
                 URL: https://issues.apache.org/jira/browse/FLINK-5859
             Project: Flink
          Issue Type: New Feature
          Components: Table API & SQL
            Reporter: godfrey he
            Assignee: godfrey he

Many data sources are partitionable storage, e.g. HDFS, Druid. And many queries just need
to read a small subset of the total data. We can use partition information to prune or skip
over files irrelevant to the user’s queries. Both query optimization time and execution
time can be reduced obviously, especially for a large partitioned table.

This message was sent by Atlassian JIRA

View raw message