impala-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alexander Behm (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (IMPALA-4869) Runtime Partition Pruning for Derived Tables
Date Tue, 13 Jun 2017 01:48:00 GMT

     [ https://issues.apache.org/jira/browse/IMPALA-4869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Alexander Behm resolved IMPALA-4869.
------------------------------------
    Resolution: Information Provided

> Runtime Partition Pruning for Derived Tables
> --------------------------------------------
>
>                 Key: IMPALA-4869
>                 URL: https://issues.apache.org/jira/browse/IMPALA-4869
>             Project: IMPALA
>          Issue Type: New Feature
>          Components: Backend
>    Affects Versions: Impala 2.7.0
>            Reporter: Scott Wallace
>         Attachments: query_summary.txt
>
>
> We are able to partition prune when we have a query like this example where both tables
are materialized:
> {code}
> select *
> from fact_table f inner join dim_date d on d.date_key = f.date_key 
> where date_key = '2016-01-01';
> {code}
> However, it would be nice to be able to partition prune using a non-materialized table.
A couple examples of queries that I wished would partition prune:
> Example 1:
> {code}
> select *
> from fact_table f inner join (select date_key from dim_date where date_key = '2016-01-01')
d on d.date_key = f.date_key;
> {code}
> Example 2:
> {code}
> select *
> from fact_table f where date_key in (select date_key from dim_date where date_key = '2016-01-01');
> {code}
> Both of these examples will scan all partitions in fact_table. 
> There are cases where we need to do a pre-query to determine key values and pass to the
second query filter on partition key in order to partition prune. It would be nice to do this
in a single step. Even if it were some hint to provide this ability, it would be a great feature.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message