drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rahul Challapalli (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-3788) Partition Pruning not taking place with metadata caching when we have ~20k files
Date Wed, 16 Sep 2015 16:08:46 GMT

    [ https://issues.apache.org/jira/browse/DRILL-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14790624#comment-14790624
] 

Rahul Challapalli commented on DRILL-3788:
------------------------------------------

[~amansinha100] Metadata Caching + Auto Partitioned Parquet Data + Partition Pruning seems
to be working fine

> Partition Pruning not taking place with metadata caching when we have ~20k files
> --------------------------------------------------------------------------------
>
>                 Key: DRILL-3788
>                 URL: https://issues.apache.org/jira/browse/DRILL-3788
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Query Planning & Optimization
>    Affects Versions: 1.2.0
>            Reporter: Rahul Challapalli
>            Assignee: Aman Sinha
>            Priority: Critical
>             Fix For: 1.2.0
>
>         Attachments: lineitem.tgz, plan.txt
>
>
> git.commit.id.abbrev=240a455
> Partition Pruning did not take place for the below query after I executed the "refresh
table metadata command"
> {code}
>  explain plan for 
> select
>   l_returnflag,
>   l_linestatus
> from
>   `lineitem/2006/1`
> where
>   dir0=1 or dir0=2
> {code}
> The logs did not indicate that "pruning did not take place"
> Before executing the refresh table metadata command, partition pruning did take effect
> I am not attaching the data set as it is larger than 10MB. Reach out to me if you need
more information



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message