drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stefán Baxter (JIRA) <j...@apache.org>
Subject [jira] [Commented] (DRILL-3560) Make partition pruning work for directory queries
Date Tue, 04 Aug 2015 04:50:04 GMT

    [ https://issues.apache.org/jira/browse/DRILL-3560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14653057#comment-14653057

Stefán Baxter commented on DRILL-3560:


Strange, for the tests we did this was evaluated for all the records in all
the files in all the directories.

Let me see if I can create a test-case for you.


> Make partition pruning work for directory queries
> -------------------------------------------------
>                 Key: DRILL-3560
>                 URL: https://issues.apache.org/jira/browse/DRILL-3560
>             Project: Apache Drill
>          Issue Type: New Feature
>          Components: Query Planning & Optimization
>    Affects Versions: 1.1.0
>            Reporter: Stefán Baxter
>            Assignee: Aman Sinha
>         Attachments: table.tar
> Currently queries that include directory conditions are not optimized at all and the
directory expression (dir0 = 'something') is evaluated for every record of every file for
every directory.
> This could be optimized to fail directories and allow for the same kind of partition
pruning for directories as for other scenarios where data has been partitioned.

This message was sent by Atlassian JIRA

View raw message