hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mithun Radhakrishnan (JIRA)" <>
Subject [jira] [Commented] (HIVE-11548) HCatLoader should support predicate pushdown.
Date Wed, 30 Aug 2017 21:18:00 GMT


Mithun Radhakrishnan commented on HIVE-11548:

Hey, [~thejas]. Could I bug you for a review on this one? 

> HCatLoader should support predicate pushdown.
> ---------------------------------------------
>                 Key: HIVE-11548
>                 URL:
>             Project: Hive
>          Issue Type: New Feature
>          Components: HCatalog
>    Affects Versions: 3.0.0
>            Reporter: Mithun Radhakrishnan
>            Assignee: Mithun Radhakrishnan
>         Attachments: HIVE-11548.1.patch, HIVE-11548.2.patch, HIVE-11548.3.patch, HIVE-11548.4.patch,
> When one uses {{HCatInputFormat}}/{{HCatLoader}} to read from file-formats that support
predicate pushdown (such as ORC, with {{hive.optimize.index.filter=true}}), one sees that
the predicates aren't actually pushed down into the storage layer.
> The forthcoming patch should allow for filter-pushdown, if any of the partitions being
scanned with {{HCatLoader}} support the functionality. The patch should technically allow
the same for users of {{HCatInputFormat}}, but I don't currently have a neat interface to
build a compound predicate-expression. Will add this separately, if required.

This message was sent by Atlassian JIRA

View raw message