hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mithun Radhakrishnan (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-11548) HCatLoader should support predicate pushdown.
Date Thu, 13 Aug 2015 18:10:45 GMT
Mithun Radhakrishnan created HIVE-11548:
-------------------------------------------

             Summary: HCatLoader should support predicate pushdown.
                 Key: HIVE-11548
                 URL: https://issues.apache.org/jira/browse/HIVE-11548
             Project: Hive
          Issue Type: New Feature
          Components: HCatalog
            Reporter: Mithun Radhakrishnan
            Assignee: Mithun Radhakrishnan


When one uses {{HCatInputFormat}}/{{HCatLoader}} to read from file-formats that support predicate
pushdown (such as ORC, with {{hive.optimize.index.filter=true}}), one sees that the predicates
aren't actually pushed down into the storage layer.

The forthcoming patch should allow for filter-pushdown, if any of the partitions being scanned
with {{HCatLoader}} support the functionality. The patch should technically allow the same
for users of {{HCatInputFormat}}, but I don't currently have a neat interface to build a compound
predicate-expression. Will add this separately, if required.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message