hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mithun Radhakrishnan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-11548) HCatLoader should support predicate pushdown.
Date Thu, 27 Aug 2015 21:20:47 GMT

    [ https://issues.apache.org/jira/browse/HIVE-11548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14717557#comment-14717557
] 

Mithun Radhakrishnan commented on HIVE-11548:
---------------------------------------------

Alright. I was able to reproduce the {{TestHCatClient.testTableSchemaPropagation()}} problem.
It seems to fail without this patch, so I'll work on that in a separate JIRA. I'm still having
trouble getting {{TestPigHBaseStorageHandler}} to fail.

> HCatLoader should support predicate pushdown.
> ---------------------------------------------
>
>                 Key: HIVE-11548
>                 URL: https://issues.apache.org/jira/browse/HIVE-11548
>             Project: Hive
>          Issue Type: New Feature
>          Components: HCatalog
>            Reporter: Mithun Radhakrishnan
>            Assignee: Mithun Radhakrishnan
>         Attachments: HIVE-11548.1.patch
>
>
> When one uses {{HCatInputFormat}}/{{HCatLoader}} to read from file-formats that support
predicate pushdown (such as ORC, with {{hive.optimize.index.filter=true}}), one sees that
the predicates aren't actually pushed down into the storage layer.
> The forthcoming patch should allow for filter-pushdown, if any of the partitions being
scanned with {{HCatLoader}} support the functionality. The patch should technically allow
the same for users of {{HCatInputFormat}}, but I don't currently have a neat interface to
build a compound predicate-expression. Will add this separately, if required.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message