hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mithun Radhakrishnan (JIRA)" <>
Subject [jira] [Commented] (HIVE-11548) HCatLoader should support predicate pushdown.
Date Thu, 27 Aug 2015 21:20:47 GMT


Mithun Radhakrishnan commented on HIVE-11548:

Alright. I was able to reproduce the {{TestHCatClient.testTableSchemaPropagation()}} problem.
It seems to fail without this patch, so I'll work on that in a separate JIRA. I'm still having
trouble getting {{TestPigHBaseStorageHandler}} to fail.

> HCatLoader should support predicate pushdown.
> ---------------------------------------------
>                 Key: HIVE-11548
>                 URL:
>             Project: Hive
>          Issue Type: New Feature
>          Components: HCatalog
>            Reporter: Mithun Radhakrishnan
>            Assignee: Mithun Radhakrishnan
>         Attachments: HIVE-11548.1.patch
> When one uses {{HCatInputFormat}}/{{HCatLoader}} to read from file-formats that support
predicate pushdown (such as ORC, with {{hive.optimize.index.filter=true}}), one sees that
the predicates aren't actually pushed down into the storage layer.
> The forthcoming patch should allow for filter-pushdown, if any of the partitions being
scanned with {{HCatLoader}} support the functionality. The patch should technically allow
the same for users of {{HCatInputFormat}}, but I don't currently have a neat interface to
build a compound predicate-expression. Will add this separately, if required.

This message was sent by Atlassian JIRA

View raw message