hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Shelukhin (JIRA)" <>
Subject [jira] [Updated] (HIVE-4914) filtering via partition name should be done inside metastore server (implementation)
Date Thu, 22 Aug 2013 02:15:51 GMT


Sergey Shelukhin updated HIVE-4914:

    Attachment: HIVE-4914.patch

I have moved handling LIKE pushdown into separate JIRA because it takes inordinate amount
of pain and delays this needlessly.
Virtual columns issue was also fixed in a separate JIRA (it caused ppd_vc to fail in the last
run in this one).
Now it should work.

Note that new client cannot talk to old metastore server because API is not available... I
am not certain whether backward compat of that sort is needed, I can add it by re-adding some
old code in deprecated form.

RB also updated. Most of the patch is still generated code.
> filtering via partition name should be done inside metastore server (implementation)
> ------------------------------------------------------------------------------------
>                 Key: HIVE-4914
>                 URL:
>             Project: Hive
>          Issue Type: Improvement
>          Components: Metastore
>            Reporter: Sergey Shelukhin
>            Assignee: Sergey Shelukhin
>         Attachments: HIVE-4914-only-no-gen.patch, HIVE-4914-only.patch, HIVE-4914.patch,
HIVE-4914.patch, HIVE-4914.patch
> Currently, if the filter pushdown is impossible (which is most cases), the client gets
all partition names from metastore, filters them, and asks for partitions by names for the
filtered set.
> Metastore server code should do that instead; it should check if pushdown is possible
and do it if so; otherwise it should do name-based filtering.
> Saves the roundtrip with all partition names from the server to client, and also removes
the need to have pushdown viability checking on both sides.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:

View raw message