hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Phabricator (JIRA)" <>
Subject [jira] [Commented] (HIVE-4914) filtering via partition name should be done inside metastore server (implementation)
Date Tue, 24 Sep 2013 17:12:02 GMT


Phabricator commented on HIVE-4914:

ashutoshc has requested changes to the revision "HIVE-4914 [jira] filtering via partition
name should be done inside metastore server (implementation)".

  ql/src/java/org/apache/hadoop/hive/ql/exec/ Why do we need to this? Simply
use runtimeSerializationKryo.
  ql/src/java/org/apache/hadoop/hive/ql/exec/ Did you encounter into any
issue while serializing timestamps? We have other tests which serialize timestamp via Kryo,
we haven't encountered any problems there yet.
  metastore/src/java/org/apache/hadoop/hive/metastore/ I don't
see any error handling for method not found and failure to deserialize expression exceptions.
Are you planning to add them?


To: JIRA, ashutoshc, sershe

> filtering via partition name should be done inside metastore server (implementation)
> ------------------------------------------------------------------------------------
>                 Key: HIVE-4914
>                 URL:
>             Project: Hive
>          Issue Type: Improvement
>          Components: Metastore
>            Reporter: Sergey Shelukhin
>            Assignee: Sergey Shelukhin
>         Attachments: D12561.5.patch, D12561.6.patch, HIVE-4914.01.patch, HIVE-4914.02.patch,
HIVE-4914.03.patch, HIVE-4914.04.patch, HIVE-4914.05.patch, HIVE-4914.06.patch, HIVE-4914.D12561.1.patch,
HIVE-4914.D12561.2.patch, HIVE-4914.D12561.3.patch, HIVE-4914.D12561.4.patch, HIVE-4914.D12645.1.patch,
HIVE-4914-only-no-gen.patch, HIVE-4914-only.patch, HIVE-4914.patch, HIVE-4914.patch, HIVE-4914.patch
> Currently, if the filter pushdown is impossible (which is most cases), the client gets
all partition names from metastore, filters them, and asks for partitions by names for the
filtered set.
> Metastore server code should do that instead; it should check if pushdown is possible
and do it if so; otherwise it should do name-based filtering.
> Saves the roundtrip with all partition names from the server to client, and also removes
the need to have pushdown viability checking on both sides.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:

View raw message