Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 07AF21041F for ; Mon, 23 Sep 2013 18:47:13 +0000 (UTC) Received: (qmail 49108 invoked by uid 500); 23 Sep 2013 18:47:10 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 49027 invoked by uid 500); 23 Sep 2013 18:47:08 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 48384 invoked by uid 500); 23 Sep 2013 18:47:05 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 48369 invoked by uid 99); 23 Sep 2013 18:47:04 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 23 Sep 2013 18:47:04 +0000 Date: Mon, 23 Sep 2013 18:47:04 +0000 (UTC) From: "Phabricator (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HIVE-4914) filtering via partition name should be done inside metastore server (implementation) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-4914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-4914: ------------------------------ Attachment: D12561.6.patch sershe updated the revision "HIVE-4914 [jira] filtering via partition name should be done inside metastore server (implementation)". Remove changes to deserialize that expose some unrelated existing bug Reviewers: ashutoshc, JIRA REVISION DETAIL https://reviews.facebook.net/D12561 CHANGE SINCE LAST DIFF https://reviews.facebook.net/D12561?vs=40233&id=40323#toc MANIPHEST TASKS https://reviews.facebook.net/T63 AFFECTED FILES common/src/java/org/apache/hadoop/hive/conf/HiveConf.java metastore/if/hive_metastore.thrift metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStoreClient.java metastore/src/java/org/apache/hadoop/hive/metastore/IMetaStoreClient.java metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreDirectSql.java metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java metastore/src/java/org/apache/hadoop/hive/metastore/PartitionExpressionProxy.java metastore/src/java/org/apache/hadoop/hive/metastore/RawStore.java metastore/src/java/org/apache/hadoop/hive/metastore/parser/ExpressionTree.java metastore/src/test/org/apache/hadoop/hive/metastore/DummyRawStoreControlledCommit.java metastore/src/test/org/apache/hadoop/hive/metastore/DummyRawStoreForJdoConnection.java ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java ql/src/java/org/apache/hadoop/hive/ql/optimizer/ppr/PartitionExpressionForMetastore.java ql/src/java/org/apache/hadoop/hive/ql/optimizer/ppr/PartitionPruner.java ql/src/test/org/apache/hadoop/hive/metastore/VerifyingObjectStore.java To: JIRA, ashutoshc, sershe > filtering via partition name should be done inside metastore server (implementation) > ------------------------------------------------------------------------------------ > > Key: HIVE-4914 > URL: https://issues.apache.org/jira/browse/HIVE-4914 > Project: Hive > Issue Type: Improvement > Components: Metastore > Reporter: Sergey Shelukhin > Assignee: Sergey Shelukhin > Attachments: D12561.5.patch, D12561.6.patch, HIVE-4914.01.patch, HIVE-4914.02.patch, HIVE-4914.03.patch, HIVE-4914.04.patch, HIVE-4914.05.patch, HIVE-4914.D12561.1.patch, HIVE-4914.D12561.2.patch, HIVE-4914.D12561.3.patch, HIVE-4914.D12561.4.patch, HIVE-4914.D12645.1.patch, HIVE-4914-only-no-gen.patch, HIVE-4914-only.patch, HIVE-4914.patch, HIVE-4914.patch, HIVE-4914.patch > > > Currently, if the filter pushdown is impossible (which is most cases), the client gets all partition names from metastore, filters them, and asks for partitions by names for the filtered set. > Metastore server code should do that instead; it should check if pushdown is possible and do it if so; otherwise it should do name-based filtering. > Saves the roundtrip with all partition names from the server to client, and also removes the need to have pushdown viability checking on both sides. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira