Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B6E6E1037E for ; Tue, 27 Aug 2013 21:51:52 +0000 (UTC) Received: (qmail 67553 invoked by uid 500); 27 Aug 2013 21:51:52 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 67446 invoked by uid 500); 27 Aug 2013 21:51:52 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 67437 invoked by uid 500); 27 Aug 2013 21:51:51 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 67434 invoked by uid 99); 27 Aug 2013 21:51:51 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 27 Aug 2013 21:51:51 +0000 Date: Tue, 27 Aug 2013 21:51:51 +0000 (UTC) From: "Sergey Shelukhin (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HIVE-4914) filtering via partition name should be done inside metastore server (implementation) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-4914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-4914: ----------------------------------- Description: Currently, if the filter pushdown is impossible (which is most cases), the client gets all partition names from metastore, filters them, and asks for partitions by names for the filtered set. Metastore server code should do that instead; it should check if pushdown is possible and do it if so; otherwise it should do name-based filtering. Saves the roundtrip with all partition names from the server to client, and also removes the need to have pushdown viability checking on both sides. NO PRECOMMIT TESTS was: Currently, if the filter pushdown is impossible (which is most cases), the client gets all partition names from metastore, filters them, and asks for partitions by names for the filtered set. Metastore server code should do that instead; it should check if pushdown is possible and do it if so; otherwise it should do name-based filtering. Saves the roundtrip with all partition names from the server to client, and also removes the need to have pushdown viability checking on both sides. > filtering via partition name should be done inside metastore server (implementation) > ------------------------------------------------------------------------------------ > > Key: HIVE-4914 > URL: https://issues.apache.org/jira/browse/HIVE-4914 > Project: Hive > Issue Type: Improvement > Components: Metastore > Reporter: Sergey Shelukhin > Assignee: Sergey Shelukhin > Attachments: HIVE-4914.01.patch, HIVE-4914-only-no-gen.patch, HIVE-4914-only.patch, HIVE-4914.patch, HIVE-4914.patch, HIVE-4914.patch > > > Currently, if the filter pushdown is impossible (which is most cases), the client gets all partition names from metastore, filters them, and asks for partitions by names for the filtered set. > Metastore server code should do that instead; it should check if pushdown is possible and do it if so; otherwise it should do name-based filtering. > Saves the roundtrip with all partition names from the server to client, and also removes the need to have pushdown viability checking on both sides. > NO PRECOMMIT TESTS -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira