Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1222510A31 for ; Wed, 9 Oct 2013 05:28:55 +0000 (UTC) Received: (qmail 43774 invoked by uid 500); 9 Oct 2013 05:28:49 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 43674 invoked by uid 500); 9 Oct 2013 05:28:47 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 43651 invoked by uid 500); 9 Oct 2013 05:28:43 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 43639 invoked by uid 99); 9 Oct 2013 05:28:42 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 09 Oct 2013 05:28:42 +0000 Date: Wed, 9 Oct 2013 05:28:41 +0000 (UTC) From: "Ashutosh Chauhan (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Comment Edited] (HIVE-5498) Merge metadata only optimizer into simple fetch optimizer MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-5498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13790027#comment-13790027 ] Ashutosh Chauhan edited comment on HIVE-5498 at 10/9/13 5:26 AM: ----------------------------------------------------------------- With {{set hive.fetch.task.conversion = more;}} and {{set hive.fetch.task.aggr=true;}}This has many advantages: * queries which metadata only optimizer currently targets can be run purely in client without launching MR job. Currently it launches MR job for it which is wasteful. So, it will be faster than its current form. * Since we won't be launching MR job we won't have to deal with bugs like HIVE-3594 and HIVE-2955 * Than we can get rid of hacks like Utilites::getInputs() and Utilities::setInputs() * This will result in lesser code to maintain * This can lay foundation for HIVE-4150 was (Author: ashutoshc): This has many advantages: * queries which metadata only optimizer currently targets can be run purely in client without launching MR job. Currently it launches MR job for it which is wasteful. So, it will be faster than its current form. * Since we won't be launching MR job we won't have to deal with bugs like HIVE-3594 and HIVE-2955 * Than we can get rid of hacks like Utilites::getInputs() and Utilities::setInputs() * This will result in lesser code to maintain * This can lay foundation for HIVE-4150 > Merge metadata only optimizer into simple fetch optimizer > --------------------------------------------------------- > > Key: HIVE-5498 > URL: https://issues.apache.org/jira/browse/HIVE-5498 > Project: Hive > Issue Type: Improvement > Components: Query Processor > Reporter: Ashutosh Chauhan > > Metadata only optimizer is currently written as physical optimizer. It can be merged into simple fetch optimizer where it will than become a logical optimizer. -- This message was sent by Atlassian JIRA (v6.1#6144)