Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7C64C6723 for ; Fri, 29 Jul 2011 18:04:34 +0000 (UTC) Received: (qmail 92507 invoked by uid 500); 29 Jul 2011 18:04:34 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 92476 invoked by uid 500); 29 Jul 2011 18:04:33 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 92467 invoked by uid 500); 29 Jul 2011 18:04:33 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 92463 invoked by uid 99); 29 Jul 2011 18:04:32 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 29 Jul 2011 18:04:32 +0000 X-ASF-Spam-Status: No, hits=-2001.2 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 29 Jul 2011 18:04:31 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 39CE094F6B for ; Fri, 29 Jul 2011 18:04:11 +0000 (UTC) Date: Fri, 29 Jul 2011 18:04:11 +0000 (UTC) From: "Ning Zhang (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: <1108669772.19429.1311962651233.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <370981316.19421.1311962530776.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Updated] (HIVE-2324) Enhancing local mode execution with non-HDFS related queries MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-2324: ----------------------------- Description: Local mode execution are decided based on the input size. There are queries that do not involve data resides in HDFS at all. We should enhance local mode execution with these types of queries: 1) metadata only queries (HIVE-178, HIVE-1003). eg., {code} SELECT max(ds) From T WHERE ts = 'some_partition'; -- both ds and ts are partition columns {code} 2) DUAL table (HIVE-1558): {code} SELECT MYUDF('constant1', 'constant2') FROM DUAL; SELECT MYUDAF(...) FROM ( SELECT 'const1' col1, 'const2' col2 FROM DUAL ) A GROUP BY col1; {code} was: Local mode execution are decided based on the input size. There are queries that do not involve data resides in HDFS at all. We should enhance local mode execution with these types of queries: 1) metadata only queries. eg., {code} SELECT max(ds) From T WHERE ts = 'some_partition'; -- both ds and ts are partition columns {code} 2) DUAL table (HIVE-1558): {code} SELECT MYUDF('constant1', 'constant2') FROM DUAL; SELECT MYUDAF(...) FROM ( SELECT 'const1' col1, 'const2' col2 FROM DUAL ) A GROUP BY col1; {code} > Enhancing local mode execution with non-HDFS related queries > ------------------------------------------------------------- > > Key: HIVE-2324 > URL: https://issues.apache.org/jira/browse/HIVE-2324 > Project: Hive > Issue Type: New Feature > Reporter: Ning Zhang > > Local mode execution are decided based on the input size. There are queries that do not involve data resides in HDFS at all. We should enhance local mode execution with these types of queries: > 1) metadata only queries (HIVE-178, HIVE-1003). eg., > {code} > SELECT max(ds) From T WHERE ts = 'some_partition'; -- both ds and ts are partition columns > {code} > 2) DUAL table (HIVE-1558): > {code} > SELECT MYUDF('constant1', 'constant2') FROM DUAL; > SELECT MYUDAF(...) FROM ( SELECT 'const1' col1, 'const2' col2 FROM DUAL ) A GROUP BY col1; > {code} -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira