Return-Path: Delivered-To: apmail-hadoop-hive-dev-archive@minotaur.apache.org Received: (qmail 24690 invoked from network); 1 Nov 2009 23:03:22 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 1 Nov 2009 23:03:22 -0000 Received: (qmail 49984 invoked by uid 500); 1 Nov 2009 23:03:22 -0000 Delivered-To: apmail-hadoop-hive-dev-archive@hadoop.apache.org Received: (qmail 49920 invoked by uid 500); 1 Nov 2009 23:03:22 -0000 Mailing-List: contact hive-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hive-dev@hadoop.apache.org Delivered-To: mailing list hive-dev@hadoop.apache.org Received: (qmail 49905 invoked by uid 99); 1 Nov 2009 23:03:22 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 01 Nov 2009 23:03:22 +0000 X-ASF-Spam-Status: No, hits=-10.5 required=5.0 tests=AWL,BAYES_00,RCVD_IN_DNSWL_HI X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 01 Nov 2009 23:03:19 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 76310234C1F2 for ; Sun, 1 Nov 2009 15:02:59 -0800 (PST) Message-ID: <1795137728.1257116579468.JavaMail.jira@brutus> Date: Sun, 1 Nov 2009 23:02:59 +0000 (UTC) From: "Zheng Shao (JIRA)" To: hive-dev@hadoop.apache.org Subject: [jira] Commented: (HIVE-549) Parallel Execution Mechanism In-Reply-To: <109659177.1244447167790.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12772385#action_12772385 ] Zheng Shao commented on HIVE-549: --------------------------------- THIVE-549-v3.patch: Can you add javadoc comments to all public methods (except getters and setters)? I know we were not following that all the time historically, but we want to enforce that on all new patches. It seems to me that "shouldLaunch()" is a better name than "checkLaunch()", but it's up to you whether you would like to change it. Can we change the name of "hive.optimize.par" to "hive.execution.parallel"? "optimize" was meant for plan optimization. This is an execution time option. Also "par" does not reflect to "parallel" in my mind. > Parallel Execution Mechanism > ---------------------------- > > Key: HIVE-549 > URL: https://issues.apache.org/jira/browse/HIVE-549 > Project: Hadoop Hive > Issue Type: Wish > Components: Query Processor > Reporter: Adam Kramer > Assignee: Chaitanya Mishra > Attachments: HIVE-549-v3.patch > > > In a massively parallel database system, it would be awesome to also parallelize some of the mapreduce phases that our data needs to go through. > One example that just occurred to me is UNION ALL: when you union two SELECT statements, effectively you could run those statements in parallel. There's no situation (that I can think of, but I don't have a formal proof) in which the left statement would rely on the right statement, or vice versa. So, they could be run at the same time...and perhaps they should be. Or, perhaps there should be a way to make this happen...PARALLEL UNION ALL? PUNION ALL? -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.