Return-Path: Delivered-To: apmail-hadoop-hive-dev-archive@minotaur.apache.org Received: (qmail 69867 invoked from network); 1 Dec 2009 18:54:43 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 1 Dec 2009 18:54:43 -0000 Received: (qmail 63244 invoked by uid 500); 1 Dec 2009 18:54:43 -0000 Delivered-To: apmail-hadoop-hive-dev-archive@hadoop.apache.org Received: (qmail 63210 invoked by uid 500); 1 Dec 2009 18:54:43 -0000 Mailing-List: contact hive-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hive-dev@hadoop.apache.org Delivered-To: mailing list hive-dev@hadoop.apache.org Received: (qmail 63184 invoked by uid 99); 1 Dec 2009 18:54:43 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 01 Dec 2009 18:54:43 +0000 X-ASF-Spam-Status: No, hits=-10.5 required=5.0 tests=AWL,BAYES_00,RCVD_IN_DNSWL_HI X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 01 Dec 2009 18:54:40 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id B1E01234C045 for ; Tue, 1 Dec 2009 10:54:20 -0800 (PST) Message-ID: <2084418688.1259693660714.JavaMail.jira@brutus> Date: Tue, 1 Dec 2009 18:54:20 +0000 (UTC) From: "Namit Jain (JIRA)" To: hive-dev@hadoop.apache.org Subject: [jira] Commented: (HIVE-549) Parallel Execution Mechanism In-Reply-To: <109659177.1244447167790.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12784336#action_12784336 ] Namit Jain commented on HIVE-549: --------------------------------- I will take a look > Parallel Execution Mechanism > ---------------------------- > > Key: HIVE-549 > URL: https://issues.apache.org/jira/browse/HIVE-549 > Project: Hadoop Hive > Issue Type: Wish > Components: Query Processor > Affects Versions: 0.3.0 > Reporter: Adam Kramer > Assignee: Chaitanya Mishra > Attachments: HIVE549-v6.patch > > > In a massively parallel database system, it would be awesome to also parallelize some of the mapreduce phases that our data needs to go through. > One example that just occurred to me is UNION ALL: when you union two SELECT statements, effectively you could run those statements in parallel. There's no situation (that I can think of, but I don't have a formal proof) in which the left statement would rely on the right statement, or vice versa. So, they could be run at the same time...and perhaps they should be. Or, perhaps there should be a way to make this happen...PARALLEL UNION ALL? PUNION ALL? -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.