Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D1E1D17F64 for ; Thu, 16 Oct 2014 23:10:36 +0000 (UTC) Received: (qmail 53733 invoked by uid 500); 16 Oct 2014 23:10:34 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 53638 invoked by uid 500); 16 Oct 2014 23:10:34 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 53470 invoked by uid 500); 16 Oct 2014 23:10:34 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 53452 invoked by uid 99); 16 Oct 2014 23:10:34 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Oct 2014 23:10:34 +0000 Date: Thu, 16 Oct 2014 23:10:34 +0000 (UTC) From: "Chao (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HIVE-8233) multi-table insertion doesn't work with ForwardOperator [Spark Branch] MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao updated HIVE-8233: ----------------------- Resolution: Won't Fix Status: Resolved (was: Patch Available) > multi-table insertion doesn't work with ForwardOperator [Spark Branch] > ---------------------------------------------------------------------- > > Key: HIVE-8233 > URL: https://issues.apache.org/jira/browse/HIVE-8233 > Project: Hive > Issue Type: Bug > Components: Spark > Reporter: Chao > Assignee: Chao > Attachments: HIVE-8233.1-spark.patch, HIVE-8233.2-spark.patch, HIVE-8233.3-spark.patch, HIVE-8233.4-spark.patch, HIVE-8233.5-spark.patch > > > Right now, for multi-table insertion, we will start from multiple FileSinkOperators, and break from their lowest common ancestor, adding temporary FileSinkOperator and TableScanOperators. A special case is when the LCA is a ForwardOperator, in which case we don't break it, since it's already been optimized. > However, there's a issue, considering the following plan: > {noformat} > ... > RS_0 > | > FOR > | > / \ > GBY_1 GBY_2 > | | > ... ... > | | > RS_1 RS_2 > | | > ... ... > | | > FS_1 FS_2 > {noformat} > which may result to: > {noformat} > RW > / \ > RW RW > {noformat} > Hence, because of the issue in HIVE-7731 and HIVE-8118, both downstream branches will get duplicated (and same) input. -- This message was sent by Atlassian JIRA (v6.3.4#6332)