Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B04F817207 for ; Wed, 5 Nov 2014 22:40:34 +0000 (UTC) Received: (qmail 17155 invoked by uid 500); 5 Nov 2014 22:40:34 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 17082 invoked by uid 500); 5 Nov 2014 22:40:34 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 17071 invoked by uid 500); 5 Nov 2014 22:40:34 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 17068 invoked by uid 99); 5 Nov 2014 22:40:34 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Nov 2014 22:40:34 +0000 Date: Wed, 5 Nov 2014 22:40:34 +0000 (UTC) From: "Prasanth J (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HIVE-8740) Sorted dynamic partition does not work correctly with constant folding MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-8740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth J updated HIVE-8740: ----------------------------- Attachment: HIVE-8740.3.patch Added more tests to cover cases where sorted dynamic partition is enabled and constant propagation is disabled to make sure the generated plan and results are correct. > Sorted dynamic partition does not work correctly with constant folding > ---------------------------------------------------------------------- > > Key: HIVE-8740 > URL: https://issues.apache.org/jira/browse/HIVE-8740 > Project: Hive > Issue Type: Bug > Affects Versions: 0.14.0 > Reporter: Prasanth J > Assignee: Prasanth J > Attachments: HIVE-8740.1.patch, HIVE-8740.2.patch, HIVE-8740.3.patch > > > Sorted dynamic partition optimization looks for partition columns from the operator above FileSinkOperator. As per hive convention it expects partition columns at the last. But with HIVE-8585 equality filters on partition columns gets folded to constant. The column pruner then prunes the constant expression as they don't reference any columns. This in some cases will yield unexpected results (throw ArrayIndexOutOfBounds exception) with sorted dynamic partition insert optimization. In such cases we don't really need sorted dynamic partition optimization. -- This message was sent by Atlassian JIRA (v6.3.4#6332)