Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E69DA177AD for ; Thu, 6 Nov 2014 00:13:34 +0000 (UTC) Received: (qmail 86802 invoked by uid 500); 6 Nov 2014 00:13:34 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 86739 invoked by uid 500); 6 Nov 2014 00:13:34 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 86726 invoked by uid 500); 6 Nov 2014 00:13:34 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 86723 invoked by uid 99); 6 Nov 2014 00:13:34 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 06 Nov 2014 00:13:34 +0000 Date: Thu, 6 Nov 2014 00:13:34 +0000 (UTC) From: "Prasanth J (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HIVE-8740) Sorted dynamic partition does not work correctly with constant folding MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-8740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth J updated HIVE-8740: ----------------------------- Attachment: HIVE-8740.4.patch Rebased patch after HIVE-8716 commit. > Sorted dynamic partition does not work correctly with constant folding > ---------------------------------------------------------------------- > > Key: HIVE-8740 > URL: https://issues.apache.org/jira/browse/HIVE-8740 > Project: Hive > Issue Type: Bug > Affects Versions: 0.14.0 > Reporter: Prasanth J > Assignee: Prasanth J > Attachments: HIVE-8740.1.patch, HIVE-8740.2.patch, HIVE-8740.3.patch, HIVE-8740.4.patch > > > Sorted dynamic partition optimization looks for partition columns from the operator above FileSinkOperator. As per hive convention it expects partition columns at the last. But with HIVE-8585 equality filters on partition columns gets folded to constant. The column pruner then prunes the constant expression as they don't reference any columns. This in some cases will yield unexpected results (throw ArrayIndexOutOfBounds exception) with sorted dynamic partition insert optimization. In such cases we don't really need sorted dynamic partition optimization. -- This message was sent by Atlassian JIRA (v6.3.4#6332)