Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id DC94B10ABF for ; Tue, 18 Nov 2014 21:48:34 +0000 (UTC) Received: (qmail 83074 invoked by uid 500); 18 Nov 2014 21:48:34 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 83007 invoked by uid 500); 18 Nov 2014 21:48:34 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 82994 invoked by uid 500); 18 Nov 2014 21:48:34 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 82991 invoked by uid 99); 18 Nov 2014 21:48:34 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 18 Nov 2014 21:48:34 +0000 Date: Tue, 18 Nov 2014 21:48:34 +0000 (UTC) From: "Ashutosh Chauhan (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HIVE-8740) Sorted dynamic partition does not work correctly with constant folding MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-8740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-8740: ----------------------------------- Fix Version/s: (was: 0.15.0) > Sorted dynamic partition does not work correctly with constant folding > ---------------------------------------------------------------------- > > Key: HIVE-8740 > URL: https://issues.apache.org/jira/browse/HIVE-8740 > Project: Hive > Issue Type: Bug > Affects Versions: 0.14.0 > Reporter: Prasanth J > Assignee: Prasanth J > Fix For: 0.14.0 > > Attachments: HIVE-8740.1.patch, HIVE-8740.2.patch, HIVE-8740.3.patch, HIVE-8740.4.patch > > > Sorted dynamic partition optimization looks for partition columns from the operator above FileSinkOperator. As per hive convention it expects partition columns at the last. But with HIVE-8585 equality filters on partition columns gets folded to constant. The column pruner then prunes the constant expression as they don't reference any columns. This in some cases will yield unexpected results (throw ArrayIndexOutOfBounds exception) with sorted dynamic partition insert optimization. In such cases we don't really need sorted dynamic partition optimization. -- This message was sent by Atlassian JIRA (v6.3.4#6332)