Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 1B74F200B72 for ; Thu, 11 Aug 2016 20:21:22 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 17D9A160A94; Thu, 11 Aug 2016 18:21:22 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 66327160A90 for ; Thu, 11 Aug 2016 20:21:21 +0200 (CEST) Received: (qmail 77000 invoked by uid 500); 11 Aug 2016 18:21:20 -0000 Mailing-List: contact issues-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list issues@hive.apache.org Received: (qmail 76976 invoked by uid 99); 11 Aug 2016 18:21:20 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 11 Aug 2016 18:21:20 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 7AB792C029E for ; Thu, 11 Aug 2016 18:21:20 +0000 (UTC) Date: Thu, 11 Aug 2016 18:21:20 +0000 (UTC) From: "Saket Saurabh (JIRA)" To: issues@hive.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HIVE-14035) Enable predicate pushdown to delta files created by ACID Transactions MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Thu, 11 Aug 2016 18:21:22 -0000 [ https://issues.apache.org/jira/browse/HIVE-14035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saket Saurabh updated HIVE-14035: --------------------------------- Attachment: HIVE-14035.16.patch Rebase with master and fix the two failing UTs due to a trivial case mismatch error. > Enable predicate pushdown to delta files created by ACID Transactions > --------------------------------------------------------------------- > > Key: HIVE-14035 > URL: https://issues.apache.org/jira/browse/HIVE-14035 > Project: Hive > Issue Type: New Feature > Components: Transactions > Reporter: Saket Saurabh > Assignee: Saket Saurabh > Attachments: HIVE-14035.02.patch, HIVE-14035.03.patch, HIVE-14035.04.patch, HIVE-14035.05.patch, HIVE-14035.06.patch, HIVE-14035.07.patch, HIVE-14035.08.patch, HIVE-14035.09.patch, HIVE-14035.10.patch, HIVE-14035.11.patch, HIVE-14035.12.patch, HIVE-14035.13.patch, HIVE-14035.14.patch, HIVE-14035.15.patch, HIVE-14035.16.patch, HIVE-14035.patch > > > In current Hive version, delta files created by ACID transactions do not allow predicate pushdown if they contain any update/delete events. This is done to preserve correctness when following a multi-version approach during event collapsing, where an update event overwrites an existing insert event. > This JIRA proposes to split an update event into a combination of a delete event followed by a new insert event, that can enable predicate push down to all delta files without breaking correctness. To support backward compatibility for this feature, this JIRA also proposes to add some sort of versioning to ACID that can allow different versions of ACID transactions to co-exist together. -- This message was sent by Atlassian JIRA (v6.3.4#6332)