Return-Path: X-Original-To: apmail-hive-issues-archive@minotaur.apache.org Delivered-To: apmail-hive-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1D46D19E77 for ; Tue, 15 Mar 2016 18:20:34 +0000 (UTC) Received: (qmail 63741 invoked by uid 500); 15 Mar 2016 18:20:33 -0000 Delivered-To: apmail-hive-issues-archive@hive.apache.org Received: (qmail 63684 invoked by uid 500); 15 Mar 2016 18:20:33 -0000 Mailing-List: contact issues-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list issues@hive.apache.org Received: (qmail 63632 invoked by uid 99); 15 Mar 2016 18:20:33 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Mar 2016 18:20:33 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 84BAF2C1F6A for ; Tue, 15 Mar 2016 18:20:33 +0000 (UTC) Date: Tue, 15 Mar 2016 18:20:33 +0000 (UTC) From: "Gopal V (JIRA)" To: issues@hive.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HIVE-13285) Orc concatenation may drop old files from moving to final path MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-13285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15195866#comment-15195866 ] Gopal V commented on HIVE-13285: -------------------------------- LGTM - +1, tests pending. > Orc concatenation may drop old files from moving to final path > -------------------------------------------------------------- > > Key: HIVE-13285 > URL: https://issues.apache.org/jira/browse/HIVE-13285 > Project: Hive > Issue Type: Bug > Components: ORC > Affects Versions: 0.14.0, 1.0.0, 1.2.0, 1.1.0, 1.3.0, 2.0.0, 2.1.0 > Reporter: Prasanth Jayachandran > Assignee: Prasanth Jayachandran > Priority: Critical > Attachments: HIVE-13285.1.patch, HIVE-13285.2.patch, HIVE-13285.3.patch > > > ORC concatenation uses combine hive input format for merging files. Under specific case where all files within a combine split are incompatible for merge (old files without stripe statistics) then these files are added to incompatible file set. But this file set is not processed as closeOp() will not be called (no output file writer will exist which will skip super.closeOp()). As a result, these incompatible files are not moved to final path. -- This message was sent by Atlassian JIRA (v6.3.4#6332)