Return-Path: X-Original-To: apmail-hive-issues-archive@minotaur.apache.org Delivered-To: apmail-hive-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 793671890F for ; Wed, 18 Nov 2015 03:00:15 +0000 (UTC) Received: (qmail 4965 invoked by uid 500); 18 Nov 2015 03:00:15 -0000 Delivered-To: apmail-hive-issues-archive@hive.apache.org Received: (qmail 4938 invoked by uid 500); 18 Nov 2015 03:00:15 -0000 Mailing-List: contact issues-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list issues@hive.apache.org Received: (qmail 4917 invoked by uid 99); 18 Nov 2015 03:00:15 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 18 Nov 2015 03:00:15 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 418612C0450 for ; Wed, 18 Nov 2015 03:00:15 +0000 (UTC) Date: Wed, 18 Nov 2015 03:00:15 +0000 (UTC) From: "Prasanth Jayachandran (JIRA)" To: issues@hive.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HIVE-12450) OrcFileMergeOperator does not use correct compression buffer size MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-12450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-12450: ----------------------------------------- Component/s: ORC > OrcFileMergeOperator does not use correct compression buffer size > ----------------------------------------------------------------- > > Key: HIVE-12450 > URL: https://issues.apache.org/jira/browse/HIVE-12450 > Project: Hive > Issue Type: Bug > Components: ORC > Affects Versions: 1.2.0, 1.3.0, 1.2.1, 2.0.0 > Reporter: Prasanth Jayachandran > Assignee: Prasanth Jayachandran > Attachments: HIVE-12450.1.patch > > > OrcFileMergeOperator checks for compatibility before merging orc files. This compatibility check include checking compression buffer size. But the output file that is created does not honor the compression buffer size and always defaults to 256KB. This will not be a problem when reading the orc file but can create unwanted memory pressure because of wasted space within compression buffer. -- This message was sent by Atlassian JIRA (v6.3.4#6332)