Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id DBD7BD26E for ; Sat, 29 Dec 2012 00:24:13 +0000 (UTC) Received: (qmail 17829 invoked by uid 500); 29 Dec 2012 00:24:13 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 17748 invoked by uid 500); 29 Dec 2012 00:24:12 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 17602 invoked by uid 500); 29 Dec 2012 00:24:12 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 17526 invoked by uid 99); 29 Dec 2012 00:24:12 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 29 Dec 2012 00:24:12 +0000 Date: Sat, 29 Dec 2012 00:24:12 +0000 (UTC) From: "Mikhail Bautin (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HIVE-3809) Concurrency issue in RCFile: multiple threads can use the same decompressor MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13540660#comment-13540660 ] Mikhail Bautin commented on HIVE-3809: -------------------------------------- [~ashutoshc]: thank you for committing this to trunk. Could you please also commit this to branch 0.9? Patch for branch 0.9: https://issues.apache.org/jira/secure/attachment/12562623/0001-HIVE-3809-Concurrency-issue-in-RCFile-multiple-threa.patch > Concurrency issue in RCFile: multiple threads can use the same decompressor > --------------------------------------------------------------------------- > > Key: HIVE-3809 > URL: https://issues.apache.org/jira/browse/HIVE-3809 > Project: Hive > Issue Type: Bug > Reporter: Mikhail Bautin > Assignee: Mikhail Bautin > Priority: Critical > Fix For: 0.11.0 > > Attachments: 0001-HIVE-3809-Concurrency-issue-in-RCFile-multiple-threa.patch, 0001-HIVE-3809-Decompressors-should-only-be-returned-to-t.patch, D7419.1.patch > > > RCFile is not thread-safe, even if each reader is only used by one thread as intended, because it is possible to return decompressors to the pool multiple times by calling close on the reader multiple times. Then, different threads can pick up the same decompressor twice from the pool, resulting in decompression failures. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira