Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id EDC95E471 for ; Thu, 24 Jan 2013 18:23:13 +0000 (UTC) Received: (qmail 41925 invoked by uid 500); 24 Jan 2013 18:23:13 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 41832 invoked by uid 500); 24 Jan 2013 18:23:13 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 41784 invoked by uid 500); 24 Jan 2013 18:23:13 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 41752 invoked by uid 99); 24 Jan 2013 18:23:13 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 24 Jan 2013 18:23:13 +0000 Date: Thu, 24 Jan 2013 18:23:13 +0000 (UTC) From: "Mikhail Bautin (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HIVE-3809) Concurrency issue in RCFile: multiple threads can use the same decompressor MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13561822#comment-13561822 ] Mikhail Bautin commented on HIVE-3809: -------------------------------------- [~ashutoshc]: any chance this fix could be committed to branch 0.9 as well, if this is not too difficult? Thanks! Patch for 0.9: https://issues.apache.org/jira/secure/attachment/12562623/0001-HIVE-3809-Concurrency-issue-in-RCFile-multiple-threa.patch > Concurrency issue in RCFile: multiple threads can use the same decompressor > --------------------------------------------------------------------------- > > Key: HIVE-3809 > URL: https://issues.apache.org/jira/browse/HIVE-3809 > Project: Hive > Issue Type: Bug > Reporter: Mikhail Bautin > Assignee: Mikhail Bautin > Priority: Critical > Fix For: 0.11.0 > > Attachments: 0001-HIVE-3809-Concurrency-issue-in-RCFile-multiple-threa.patch, 0001-HIVE-3809-Decompressors-should-only-be-returned-to-t.patch, D7419.1.patch > > > RCFile is not thread-safe, even if each reader is only used by one thread as intended, because it is possible to return decompressors to the pool multiple times by calling close on the reader multiple times. Then, different threads can pick up the same decompressor twice from the pool, resulting in decompression failures. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira