hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-3809) Concurrency issue in RCFile: multiple threads can use the same decompressor
Date Fri, 28 Dec 2012 22:50:14 GMT

    [ https://issues.apache.org/jira/browse/HIVE-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13540625#comment-13540625
] 

Hudson commented on HIVE-3809:
------------------------------

Integrated in Hive-trunk-h0.21 #1884 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1884/])
    HIVE-3809 : Concurrency issue in RCFile: multiple threads can use the same decompressor
(Mikhail Bautin via Ashutosh Chauhan) (Revision 1426524)

     Result = SUCCESS
hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1426524
Files : 
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/RCFile.java

                
> Concurrency issue in RCFile: multiple threads can use the same decompressor
> ---------------------------------------------------------------------------
>
>                 Key: HIVE-3809
>                 URL: https://issues.apache.org/jira/browse/HIVE-3809
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Mikhail Bautin
>            Assignee: Mikhail Bautin
>            Priority: Critical
>             Fix For: 0.11.0
>
>         Attachments: 0001-HIVE-3809-Decompressors-should-only-be-returned-to-t.patch,
D7419.1.patch
>
>
> RCFile is not thread-safe, even if each reader is only used by one thread as intended,
because it is possible to return decompressors to the pool multiple times by calling close
on the reader multiple times. Then, different threads can pick up the same decompressor twice
from the pool, resulting in decompression failures.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message