hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-5918) LineRecordReader can return the same decompressor to CodecPool multiple times
Date Fri, 14 Nov 2014 11:52:44 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-5918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14212197#comment-14212197
] 

Hudson commented on MAPREDUCE-5918:
-----------------------------------

FAILURE: Integrated in Hadoop-trunk-Commit #6544 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/6544/])
MAPREDUCE-5918. LineRecordReader can return the same decompressor to CodecPool multiple times
(Sergey Murylev via raviprak) (raviprak: rev 1a1dcce827d8747a5629151afa335598fbc94f9e)
* hadoop-mapreduce-project/CHANGES.txt
* hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestLineRecordReader.java
* hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/LineRecordReader.java
* hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/lib/input/LineRecordReader.java
* hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/lib/input/TestLineRecordReader.java
* hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/compress/TestCodecPool.java
* hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/CodecPool.java


> LineRecordReader can return the same decompressor to CodecPool multiple times
> -----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-5918
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5918
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>    Affects Versions: 2.3.0
>            Reporter: Sergey Murylev
>            Assignee: Sergey Murylev
>             Fix For: 2.7.0
>
>         Attachments: MAPREDUCE-5918.1.patch, MAPREDUCE-5918.2.patch, MAPREDUCE-5918.3.patch,
MAPREDUCE-5918.4.patch
>
>
> LineRecordReader can return the same decompressor to CodecPool multiple times if method
close() called multiple times. In this case CodecPool doesn't guarantee that it always return
different decompressors. This issue can cause some difficult reproducible and difficult diagnosable
bugs in Hadoop based programs. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message