hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "karen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-1242) CombineHiveInputFormat does not work for compressed text files
Date Fri, 01 Aug 2014 04:52:39 GMT

    [ https://issues.apache.org/jira/browse/HIVE-1242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14081904#comment-14081904
] 

karen commented on HIVE-1242:
-----------------------------

The comment in the code include the followings:
// Since there is no easy way of knowing whether MAPREDUCE-1597 is present in the tree or
not,
      // we use a configuration variable for the same

This is clearly misunderstanding. MAPREDUCE-1597 is a bug that was fixed for new  api (mapreduce
package), while CombineHiveInputFormat is using old API (deprecated mapred package). CombineHiveInputFormat
 does not properly works with any non-splittable compressed file, if that files is written
over multiple hdfs partitions (same as CombineFileInputFormat from mapred package, while CombineFileInputFormat
from new mapreduce package works beautifully).
Not sure why this issue is marked as closed.

> CombineHiveInputFormat does not work for compressed text files
> --------------------------------------------------------------
>
>                 Key: HIVE-1242
>                 URL: https://issues.apache.org/jira/browse/HIVE-1242
>             Project: Hive
>          Issue Type: Bug
>          Components: Query Processor
>    Affects Versions: 0.5.0
>            Reporter: Namit Jain
>            Assignee: Namit Jain
>             Fix For: 0.6.0
>
>         Attachments: hive.1242.1.patch, hive.1242.2.patch, hive.1242.3.patch, hive.1242.4.patch,
hive.1242.branch5.2.patch, hive.1242.branch5.3.patch, hive.1242.branch5.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message