hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-11376) CombineHiveInputFormat is falling back to HiveInputFormat in case codecs are found for one of the input files
Date Sat, 08 Aug 2015 18:35:45 GMT

    [ https://issues.apache.org/jira/browse/HIVE-11376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14663107#comment-14663107
] 

Hive QA commented on HIVE-11376:
--------------------------------



{color:green}Overall{color}: +1 all checks pass

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12749200/HIVE-11376.02.patch

{color:green}SUCCESS:{color} +1 9344 tests passed

Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4875/testReport
Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4875/console
Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4875/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12749200 - PreCommit-HIVE-TRUNK-Build

> CombineHiveInputFormat is falling back to HiveInputFormat in case codecs are found for
one of the input files
> -------------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-11376
>                 URL: https://issues.apache.org/jira/browse/HIVE-11376
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Rajat Khandelwal
>            Assignee: Rajat Khandelwal
>         Attachments: HIVE-11376.02.patch
>
>
> https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/io/CombineHiveInputFormat.java#L379
> This is the exact code snippet:
> {noformat}
> / Since there is no easy way of knowing whether MAPREDUCE-1597 is present in the tree
or not,
>       // we use a configuration variable for the same
>       if (this.mrwork != null && !this.mrwork.getHadoopSupportsSplittable())
{
>         // The following code should be removed, once
>         // https://issues.apache.org/jira/browse/MAPREDUCE-1597 is fixed.
>         // Hadoop does not handle non-splittable files correctly for CombineFileInputFormat,
>         // so don't use CombineFileInputFormat for non-splittable files
>         //ie, dont't combine if inputformat is a TextInputFormat and has compression
turned on
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message