hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prasanna Rajaperumal (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-13968) CombineHiveInputFormat does not honor InputFormat that implements AvoidSplitCombination
Date Thu, 09 Jun 2016 20:15:22 GMT

     [ https://issues.apache.org/jira/browse/HIVE-13968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Prasanna Rajaperumal updated HIVE-13968:
----------------------------------------
    Attachment: HIVE-13968.3.patch

Added the cleanup of tmp files created.

> CombineHiveInputFormat does not honor InputFormat that implements AvoidSplitCombination
> ---------------------------------------------------------------------------------------
>
>                 Key: HIVE-13968
>                 URL: https://issues.apache.org/jira/browse/HIVE-13968
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Prasanna Rajaperumal
>            Assignee: Prasanna Rajaperumal
>         Attachments: HIVE-13968.1.patch, HIVE-13968.2.patch, HIVE-13968.3.patch
>
>
> If I have 100 path[] , the nonCombinablePaths will have only the paths paths[0-9] and
the rest of the paths will be in combinablePaths, even if the inputformat returns false for
AvoidSplitCombination.shouldSkipCombine() for all the paths. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message