hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zoltan Haindrich (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-17047) Allow table property to be populated to jobConf to make FixedLengthInputFormat work
Date Thu, 06 Jul 2017 10:17:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-17047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076295#comment-16076295
] 

Zoltan Haindrich commented on HIVE-17047:
-----------------------------------------

[~aplusplus] I've uploaded your patch to run against branch-1.
+1 the change looks good to me; it seems to me that {{HiveInputFormat.getPartitionDescFromPath}}
might be also problematic...possibly it didnt cause any trouble...

> Allow table property to be populated to jobConf to make FixedLengthInputFormat work
> -----------------------------------------------------------------------------------
>
>                 Key: HIVE-17047
>                 URL: https://issues.apache.org/jira/browse/HIVE-17047
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Zhiyuan Yang
>            Assignee: Zhiyuan Yang
>         Attachments: HIVE-17047.1.patch, HIVE-17047-branch-1.1.patch
>
>
> To make FixedLengthInputFormat work in Hive, we need table specific value for the configuration
"fixedlengthinputformat.record.length". Right now the best place would be table property.
Unfortunately, table property is not alway populated to InputFormat configurations because
of this in HiveInputFormat: 
> {code} 
> PartitionDesc part = pathToPartitionInfo.get(hsplit.getPath().toString()); 
> if ((part != null) && (part.getTableDesc() != null)) { 
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message