hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhiyuan Yang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-17047) Allow table property to be populated to jobConf to make FixedLengthInputFormat work
Date Wed, 05 Jul 2017 22:37:02 GMT

    [ https://issues.apache.org/jira/browse/HIVE-17047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16075556#comment-16075556
] 

Zhiyuan Yang commented on HIVE-17047:
-------------------------------------

It turns out HIVE-15147 has fix for this accidentally. HIVE-15147 was for Hive 2.2.0 LLAP
but not for earlier versions. Uploading a partial patch from HIVE-15147 for earlier versions.

> Allow table property to be populated to jobConf to make FixedLengthInputFormat work
> -----------------------------------------------------------------------------------
>
>                 Key: HIVE-17047
>                 URL: https://issues.apache.org/jira/browse/HIVE-17047
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Zhiyuan Yang
>            Assignee: Zhiyuan Yang
>             Fix For: 1.2.1
>
>
> To make FixedLengthInputFormat work in Hive, we need table specific value for the configuration
"fixedlengthinputformat.record.length". Right now the best place would be table property.
Unfortunately, table property is not alway populated to InputFormat configurations because
of this in HiveInputFormat:
> {code}
> PartitionDesc part = pathToPartitionInfo.get(hsplit.getPath().toString());
> if ((part != null) && (part.getTableDesc() != null)) {
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message