hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "zhaolong (Jira)" <j...@apache.org>
Subject [jira] [Comment Edited] (HIVE-18325) Config to do case unaware schema evolution to ORC reader.
Date Fri, 07 Aug 2020 06:09:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-18325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17172914#comment-17172914
] 

zhaolong edited comment on HIVE-18325 at 8/7/20, 6:08 AM:
----------------------------------------------------------

   In OrcFile.java,

readerOptions method add 

conf.set("orc.schema.evolution.case.sensitive", "false");

 can fix this problem


was (Author: fsilent):
!image-2020-08-07-14-07-04-676.png!   this param can fix this problem

> Config to do case unaware schema evolution to ORC reader.
> ---------------------------------------------------------
>
>                 Key: HIVE-18325
>                 URL: https://issues.apache.org/jira/browse/HIVE-18325
>             Project: Hive
>          Issue Type: Bug
>          Components: ORC
>            Reporter: piyush mukati
>            Priority: Critical
>
> in case of orc data reader schema passed by hive are all small cases and if the column
name stored in the file has any uppercase, it will return null values for those columns even
if the data is present in the file. 
> Column name matching while schema evolution should be case unaware. 
> we need to pass config for same from hive. the config(orc.schema.evolution.case.sensitive)
in orc will be exposed by https://issues.apache.org/jira/browse/ORC-264 
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message