hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bing Li (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-11201) HCatalog is ignoring user specified avro schema in the table definition
Date Wed, 08 Jul 2015 06:24:04 GMT
Bing Li created HIVE-11201:
------------------------------

             Summary: HCatalog  is ignoring user specified avro schema in the table definition
                 Key: HIVE-11201
                 URL: https://issues.apache.org/jira/browse/HIVE-11201
             Project: Hive
          Issue Type: Bug
          Components: HCatalog
    Affects Versions: 1.2.0
            Reporter: Bing Li
            Assignee: Bing Li
            Priority: Critical


HCatalog  is ignoring user specified avro schema in the table definition , instead generating
its own avro based  from hive meta store. 

By generating its own schema  will result in mismatch names.  For exmple Avro fields name
are Case Sensitive.  By generating it's own schema will  result in incorrect schema written
to the avro file , and result   select fail on read.   And also Even if user specified schema
does not allow null ,  when data is written using Hcatalog , it will write a schema that will
allow null. 

For example in the table ,  user specified , all CAPITAL letters in the schema , and record
name as LINEITEM.  The schema should be written as it is.  Instead Hcatalog ignores it and
generated its own avro schema from the hive table case. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message