hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Johndee Burks (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-6059) Add union type support in LazyBinarySerDe
Date Mon, 14 Apr 2014 01:12:15 GMT

     [ https://issues.apache.org/jira/browse/HIVE-6059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Johndee Burks updated HIVE-6059:
--------------------------------

    Attachment: repro.tar

[~houckman] The file repro.tar has all the reproduction information. The ddl needs to be changed
for the schema file path. Run the dml after and the problem should reproduce. 

> Add union type support in LazyBinarySerDe
> -----------------------------------------
>
>                 Key: HIVE-6059
>                 URL: https://issues.apache.org/jira/browse/HIVE-6059
>             Project: Hive
>          Issue Type: New Feature
>          Components: File Formats
>    Affects Versions: 0.12.0
>            Reporter: Chaoyu Tang
>         Attachments: Hive Issue 0.jpeg, Hive Issue 1.jpeg, Hive Issue 2.jpeg, Hive Issue
3.jpeg, repro.tar
>
>
> We need the support to type union in LazyBinarySerDe, which is required to the join query
with any union types in its select values. The reduce values in Join operation is serialized/deserialized
using LazyBinarySerDe, otherwise we will see some errors like:
> {code}
> Caused by: java.lang.NullPointerException
> at org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorUtils.getStandardObjectInspector(ObjectInspectorUtils.java:106)
> at org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorUtils.getStandardObjectInspector(ObjectInspectorUtils.java:156)
> at org.apache.hadoop.hive.ql.exec.JoinUtil.getStandardObjectInspectors(JoinUtil.java:98)
> at org.apache.hadoop.hive.ql.exec.CommonJoinOperator.initializeOp(CommonJoinOperator.java:261)
> at org.apache.hadoop.hive.ql.exec.JoinOperator.initializeOp(JoinOperator.java:61)
> at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:360)
> at org.apache.hadoop.hive.ql.exec.ExecReducer.configure(ExecReducer.java:150)
> {code}



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message