hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jimmy Xiang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-12619) Switching the field order within an array of structs causes the query to fail
Date Mon, 21 Mar 2016 21:56:25 GMT

     [ https://issues.apache.org/jira/browse/HIVE-12619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jimmy Xiang updated HIVE-12619:
-------------------------------
    Attachment: HIVE-12619.6.patch

> Switching the field order within an array of structs causes the query to fail
> -----------------------------------------------------------------------------
>
>                 Key: HIVE-12619
>                 URL: https://issues.apache.org/jira/browse/HIVE-12619
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 1.1.0
>            Reporter: Ang Zhang
>            Assignee: Mohammad Kamrul Islam
>            Priority: Minor
>         Attachments: HIVE-12619.2.patch, HIVE-12619.3.patch, HIVE-12619.4.patch, HIVE-12619.5.patch,
HIVE-12619.6.patch
>
>
> Switching the field order within an array of structs causes the query to fail or return
the wrong data for the fields, but switching the field order within just a struct works.
> How to reproduce:
> Case1 if the two fields have the same type, query will return wrong data for the fields
> drop table if exists schema_test;
> create table schema_test (msg array<struct<f1: string, f2: string>>) stored
as parquet;
> insert into table schema_test select stack(2, array(named_struct('f1', 'abc', 'f2', 'abc2')),
array(named_struct('f1', 'efg', 'f2', 'efg2'))) from one limit 2;
> select * from schema_test;
> --returns
> --[{"f1":"efg","f2":"efg2"}]
> --[{"f1":"abc","f2":"abc2"}]
> alter table schema_test change msg msg array<struct<f2: string, f1: string>>;
> select * from schema_test;
> --returns
> --[{"f2":"efg","f1":"efg2"}]
> --[{"f2":"abc","f1":"abc2"}]
> Case2: if the two fields have different type, the query will fail
> drop table if exists schema_test;
> create table schema_test (msg array<struct<f1: string, f2: int>>) stored
as parquet;
> insert into table schema_test select stack(2, array(named_struct('f1', 'abc', 'f2', 1)),
array(named_struct('f1', 'efg', 'f2', 2))) from one limit 2;
> select * from schema_test;
> --returns
> --[{"f1":"efg","f2":2}]
> --[{"f1":"abc","f2":1}]
> alter table schema_test change msg msg array<struct<f2: int, f1: string>>;
> select * from schema_test;
> Failed with exception java.io.IOException:org.apache.hadoop.hive.ql.metadata.HiveException:
java.lang.ClassCastException: org.apache.hadoop.io.Text cannot be cast to org.apache.hadoop.io.IntWritable



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message