hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brock Noland (JIRA)" <>
Subject [jira] [Commented] (HIVE-8909) Hive doesn't correctly read Parquet nested types
Date Thu, 20 Nov 2014 21:28:34 GMT


Brock Noland commented on HIVE-8909:

After adding a .q file you generate the .q.out file via:

cd itests
mvn test -Dtest=TestCliDriver -Dqfile=my_parquet.q -Dtest.output.overwrite=true -Phadoop-2

> Hive doesn't correctly read Parquet nested types
> ------------------------------------------------
>                 Key: HIVE-8909
>                 URL:
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.13.1
>            Reporter: Ryan Blue
>            Assignee: Ryan Blue
>         Attachments: HIVE-8909-1.patch, HIVE-8909-2.patch, HIVE-8909.2.patch
> Parquet's Avro and Thrift object models don't produce the same parquet type representation
for lists and maps that Hive does. In the Parquet community, we've defined what should be
written and backward-compatibility rules for existing data written by parquet-avro and parquet-thrift
in PARQUET-113. We need to implement those rules in the Hive Converter classes.

This message was sent by Atlassian JIRA

View raw message