hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brock Noland (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-8909) Hive doesn't correctly read Parquet nested types
Date Fri, 21 Nov 2014 17:32:33 GMT

    [ https://issues.apache.org/jira/browse/HIVE-8909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14221149#comment-14221149
] 

Brock Noland commented on HIVE-8909:
------------------------------------

Typically we just run the tests manually but I don't see harm in checking in the binary files
now and I just did so. Thus we won't want to submit them on the patch which fixes the failures
I mentioned earlier.

> Hive doesn't correctly read Parquet nested types
> ------------------------------------------------
>
>                 Key: HIVE-8909
>                 URL: https://issues.apache.org/jira/browse/HIVE-8909
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.13.1
>            Reporter: Ryan Blue
>            Assignee: Ryan Blue
>         Attachments: HIVE-8909-1.patch, HIVE-8909-2.patch, HIVE-8909.2.patch, HIVE-8909.3.patch,
parquet-test-data.tar.gz
>
>
> Parquet's Avro and Thrift object models don't produce the same parquet type representation
for lists and maps that Hive does. In the Parquet community, we've defined what should be
written and backward-compatibility rules for existing data written by parquet-avro and parquet-thrift
in PARQUET-113. We need to implement those rules in the Hive Converter classes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message