hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mickael Lacour (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-6994) parquet-hive createArray strips null elements
Date Fri, 03 Oct 2014 15:26:34 GMT

    [ https://issues.apache.org/jira/browse/HIVE-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14158087#comment-14158087
] 

Mickael Lacour commented on HIVE-6994:
--------------------------------------

I'm working on this one. We have 3 different data that can throw exception (for different
reason) :

* array with first value null (NullPointerException) : fixed
* array with all empty fields (ParquetEncodingException "empty fields are illegal, the field
should be ommited completely instead") : Still in progress, talking with the parquet team
about it
* array with few empty fields (no exception, just missing data) : related to the previous
one.

Keep you posted

> parquet-hive createArray strips null elements
> ---------------------------------------------
>
>                 Key: HIVE-6994
>                 URL: https://issues.apache.org/jira/browse/HIVE-6994
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.13.0, 0.14.0
>            Reporter: Justin Coffey
>            Assignee: Justin Coffey
>             Fix For: 0.14.0
>
>         Attachments: HIVE-6994-1.patch, HIVE-6994.2.patch, HIVE-6994.3.patch, HIVE-6994.3.patch,
HIVE-6994.patch
>
>
> The createArray method in ParquetHiveSerDe strips null values from resultant ArrayWritables.
> tracked here as well: https://github.com/Parquet/parquet-mr/issues/377



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message