hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gopal V (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-20827) Inconsistent results for empty arrays
Date Wed, 05 Dec 2018 06:32:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-20827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16709664#comment-16709664
] 

Gopal V commented on HIVE-20827:
--------------------------------

LGTM - +1

> Inconsistent results for empty arrays
> -------------------------------------
>
>                 Key: HIVE-20827
>                 URL: https://issues.apache.org/jira/browse/HIVE-20827
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Teddy Choi
>            Assignee: Teddy Choi
>            Priority: Major
>              Labels: pull-request-available
>         Attachments: HIVE-20827.1.patch
>
>
> LazySimpleDeserializeRead parses an empty array wrong. For example, a line ',' in a text
file table with a delimiter ',' and schema 'array<int>, array<array<string>>' shows
\[null\], \[\[""\]\], instead of \[\], \[\] with MapReduce engine and vectorized execution
enabled. LazySimpleDeserializeRead has following code; 
> {code:java}
> switch (complexField.complexCategory) {
> case LIST:
>   {
>     // Allow for empty string, etc.
>     final boolean isNext = (fieldPosition <= complexFieldEnd);
> {code}
> Empty string value read should be only applied to string families, not to other data
types. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message