hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matt McCline (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-16207) Add support for Complex Types in Fast SerDe
Date Tue, 14 Mar 2017 18:19:41 GMT

    [ https://issues.apache.org/jira/browse/HIVE-16207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15924732#comment-15924732
] 

Matt McCline commented on HIVE-16207:
-------------------------------------

The partial patch contains a partial solution including vectorization changes.

The work for LazySimpleSerializeWrite and LazySimpleDeserializeWrite is mostly complete for
a 2-level schema.  When I tried a 4 level schema the test failed.

The LazyBinary* and BinarySortable* classes work is still needed.

A lot of the patch is work in the test classes TestLazySimpleFast, SerdeRandomRowSource, VerifyFast,
and VerifyLazy.  It was to enhance tests to create schemas with complex types, populate them
with random complex values, and deserialize them back and verify results.

Note the SerdeRandomRowSource and VectorRandomRowSource are the same -- we currently don't
have a way to share test classes in the project.  So a copy was made.

The work in VectorSerializeRow and VectorDeserializeRow could be separated into a different
JIRA.

> Add support for Complex Types in Fast SerDe
> -------------------------------------------
>
>                 Key: HIVE-16207
>                 URL: https://issues.apache.org/jira/browse/HIVE-16207
>             Project: Hive
>          Issue Type: Bug
>          Components: Hive
>            Reporter: Matt McCline
>            Assignee: Teddy Choi
>            Priority: Critical
>         Attachments: partial.patch
>
>
> Add complex type support to Fast SerDe classes.  This is needed for fully supporting
complex types in Vectorization



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message