hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ryan Blue (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-12080) Support auto type widening for Parquet table
Date Mon, 19 Oct 2015 18:44:28 GMT

    [ https://issues.apache.org/jira/browse/HIVE-12080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963816#comment-14963816
] 

Ryan Blue commented on HIVE-12080:
----------------------------------

I like option #2 the best.

I'd also point out, though, that rather than having an if statement for option 1, we should
instead push that to the writable object. Basically, add a NumericWritable interface that
defines getInt, getLong, getFloat, etc. and call the correct one depending on the object inspector.

> Support auto type widening for Parquet table
> --------------------------------------------
>
>                 Key: HIVE-12080
>                 URL: https://issues.apache.org/jira/browse/HIVE-12080
>             Project: Hive
>          Issue Type: New Feature
>          Components: File Formats
>            Reporter: Mohammad Kamrul Islam
>            Assignee: Mohammad Kamrul Islam
>         Attachments: HIVE-12080.1.patch
>
>
> Currently Hive+Parquet doesn't support it. It should include at least basic type promotions
short->int->bigint,  float->double etc, that are already supported for  other file
formats.
> There were similar effort (Hive-6784) but was not committed. This JIRA is to address
the same in different way with little (no) performance impact.
>  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message