hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chaoyu Tang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-11926) Stats annotation might not extract stats for varchar/decimal columns
Date Wed, 23 Sep 2015 04:08:04 GMT

    [ https://issues.apache.org/jira/browse/HIVE-11926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14903919#comment-14903919
] 

Chaoyu Tang commented on HIVE-11926:
------------------------------------

Patch has been posted on RB https://reviews.apache.org/r/38659/ . Thanks in advanced for review.

> Stats annotation might not extract stats for varchar/decimal columns
> --------------------------------------------------------------------
>
>                 Key: HIVE-11926
>                 URL: https://issues.apache.org/jira/browse/HIVE-11926
>             Project: Hive
>          Issue Type: Bug
>          Components: Logical Optimizer, Statistics
>    Affects Versions: 1.2.1
>            Reporter: Chaoyu Tang
>            Assignee: Chaoyu Tang
>         Attachments: HIVE-11926.patch
>
>
> It is because StatsUtils uses the String.startWith to compare VARCHAR/DECIMAL column
type name with serdeConstants which are in lowercase.  But these type names in stats might
not be in lower case. We ran into a case where the type name from TAB_COL_STATS/PART_COL_STATS
was actually in uppercase (e.g. VARCHAR, DECIMAL) because these column stats were populated
from other HMS clients like Impala.
> We need changes these type name comparison to be case insensitive



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message