hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kevin Wilfong (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-3750) JDBCStatsPublisher fails when ID length exceeds length of ID column
Date Wed, 05 Dec 2012 00:02:59 GMT

    [ https://issues.apache.org/jira/browse/HIVE-3750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13510146#comment-13510146
] 

Kevin Wilfong commented on HIVE-3750:
-------------------------------------

Sorry about that.

I filed HIVE-3771 to fix it and attached a diff.  I only saw failures in TestParse.
                
> JDBCStatsPublisher fails when ID length exceeds length of ID column
> -------------------------------------------------------------------
>
>                 Key: HIVE-3750
>                 URL: https://issues.apache.org/jira/browse/HIVE-3750
>             Project: Hive
>          Issue Type: Bug
>          Components: Statistics
>    Affects Versions: 0.11
>            Reporter: Kevin Wilfong
>            Assignee: Kevin Wilfong
>         Attachments: HIVE-3750.1.patch.txt
>
>
> When the length of the ID field passed to JDBCStatsPublisher exceeds the length of the
column in the table (currently 255 characters) stats collection fails.  This causes the entire
query to fail when hive.stats.reliable is set to true.
> One way to prevent this would be to calculate a deterministic, very low collision hash
of the ID prefix used for aggregation and use that when the length of the ID is too long.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message