hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xuefu Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-8745) Joins on decimal keys return different results whether they are run as reduce join or map join
Date Thu, 06 Nov 2014 03:33:34 GMT

    [ https://issues.apache.org/jira/browse/HIVE-8745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14199713#comment-14199713
] 

Xuefu Zhang commented on HIVE-8745:
-----------------------------------

I don't thinking reverting HIVE-7373 is a viable option. That's the trigger but not the root
cause of the problem. The root cause is that BinarySortableSerde should be able to serailize
decimal values in such way that comparison can be performed at byte level w/o requiring values
be trailed for zeroes. I don't know how to do this, but I think that's the direction into
which we should look. If the serde needs to remove trailing zeros during serialization, this
is fine as long as it can get them back upon deserialization.

> Joins on decimal keys return different results whether they are run as reduce join or
map join
> ----------------------------------------------------------------------------------------------
>
>                 Key: HIVE-8745
>                 URL: https://issues.apache.org/jira/browse/HIVE-8745
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.14.0
>            Reporter: Gunther Hagleitner
>            Assignee: Jason Dere
>            Priority: Critical
>             Fix For: 0.14.0
>
>         Attachments: join_test.q
>
>
> See attached .q file to reproduce. The difference seems to be whether trailing 0s are
considered the same value or not.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message