hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prasanth Jayachandran (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-12584) Vectorized join with partition column of type char does not trim spaces
Date Fri, 04 Dec 2015 20:18:11 GMT

     [ https://issues.apache.org/jira/browse/HIVE-12584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Prasanth Jayachandran updated HIVE-12584:
-----------------------------------------
    Attachment: HIVE-12584.2.patch
                HIVE-12584-branch-1.patch

Test failures are related to missing hive.mapred.mode=nonstrict config. Added that config
on commit.

> Vectorized join with partition column of type char does not trim spaces 
> ------------------------------------------------------------------------
>
>                 Key: HIVE-12584
>                 URL: https://issues.apache.org/jira/browse/HIVE-12584
>             Project: Hive
>          Issue Type: Bug
>          Components: Vectorization
>    Affects Versions: 1.3.0, 2.0.0, 2.1.0
>            Reporter: Jagruti Varia
>            Assignee: Prasanth Jayachandran
>            Priority: Critical
>         Attachments: HIVE-12584-branch-1.patch, HIVE-12584.1.patch, HIVE-12584.2.patch
>
>
> When a table is partitioned on a column of type char and if join is performed on partitioned
column then following exception gets thrown from hashtable loader
> {code}
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.ql.metadata.HiveException:
org.apache.hadoop.hive.serde2.SerDeException: Unexpected tag: 52 reserialized to 5
> 	at org.apache.hadoop.hive.ql.exec.tez.ObjectCache.retrieve(ObjectCache.java:82)
> 	at org.apache.hadoop.hive.ql.exec.tez.ObjectCache$1.call(ObjectCache.java:92)
> 	... 4 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.serde2.SerDeException:
Unexpected tag: 52 reserialized to 5
> 	at org.apache.hadoop.hive.ql.exec.tez.HashTableLoader.load(HashTableLoader.java:216)
> 	at org.apache.hadoop.hive.ql.exec.MapJoinOperator.loadHashTable(MapJoinOperator.java:293)
> 	at org.apache.hadoop.hive.ql.exec.MapJoinOperator$1.call(MapJoinOperator.java:174)
> 	at org.apache.hadoop.hive.ql.exec.MapJoinOperator$1.call(MapJoinOperator.java:170)
> 	at org.apache.hadoop.hive.ql.exec.tez.ObjectCache.retrieve(ObjectCache.java:75)
> 	... 5 more
> Caused by: org.apache.hadoop.hive.serde2.SerDeException: Unexpected tag: 52 reserialized
to 5
> 	at org.apache.hadoop.hive.ql.exec.persistence.MapJoinBytesTableContainer$LazyBinaryKvWriter.sanityCheckKeyForTag(MapJoinBytesTableContainer.java:276)
> 	at org.apache.hadoop.hive.ql.exec.persistence.MapJoinBytesTableContainer$LazyBinaryKvWriter.getHashFromKey(MapJoinBytesTableContainer.java:247)
> 	at org.apache.hadoop.hive.ql.exec.persistence.HybridHashTableContainer.internalPutRow(HybridHashTableContainer.java:451)
> 	at org.apache.hadoop.hive.ql.exec.persistence.HybridHashTableContainer.putRow(HybridHashTableContainer.java:444)
> 	at org.apache.hadoop.hive.ql.exec.tez.HashTableLoader.load(HashTableLoader.java:210)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message