hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Shelukhin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-11305) LLAP: Hybrid Map-join cache returns invalid data
Date Tue, 21 Jul 2015 20:43:04 GMT

    [ https://issues.apache.org/jira/browse/HIVE-11305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635781#comment-14635781
] 

Sergey Shelukhin commented on HIVE-11305:
-----------------------------------------

looks like mapjoin cache is being reused between queries. There's either a bug in recent patch,
or some fundamental issue (i.e. if query ID is duplicated between queries, I am not sure how
it ever worked)

> LLAP: Hybrid Map-join cache returns invalid data 
> -------------------------------------------------
>
>                 Key: HIVE-11305
>                 URL: https://issues.apache.org/jira/browse/HIVE-11305
>             Project: Hive
>          Issue Type: Sub-task
>    Affects Versions: llap
>         Environment: TPC-DS 200 scale data
>            Reporter: Gopal V
>            Assignee: Sergey Shelukhin
>            Priority: Critical
>             Fix For: llap
>
>         Attachments: q55-test.sql
>
>
> Start a 1-node LLAP cluster with 16 executors and run attached test-case on the single
node instance.
> {code}
> Caused by: java.lang.ClassCastException: org.apache.hadoop.hive.ql.exec.persistence.HybridHashTableContainer
cannot be cast to org.apache.hadoop.hive.ql.exec.vector.mapjoin.hashtable.VectorMapJoinTableContainer
>         at org.apache.hadoop.hive.ql.exec.vector.mapjoin.VectorMapJoinCommonOperator.loadHashTable(VectorMapJoinCommonOperator.java:648)
>         at org.apache.hadoop.hive.ql.exec.MapJoinOperator.cleanUpInputFileChangedOp(MapJoinOperator.java:314)
>         at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1104)
>         at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1108)
>         at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1108)
>         at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1108)
>         at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1108)
>         at org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator.process(VectorMapOperator.java:37)
>         at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.processRow(MapRecordSource.java:86)
>         ... 17 more
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message