hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vikram Dixit K (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-9038) Join tests fail on Tez
Date Wed, 14 Jan 2015 01:57:34 GMT

    [ https://issues.apache.org/jira/browse/HIVE-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14276373#comment-14276373
] 

Vikram Dixit K commented on HIVE-9038:
--------------------------------------

This issue as Navis mentioned, stems from the fact that tez does not make filterTag. FilterTag
is generated in case of MR by the HashTableSinkOperator which is not used in case of tez.
The right solution would be to have a select operator that adds the filtertag to the value
field so as to work without sacrificing the increased stages by moving this to a shuffle join
instead of map join. However, since this only happens in the case where there are multiple
joins on the same key with an outer join doing the filtering, I have this patch that changes
the join to a shuffle join in this case for the time being so as to get away from the asserts.
I will be raising a different jira for the good fix.

> Join tests fail on Tez
> ----------------------
>
>                 Key: HIVE-9038
>                 URL: https://issues.apache.org/jira/browse/HIVE-9038
>             Project: Hive
>          Issue Type: Bug
>          Components: Tests, Tez
>            Reporter: Ashutosh Chauhan
>            Assignee: Vikram Dixit K
>
> Tez doesn't run all tests. But, if you run them, following tests fail with runt time
exception pointing to bugs. {{auto_join21.q,auto_join29.q,auto_join30.q    ,auto_join_filters.q,auto_join_nulls.q}}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message