hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chao (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-9112) Query may generate different results depending on the number of reducers
Date Wed, 14 Jan 2015 22:32:34 GMT

    [ https://issues.apache.org/jira/browse/HIVE-9112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14277806#comment-14277806
] 

Chao commented on HIVE-9112:
----------------------------

I ran a few tests and the issue is gone.
Although ppd_multi_insert.q has a ordering issue: when mapred.reduce.tasks is set larger than
one it generates same results with different order, even with {{SORT_QUERY_RESULTS}}. But,
this is irrelevant and can be addressed in a separate JIRA.

> Query may generate different results depending on the number of reducers
> ------------------------------------------------------------------------
>
>                 Key: HIVE-9112
>                 URL: https://issues.apache.org/jira/browse/HIVE-9112
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Chao
>            Assignee: Ted Xu
>         Attachments: HIVE-9112.1.patch, HIVE-9112.patch
>
>
> Some queries may generate different results depending on the number of reducers, for
example, tests like ppd_multi_insert.q, join_nullsafe.q, subquery_in.q, etc.
> Take subquery_in.q as example, if we add
> {noformat}
> set mapred.reduce.tasks=3;
> {noformat}
> to this test file, the result will be different (and wrong):
> {noformat}
> @@ -903,5 +903,3 @@ where li.l_linenumber = 1 and
>  POSTHOOK: type: QUERY
>  POSTHOOK: Input: default@lineitem
>  #### A masked pattern was here ####
> -108570 8571
> -4297   1798
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message