hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Dere (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-6939) TestExecDriver.testMapRedPlan3 fails on hadoop-2
Date Mon, 21 Apr 2014 20:24:14 GMT

    [ https://issues.apache.org/jira/browse/HIVE-6939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13975990#comment-13975990
] 

Jason Dere commented on HIVE-6939:
----------------------------------

It appears that on hadoop-2 there are multiple output files for this test, whereas on hadoop-1
there is just a single file.  Also the test looks like it assumes there is just a single file
to compare to.
This test for some reason is specifying 5 reducers.  I've been told that hadoop-1 Hive did
not obey the number of reducers, while hadoop-2 does.  This could explain why this test works
for hadoop-1 since if it only ever used 1 reducer and generated a single output file.

Changing this test to use just a single reducer allows the test to pass with hadoop-2.  Does
anyone know the history of this test and why it was set to use 5 reducers?

> TestExecDriver.testMapRedPlan3 fails on hadoop-2
> ------------------------------------------------
>
>                 Key: HIVE-6939
>                 URL: https://issues.apache.org/jira/browse/HIVE-6939
>             Project: Hive
>          Issue Type: Bug
>          Components: Tests
>            Reporter: Jason Dere
>            Assignee: Jason Dere
>
> Passes on hadoop-1, but fails on hadoop-2.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message