hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Dere (JIRA)" <>
Subject [jira] [Commented] (HIVE-6939) TestExecDriver.testMapRedPlan3 fails on hadoop-2
Date Mon, 21 Apr 2014 20:24:14 GMT


Jason Dere commented on HIVE-6939:

It appears that on hadoop-2 there are multiple output files for this test, whereas on hadoop-1
there is just a single file.  Also the test looks like it assumes there is just a single file
to compare to.
This test for some reason is specifying 5 reducers.  I've been told that hadoop-1 Hive did
not obey the number of reducers, while hadoop-2 does.  This could explain why this test works
for hadoop-1 since if it only ever used 1 reducer and generated a single output file.

Changing this test to use just a single reducer allows the test to pass with hadoop-2.  Does
anyone know the history of this test and why it was set to use 5 reducers?

> TestExecDriver.testMapRedPlan3 fails on hadoop-2
> ------------------------------------------------
>                 Key: HIVE-6939
>                 URL:
>             Project: Hive
>          Issue Type: Bug
>          Components: Tests
>            Reporter: Jason Dere
>            Assignee: Jason Dere
> Passes on hadoop-1, but fails on hadoop-2.

This message was sent by Atlassian JIRA

View raw message