Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: mapreduce-issues@hadoop.apache.org
Date: Tue, 20 Dec 2011 22:31:30 +0000 (UTC)
From: "Hudson (Commented) (JIRA)" <jira@apache.org>
To: mapreduce-issues@hadoop.apache.org
Message-ID: 
 <787821043.32836.1324420290902.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: 
 <1142117380.11243.1320769551885.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Commented] (MAPREDUCE-3376) Old mapred API combiner uses
 NULL reporter
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/MAPREDUCE-3376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13173572#comment-13173572 ] 

Hudson commented on MAPREDUCE-3376:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk-Commit #1480 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1480/])
    MAPREDUCE-3376. Fixed Task to ensure it passes reporter to combiners using old MR api. Contributed by Subroto Sanyal.

acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1221501
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/Task.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestMRAppWithCombiner.java

                
> Old mapred API combiner uses NULL reporter
> ------------------------------------------
>
>                 Key: MAPREDUCE-3376
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3376
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv1, mrv2
>    Affects Versions: 0.20.205.0, 0.23.0, 0.24.0
>            Reporter: Robert Joseph Evans
>            Assignee: Subroto Sanyal
>             Fix For: 0.23.1
>
>         Attachments: MAPREDUCE-3376.patch
>
>
> The OldCombinerRunner class inside Task.java uses a NULL Reporter.  If the combiner code runs for an extended period of time, even with reporting progress as it should, the map task can timeout and be killed.  It appears that the NewCombinerRunner class uses a valid reporter and as such is not impacted by this bug.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira