hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Subroto Sanyal (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3376) Old mapred API combiner uses NULL reporter
Date Fri, 02 Dec 2011 12:51:44 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13161602#comment-13161602
] 

Subroto Sanyal commented on MAPREDUCE-3376:
-------------------------------------------

@Mahadev
executed:
./dev-support/test-patch.sh /home/subroto/Desktop/MAPREDUCE-3376.patch --run-tests >>
/tmp/patchTest.log

Following is the result for test cases:
{noformat}
    -1 core tests.  The patch failed these unit tests:
                  org.apache.hadoop.fs.TestLocalDirAllocator
                  org.apache.hadoop.io.retry.TestFailoverProxy
                  org.apache.hadoop.fs.TestFileUtil
                  org.apache.hadoop.fs.viewfs.TestViewFsTrash
                  org.apache.hadoop.fs.viewfs.TestFSMainOperationsLocalFileSystem
                  org.apache.hadoop.fs.TestFSMainOperationsLocalFileSystem
{noformat}

The failed testcases are not at all related to patch. May be some env issue. The patch doesn't
break any mapred functionality
                
> Old mapred API combiner uses NULL reporter
> ------------------------------------------
>
>                 Key: MAPREDUCE-3376
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3376
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv1, mrv2
>    Affects Versions: 0.20.205.0, 0.23.0, 0.24.0
>            Reporter: Robert Joseph Evans
>            Assignee: Subroto Sanyal
>             Fix For: 0.23.1
>
>         Attachments: MAPREDUCE-3376.patch
>
>
> The OldCombinerRunner class inside Task.java uses a NULL Reporter.  If the combiner code
runs for an extended period of time, even with reporting progress as it should, the map task
can timeout and be killed.  It appears that the NewCombinerRunner class uses a valid reporter
and as such is not impacted by this bug.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message