hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Graves (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2524) Backport trunk heuristics for failing maps when we get fetch failures retrieving map output during shuffle
Date Mon, 23 May 2011 19:57:47 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13038174#comment-13038174
] 

Thomas Graves commented on MAPREDUCE-2524:
------------------------------------------

   
The javadoc and eclipse failures existed before/without these changes.

  [exec] -1 overall.     [exec]
     [exec]     +1 @author.  The patch does not contain any @author tags.     [exec]     
     [exec]     +1 tests included.  The patch appears to include 3 new or modified tests.
     [exec]
     [exec]     -1 javadoc.  The javadoc tool appears to have generated 1 warning messages.
    [exec]
     [exec]     +1 javac.  The applied patch does not increase the total number of javac compiler
warnings.
     [exec]
     [exec]     +1 findbugs.  The patch does not introduce any new Findbugs warnings.
     [exec]
     [exec]     -1 Eclipse classpath. The patch causes the Eclipse classpath to differ from
the contents of the lib directories.     [exec]     [exec]

> Backport trunk heuristics for failing maps when we get fetch failures retrieving map
output during shuffle
> ----------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2524
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2524
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: tasktracker
>    Affects Versions: 0.20.204.0
>            Reporter: Thomas Graves
>            Assignee: Thomas Graves
>            Priority: Minor
>             Fix For: 0.20.205.0
>
>         Attachments: MAPREDUCE2524-patch-20security.txt
>
>
> The heuristics for failing maps when we get map output fetch failures during the shuffle
is pretty conservative in 20. Backport the heuristics from trunk which are more aggressive,
simpler, and configurable.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message