hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Graves (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-2524) Backport trunk heuristics for failing maps when we get fetch failures retrieving map output during shuffle
Date Thu, 26 May 2011 23:01:47 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-2524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Thomas Graves updated MAPREDUCE-2524:
-------------------------------------

    Release Note: Added a new configuration option: mapreduce.reduce.shuffle.maxfetchfailures,
and removed a no longer used option: mapred.reduce.copy.backoff.
          Status: Patch Available  (was: Open)

> Backport trunk heuristics for failing maps when we get fetch failures retrieving map
output during shuffle
> ----------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2524
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2524
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: tasktracker
>    Affects Versions: 0.20.204.0
>            Reporter: Thomas Graves
>            Assignee: Thomas Graves
>            Priority: Minor
>             Fix For: 0.20.205.0
>
>         Attachments: MAPREDUCE2524-20security-v2.patch, MAPREDUCE2524-patch-20security.txt,
MAPREDUCE2524-patch-20security.txt
>
>
> The heuristics for failing maps when we get map output fetch failures during the shuffle
is pretty conservative in 20. Backport the heuristics from trunk which are more aggressive,
simpler, and configurable.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message