hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun C Murthy (JIRA)" <j...@apache.org>
Subject [jira] [Closed] (MAPREDUCE-4423) Potential infinite fetching of map output
Date Thu, 11 Oct 2012 17:49:59 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-4423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Arun C Murthy closed MAPREDUCE-4423.

> Potential infinite fetching of map output
> -----------------------------------------
>                 Key: MAPREDUCE-4423
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4423
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.3, 2.0.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: Robert Joseph Evans
>            Priority: Critical
>             Fix For: 0.23.3, 2.0.2-alpha
>         Attachments: MR-4423-branch-0.23.txt, MR-4423-trunk.txt, MR-4423-trunk.txt, MR-4423.txt,
MR-4423.txt, MR-4423.txt
> Inside Fetcher.java there are a few cases where an error can happen and the corresponding
map task is not marked as a fetch failure.  One of these is if the Shuffle server returns
a malformed result.
> MAPREDUCE-3992 makes this case a lot less common, but it is still possible.  IF the shuffle
handler always returns a malformed result, but a OK response the Fetcher will never stop trying
to fetch those results. 

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message