hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun C Murthy (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2237) Lost heartbeat response containing MapTask throws NPE when it is resent
Date Mon, 12 Sep 2011 23:51:09 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13103189#comment-13103189
] 

Arun C Murthy commented on MAPREDUCE-2237:
------------------------------------------

Devaraj - this seems like it's already fixed in 0.20.2xx. I can commit this to 0.23, but it's
probably not going to be ever used. Is that ok?

> Lost heartbeat response containing MapTask throws NPE when it is resent
> -----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2237
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2237
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: jobtracker
>    Affects Versions: 0.20.2, 0.21.0, 0.22.0
>            Reporter: Todd Lipcon
>            Assignee: Devaraj K
>             Fix For: 0.23.0
>
>         Attachments: MAPREDUCE-2237-0.20.patch, MAPREDUCE-2237-0.23.1.patch, MAPREDUCE-2237-0.23.2.patch,
MAPREDUCE-2237-0.23.patch
>
>
> When the JT sends a heartbeat response, it records it in trackerToHeartbeatResponseMap.
But after MapTask writes its input split, it sets that split to null (assumedly to save memory?).
So, if the heartbeat response is lost, and the JT needs to resend it, it will throw NPE since
the split information has been lost.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message