hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hemanth Yamijala (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1143) runningMapTasks counter is not properly decremented in case of failed Tasks.
Date Fri, 11 Dec 2009 08:51:18 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12789175#action_12789175

Hemanth Yamijala commented on MAPREDUCE-1143:

Arun helped us understand the change that was discussed and I really like the idea. Rather
than looking at this as a way of the TIP calling into the JIP to update counters, I started
thinking about this as the TIP deciding what has changed in its state and informing about
the change to the JIP. Then JIP decides to update its state (basically the counters) based
on this information. This is a really good separation of ownership.

However, Arun, Rahul and I looked into making this change into the current code base and fell
out of confidence with respect to the level of change it was causing. Given this point, we
now feel that my original suggestion [here|https://issues.apache.org/jira/browse/MAPREDUCE-1143?focusedCommentId=12784077&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#action_12784077],
while agreeably not as good as Owen's, is a *safer* and more localized change to implement
than the alternate proposal. And we suggest taking that approach to fix this JIRA.

A rewrite of this status update code is really long overdue, and it would anyway be done in
the manner Owen is proposing, but in a separate JIRA. Hope this is agreeable to all.

> runningMapTasks counter is not properly decremented in case of failed Tasks.
> ----------------------------------------------------------------------------
>                 Key: MAPREDUCE-1143
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1143
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: rahul k singh
>            Priority: Blocker
>         Attachments: MAPRED-1143-1.patch, MAPRED-1143-2.patch, MAPRED-1143-2.patch, MAPRED-1143-3.patch,
MAPRED-1143-4.patch, MAPRED-1143-ydist-1.patch, MAPRED-1143-ydist-2.patch, MAPRED-1143-ydist-3.patch,
MAPRED-1143-ydist-4.patch, MAPRED-1143-ydist-5.patch, MAPRED-1143-ydist-6.patch

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message