hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aaron T. Myers (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3858) Task attempt failure during commit results in task never completing
Date Tue, 14 Feb 2012 18:23:59 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13207883#comment-13207883

Aaron T. Myers commented on MAPREDUCE-3858:

+1 (non-binding.) I tested this patch on a cluster over night and didn't experience this issue
at all, whereas without this patch I hit this problem twice in a 12 hour period under the
same load.
> Task attempt failure during commit results in task never completing
> -------------------------------------------------------------------
>                 Key: MAPREDUCE-3858
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3858
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>            Reporter: Tom White
>            Assignee: Tom White
>            Priority: Critical
>         Attachments: MAPREDUCE-3858.patch
> On a terasort job a task attempt failed during the commit phase. Another attempt was
rescheduled, but when it tried to commit it failed.
> {noformat}
> attempt_1329019187148_0083_r_000586_0 already given a go for committing the task output,
so killing attempt_1329019187148_0083_r_000586_1
> {noformat}
> The job hung as new attempts kept getting scheduled only to fail during commit.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message