hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sharad Agarwal (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2702) [MR-279] OutputCommitter changes for MR Application Master recovery
Date Fri, 05 Aug 2011 11:13:27 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13079906#comment-13079906

Sharad Agarwal commented on MAPREDUCE-2702:

Also as part of the last patch, fixed the directory structure from mapreduce/mr-client/hadoop-mapreduce-client-core/src/test/mapred
to mapreduce/mr-client/hadoop-mapreduce-client-core/src/test/java

> [MR-279] OutputCommitter changes for MR Application Master recovery
> -------------------------------------------------------------------
>                 Key: MAPREDUCE-2702
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2702
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: mrv2
>            Reporter: Sharad Agarwal
>            Assignee: Sharad Agarwal
>         Attachments: mr2702_v1.patch
> In MR AM recovers from a crash, it only reruns the non completed tasks. The completed
tasks (along with their output, if any) needs to be recovered from the previous life. This
would require some changes in OutputCommitter.

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message