hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chang Li (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-5003) AM recovery should recreate records for attempts that were incomplete
Date Tue, 15 Sep 2015 01:21:46 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-5003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14744644#comment-14744644

Chang Li commented on MAPREDUCE-5003:

The broken unit test is unrelated to my change. Have test this test on my local machine with
my patch on and the test passed. [~jlowe] please help review the latest patch. Thanks!

> AM recovery should recreate records for attempts that were incomplete
> ---------------------------------------------------------------------
>                 Key: MAPREDUCE-5003
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5003
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mr-am
>            Reporter: Jason Lowe
>            Assignee: Chang Li
>         Attachments: MAPREDUCE-5003.1.patch, MAPREDUCE-5003.2.patch, MAPREDUCE-5003.3.patch,
MAPREDUCE-5003.4.patch, MAPREDUCE-5003.5.patch, MAPREDUCE-5003.5.patch, MAPREDUCE-5003.6.patch,
MAPREDUCE-5003.7.patch, MAPREDUCE-5003.8.patch
> As discussed in MAPREDUCE-4992, it would be nice if the AM recovered task attempt entries
for *all* task attempts launched by the prior app attempt even if those task attempts did
not complete.  The attempts would have to be marked as killed or something similar to indicate
it is no longer running.  Having records for the task attempts enables the user to see what
nodes were associated with the attempts and potentially access their logs.

This message was sent by Atlassian JIRA

View raw message