hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Joseph Evans (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-4128) AM Recovery expects all attempts of a completed task to also be completed.
Date Thu, 12 Apr 2012 20:21:16 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13252796#comment-13252796
] 

Robert Joseph Evans commented on MAPREDUCE-4128:
------------------------------------------------

I am not an expert on Avro, so I really don't know why it is not handling the schema thing
better.  The JobHistory files are also AVRO JSON, so I am really confused why it would blow
up so badly.  In either case I think you do need to handle the null for the ID.  That is because
there are likely to be older job history files sitting around, and we don't want to crash
if they are read in. 
                
> AM Recovery expects all attempts of a completed task to also be completed.
> --------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-4128
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4128
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 3.0.0
>            Reporter: Bikas Saha
>            Assignee: Bikas Saha
>             Fix For: 3.0.0
>
>         Attachments: MAPREDUCE-4128-1.patch, MAPREDUCE-4128-2.patch, MAPREDUCE-4128.patch
>
>
> The AM seems to assume that all attempts of a completed task (from a previous AM incarnation)
would also be completed. There is at least one case in which this does not hold. Case being
cancellation of a completed task resulting in a new running attempt.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message