hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Lowe (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-6771) RMContainerAllocator sends container diagnostics event after corresponding completion event
Date Thu, 29 Sep 2016 16:07:20 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-6771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Jason Lowe updated MAPREDUCE-6771:
       Resolution: Fixed
    Fix Version/s: 3.0.0-alpha2
           Status: Resolved  (was: Patch Available)

Thanks, [~haibochen]!  I committed this to trunk, branch-2, branch-2.8, and branch-2.7.

> RMContainerAllocator sends container diagnostics event after corresponding completion
> -------------------------------------------------------------------------------------------
>                 Key: MAPREDUCE-6771
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6771
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 2.7.3
>            Reporter: Haibo Chen
>            Assignee: Haibo Chen
>             Fix For: 2.8.0, 2.7.4, 3.0.0-alpha2
>         Attachments: TaUnsuccessfullyEventEmission.jpg, mapreduce6771.001.patch, mapreduce6771.002.patch,
mapreduce6771.003.patch, mapreduce6771.004.patch, mapreduce6771.branch-2.8.patch
> Task containers can go over their resource limit, and killed by Node Manager. Then MR
AM gets notified of the container status and diagnostics information through its heartbeat
with RM.  However, it is possible that the diagnostics information never gets into .jhist
file, so when the job completes, the diagnostics information associated with the failed task
attempts is empty.  This makes it hard for users to root cause job failures that are often
caused by memory leak.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org

View raw message