Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Date: Wed, 28 Sep 2016 14:32:20 +0000 (UTC)
From: "Jason Lowe (JIRA)" <jira@apache.org>
To: mapreduce-issues@hadoop.apache.org
Message-ID: <JIRA.13000546.1472256390000.687898.1475073140687@Atlassian.JIRA>
In-Reply-To: <JIRA.13000546.1472256390000@Atlassian.JIRA>
References: <JIRA.13000546.1472256390000@Atlassian.JIRA> <JIRA.13000546.1472256390918@arcas>
Subject: [jira] [Commented] (MAPREDUCE-6771) RMContainerAllocator sends
 container diagnostics event after corresponding completion event
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Wed, 28 Sep 2016 14:32:23 -0000


    [ https://issues.apache.org/jira/browse/MAPREDUCE-6771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15529829#comment-15529829 ] 

Jason Lowe commented on MAPREDUCE-6771:
---------------------------------------

+1 for the latest patch.  This seems like an important fix to get into 2.8 as well.  Could you provide a patch for branch-2.8?

> RMContainerAllocator sends container diagnostics event after corresponding completion event
> -------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-6771
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6771
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 2.7.3
>            Reporter: Haibo Chen
>            Assignee: Haibo Chen
>         Attachments: TaUnsuccessfullyEventEmission.jpg, mapreduce6771.001.patch, mapreduce6771.002.patch, mapreduce6771.003.patch, mapreduce6771.004.patch
>
>
> Task containers can go over their resource limit, and killed by Node Manager. Then MR AM gets notified of the container status and diagnostics information through its heartbeat with RM.  However, it is possible that the diagnostics information never gets into .jhist file, so when the job completes, the diagnostics information associated with the failed task attempts is empty.  This makes it hard for users to root cause job failures that are often caused by memory leak.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org