Return-Path: X-Original-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E34B743CF for ; Thu, 2 Jun 2011 03:18:32 +0000 (UTC) Received: (qmail 23160 invoked by uid 500); 2 Jun 2011 03:18:32 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 23106 invoked by uid 500); 2 Jun 2011 03:18:31 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 23092 invoked by uid 99); 2 Jun 2011 03:18:29 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Jun 2011 03:18:29 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Jun 2011 03:18:27 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id A8D72EF7AF for ; Thu, 2 Jun 2011 03:17:47 +0000 (UTC) Date: Thu, 2 Jun 2011 03:17:47 +0000 (UTC) From: "Amar Kamat (JIRA)" To: mapreduce-issues@hadoop.apache.org Message-ID: <694716458.61788.1306984667688.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <40797085.17439.1304397363120.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Updated] (MAPREDUCE-2469) Task counters should also report the total heap usage of the task MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/MAPREDUCE-2469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated MAPREDUCE-2469: ---------------------------------- Resolution: Fixed Fix Version/s: 0.23.0 Release Note: Task attempt's total heap usage gets recorded and published via counters as COMMITTED_HEAP_BYTES. Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) I just committed the latest patch to trunk. Thanks Ravi, Santosh and Owen! > Task counters should also report the total heap usage of the task > ----------------------------------------------------------------- > > Key: MAPREDUCE-2469 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2469 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Components: task > Affects Versions: 0.23.0 > Reporter: Amar Kamat > Assignee: Amar Kamat > Labels: mapreduce > Fix For: 0.23.0 > > Attachments: 2469.v0.1.patch, mapreduce-2469-v1.1.patch, mapreduce-2469-v1.2.patch, mapreduce-2469-v1.3.patch, mapreduce-2469-v1.4.patch > > > Currently, the task counters report VSS and RSS usage of the task. The task counter should also report the total heap usage of the task also. The task might be configured with a max heap size of M but the task's total heap usage might only be H, where H < M. In such a case, knowing only M doesn't provide a complete picture of the task's memory usage. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira