Return-Path: X-Original-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2198B64E7 for ; Wed, 1 Jun 2011 14:14:31 +0000 (UTC) Received: (qmail 45914 invoked by uid 500); 1 Jun 2011 14:14:31 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 45842 invoked by uid 500); 1 Jun 2011 14:14:30 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 45826 invoked by uid 99); 1 Jun 2011 14:14:30 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Jun 2011 14:14:30 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Jun 2011 14:14:28 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id A1978EE345 for ; Wed, 1 Jun 2011 14:13:47 +0000 (UTC) Date: Wed, 1 Jun 2011 14:13:47 +0000 (UTC) From: "Amar Kamat (JIRA)" To: mapreduce-issues@hadoop.apache.org Message-ID: <1400966920.59628.1306937627658.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <40797085.17439.1304397363120.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Updated] (MAPREDUCE-2469) Task counters should also report the total heap usage of the task MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/MAPREDUCE-2469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated MAPREDUCE-2469: ---------------------------------- Attachment: mapreduce-2469-v1.4.patch Attaching a new patch incorporating Ravi's offline comments. test-patch passed. The only change is in TestJobCounters and that passed on my box. > Task counters should also report the total heap usage of the task > ----------------------------------------------------------------- > > Key: MAPREDUCE-2469 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2469 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Components: task > Affects Versions: 0.23.0 > Reporter: Amar Kamat > Assignee: Amar Kamat > Labels: mapreduce > Attachments: 2469.v0.1.patch, mapreduce-2469-v1.1.patch, mapreduce-2469-v1.2.patch, mapreduce-2469-v1.3.patch, mapreduce-2469-v1.4.patch > > > Currently, the task counters report VSS and RSS usage of the task. The task counter should also report the total heap usage of the task also. The task might be configured with a max heap size of M but the task's total heap usage might only be H, where H < M. In such a case, knowing only M doesn't provide a complete picture of the task's memory usage. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira