Return-Path: X-Original-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D9B5D46C1 for ; Thu, 2 Jun 2011 03:39:30 +0000 (UTC) Received: (qmail 41632 invoked by uid 500); 2 Jun 2011 03:39:30 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 41564 invoked by uid 500); 2 Jun 2011 03:39:29 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 41556 invoked by uid 99); 2 Jun 2011 03:39:29 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Jun 2011 03:39:29 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Jun 2011 03:39:27 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 83E16EFBA1 for ; Thu, 2 Jun 2011 03:38:47 +0000 (UTC) Date: Thu, 2 Jun 2011 03:38:47 +0000 (UTC) From: "Hudson (JIRA)" To: mapreduce-issues@hadoop.apache.org Message-ID: <1232295029.61842.1306985927537.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <40797085.17439.1304397363120.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (MAPREDUCE-2469) Task counters should also report the total heap usage of the task MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/MAPREDUCE-2469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042592#comment-13042592 ] Hudson commented on MAPREDUCE-2469: ----------------------------------- Integrated in Hadoop-Mapreduce-trunk-Commit #708 (See [https://builds.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/708/]) MAPREDUCE-2469. Task counters should also report the total heap usage of the task. (Ravi Gummadi and Amar Ramesh Kamat via amarrk) amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1130393 Files : * /hadoop/mapreduce/trunk/CHANGES.txt * /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapred/Task.java * /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapreduce/TaskCounter.java * /hadoop/mapreduce/trunk/src/test/mapred/org/apache/hadoop/mapred/TestJobCounters.java * /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapreduce/TaskCounter.properties > Task counters should also report the total heap usage of the task > ----------------------------------------------------------------- > > Key: MAPREDUCE-2469 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2469 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Components: task > Affects Versions: 0.23.0 > Reporter: Amar Kamat > Assignee: Amar Kamat > Labels: mapreduce > Fix For: 0.23.0 > > Attachments: 2469.v0.1.patch, mapreduce-2469-v1.1.patch, mapreduce-2469-v1.2.patch, mapreduce-2469-v1.3.patch, mapreduce-2469-v1.4.patch > > > Currently, the task counters report VSS and RSS usage of the task. The task counter should also report the total heap usage of the task also. The task might be configured with a max heap size of M but the task's total heap usage might only be H, where H < M. In such a case, knowing only M doesn't provide a complete picture of the task's memory usage. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira