hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2469) Task counters should also report the total heap usage of the task
Date Thu, 02 Jun 2011 03:38:47 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042592#comment-13042592
] 

Hudson commented on MAPREDUCE-2469:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk-Commit #708 (See [https://builds.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/708/])
    MAPREDUCE-2469. Task counters should also report the total heap usage of the task. (Ravi
Gummadi and Amar Ramesh Kamat via amarrk)

amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1130393
Files : 
* /hadoop/mapreduce/trunk/CHANGES.txt
* /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapred/Task.java
* /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapreduce/TaskCounter.java
* /hadoop/mapreduce/trunk/src/test/mapred/org/apache/hadoop/mapred/TestJobCounters.java
* /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapreduce/TaskCounter.properties


> Task counters should also report the total heap usage of the task
> -----------------------------------------------------------------
>
>                 Key: MAPREDUCE-2469
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2469
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: task
>    Affects Versions: 0.23.0
>            Reporter: Amar Kamat
>            Assignee: Amar Kamat
>              Labels: mapreduce
>             Fix For: 0.23.0
>
>         Attachments: 2469.v0.1.patch, mapreduce-2469-v1.1.patch, mapreduce-2469-v1.2.patch,
mapreduce-2469-v1.3.patch, mapreduce-2469-v1.4.patch
>
>
> Currently, the task counters report VSS and RSS usage of the task. The task counter should
also report the total heap usage of the task also. The task might be configured with a max
heap size of M but the task's total heap usage might only be H, where H < M. In such a
case, knowing only M doesn't provide a complete picture of the task's memory usage.  

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message