hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod K V (JIRA)" <j...@apache.org>
Subject [jira] Updated: (MAPREDUCE-144) TaskMemoryManager should log process-tree's status while killing tasks.
Date Wed, 02 Sep 2009 07:08:32 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Vinod K V updated MAPREDUCE-144:
--------------------------------

    Attachment: MAPREDUCE-144-20090902.txt


Attaching an updated patch to reflect the project split. Also added parent pid to the dump.

The tree dump would look something like below"
{code}
TaskTree [pid=20096,tipID=attempt_20090902122532859_0001_m_000004_0] is running beyond memory-
limits. Current usage : 426889216bytes. Limit : 1048576bytes. Killing task. 
Dump of the process-tree for attempt_20090902122532859_0001_m_000004_0 : 
        |- $pid $ppid $cmd_name $vmem_usage $cmd_line
        |- 20130 20128 (sh) 1916928bytes sh /home/vinodkv/Workspace/eclipse-workspace/hadoop-mapreduce/build/test/data
/testProcessTree_shellScript_-2044420742.sh 0 
        |- 20128 20126 (sh) 1916928bytes sh /home/vinodkv/Workspace/eclipse-workspace/hadoop-mapreduce/build/test/data
/testProcessTree_shellScript_-2044420742.sh 1 
        |- 20116 20096 (bash) 4542464bytes bash -c  echo $$ > /home/vinodkv/Workspace/eclipse-workspace/hadoop-mapreduce/build
/test/data/testProcessTree_pidFile_-1719677031.pid; sh /home/vinodkv/Workspace/eclipse-workspace/hadoop-mapreduce/build/test/data
/testProcessTree_shellScript_-2044420742.sh 6; 
        |- 20117 20116 (sh) 1916928bytes sh /home/vinodkv/Workspace/eclipse-workspace/hadoop-mapreduce/build/test/data
/testProcessTree_shellScript_-2044420742.sh 6 
        |- 20132 20130 (sleep) 3108864bytes sleep 5 
        |- 20120 20117 (sh) 1916928bytes sh /home/vinodkv/Workspace/eclipse-workspace/hadoop-mapreduce/build/test/data
/testProcessTree_shellScript_-2044420742.sh 5 
        ....
{code}


> TaskMemoryManager should log process-tree's status while killing tasks.
> -----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-144
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-144
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Vinod K V
>            Assignee: Vinod K V
>         Attachments: HADOOP-5570-1.patch, HADOOP-5570-20090614.txt, HADOOP-5570-20090615.txt,
HADOOP-5570-20090619.txt, HADOOP-5570-20090622.txt, MAPREDUCE-144-20090902.txt
>
>
> This helps a lot in debugging why a particular task has gone beyond memory limits.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message