hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Jungblut (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1755) Zombie tasks kept alive by logging system
Date Mon, 22 Nov 2010 20:27:18 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934585#action_12934585
] 

Thomas Jungblut commented on MAPREDUCE-1755:
--------------------------------------------

So I had some time to test a bit. 
I have a 0.20.2 Hadoop on my ubuntu netbook and same virtual machine running on the cluster
servers.

I implemented a WordCount memory leak that will immediately fail the task. So what's the suprise?
There are no zombies!
That is a really strange problem...

> Zombie tasks kept alive by logging system
> -----------------------------------------
>
>                 Key: MAPREDUCE-1755
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1755
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>    Affects Versions: 0.20.2
>            Reporter: Allen Wittenauer
>         Attachments: jstack.txt, stderr.txt, syslog.txt, tightloop.txt
>
>
> I'm currently looking at a task that, as far as the task tracker is concerned, is dead.
 Like long long long ago dead.  It was a failed task that ran out of heap.  Rather than just
kill it, I thought I would see what it was doing, since it was clearly using system resources.
 It would appear the system is trying to log but failing.  I'm guessing we're missing an error
condition and not doing the appropriate thing. See the comments for more.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message