hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mahadev konar (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-791) deadlock issue in taskstracker.
Date Thu, 14 Dec 2006 20:06:22 GMT
     [ http://issues.apache.org/jira/browse/HADOOP-791?page=all ]

Mahadev konar updated HADOOP-791:
---------------------------------

    Attachment: deadlock2.patch

An updated patch which includes a fix for speculative reduces. The cleanup code for speculative
reduces currently cleans up the tip directory. It should only clean up the task directory.

> deadlock issue in taskstracker.
> -------------------------------
>
>                 Key: HADOOP-791
>                 URL: http://issues.apache.org/jira/browse/HADOOP-791
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>            Reporter: Mahadev konar
>         Assigned To: Mahadev konar
>         Attachments: deadlock2.patch
>
>
> the stack trace--
> "main":
>         at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.createStatus(TaskTracker.java:880)
>         - waiting to lock <0xea101658> (a org.apache.hadoop.mapred.TaskTracker$TaskInProgress)
>         at org.apache.hadoop.mapred.TaskTracker.transmitHeartBeat(TaskTracker.java:489)
>         - locked <0x75505f00> (a org.apache.hadoop.mapred.TaskTracker)
>         at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:442)
>         at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:720)
>         at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1374)
> "taskCleanup":
>         at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.cleanup(TaskTracker.java:1072)
>         - waiting to lock <0x75505f00> (a org.apache.hadoop.mapred.TaskTracker)
>         at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.jobHasFinished(TaskTracker.java:1013)
>         - locked <0xea101658> (a org.apache.hadoop.mapred.TaskTracker$TaskInProgress)
>         at org.apache.hadoop.mapred.TaskTracker$1.run(TaskTracker.java:144)
>         at java.lang.Thread.run(Thread.java:595)
> Found 1 deadlock.
> The jobhasfinished method and transmitHeart beat lock the tasktracker and tip in a different
order. Also , before emitting HeartBeat we should be updating the status and removing entries
from runningtasks. Currently this is done after the heartbeat.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message