hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-2708) Force the task tracker to exit when the task is complete, prevents nodes from dying due to resource starvation from impropertly written map/reduce tasks
Date Thu, 24 Jan 2008 23:18:35 GMT
Force the task tracker to exit when the task is complete, prevents nodes from dying due to
resource starvation from impropertly written map/reduce tasks
--------------------------------------------------------------------------------------------------------------------------------------------------------

                 Key: HADOOP-2708
                 URL: https://issues.apache.org/jira/browse/HADOOP-2708
             Project: Hadoop Core
          Issue Type: Improvement
          Components: mapred
    Affects Versions: 0.15.2
            Reporter: Jason
            Priority: Minor
             Fix For: 0.15.3


We have map/reduce jobs that sometimes run additional threads that are not at daemon priority,
and these threads prevent the Task from properly exiting. When enough of these accumulate,
the node falls over.

The included patch forces the Tasks to exit when completed.

Index: src/java/org/apache/hadoop/mapred/TaskTracker.java
===================================================================
--- src/java/org/apache/hadoop/mapred/TaskTracker.java  (revision 608611)
+++ src/java/org/apache/hadoop/mapred/TaskTracker.java  (working copy)
@@ -1801,6 +1801,8 @@
         // This assumes that on return from Task.run()
         // there is no more logging done.
         LogManager.shutdown();
+
+        System.exit(0);
       }
     }
   } 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message