hadoop-common-commits mailing list archives

Author: cutting
Date: Wed Apr 26 15:27:15 2006
New Revision: 397321

URL: http://svn.apache.org/viewcvs?rev=397321&view=rev
Log:
Fix HADOOP-169.  Don't fail reduce tasks if a call to the jobtracker to locate map outputs
fails.  Contributed by Owen.

Modified:
    lucene/hadoop/trunk/CHANGES.txt
    lucene/hadoop/trunk/src/java/org/apache/hadoop/mapred/ReduceTaskRunner.java

Modified: lucene/hadoop/trunk/CHANGES.txt
URL: http://svn.apache.org/viewcvs/lucene/hadoop/trunk/CHANGES.txt?rev=397321&r1=397320&r2=397321&view=diff
==============================================================================
--- lucene/hadoop/trunk/CHANGES.txt (original)
+++ lucene/hadoop/trunk/CHANGES.txt Wed Apr 26 15:27:15 2006
@@ -105,6 +105,9 @@
     IOException, so that timeouts are handled appropriately.
     (omalley via cutting)
 
+28. Fix HADOOP-169.  Don't fail a reduce task if a call to the
+    jobtracker to locate map outputs fails.  (omalley via cutting)
+
 
 Release 0.1.1 - 2006-04-08
 

Modified: lucene/hadoop/trunk/src/java/org/apache/hadoop/mapred/ReduceTaskRunner.java
URL: http://svn.apache.org/viewcvs/lucene/hadoop/trunk/src/java/org/apache/hadoop/mapred/ReduceTaskRunner.java?rev=397321&r1=397320&r2=397321&view=diff
==============================================================================
--- lucene/hadoop/trunk/src/java/org/apache/hadoop/mapred/ReduceTaskRunner.java (original)
+++ lucene/hadoop/trunk/src/java/org/apache/hadoop/mapred/ReduceTaskRunner.java Wed Apr 26
15:27:15 2006
@@ -65,10 +65,14 @@
       for (int i = 0; i < checkSize; i++) {
           neededStrings[i] = (String[]) needed.elementAt(i);
       }
-      MapOutputLocation[] locs =
-        jobClient.locateMapOutputs(task.getTaskId(), neededStrings);
-
-      if (locs.length == 0) {
+      MapOutputLocation[] locs = null;
+      try {
+        locs = jobClient.locateMapOutputs(task.getTaskId(), neededStrings);
+      } catch (IOException ie) {
+        LOG.info("Problem locating map outputs: " + 
+                 StringUtils.stringifyException(ie));
+      }
+      if (locs == null || locs.length == 0) {
         try {
           if (killed) {
             return false;