hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From cutt...@apache.org
Subject svn commit: r550932 - in /lucene/hadoop/trunk: CHANGES.txt src/java/org/apache/hadoop/mapred/ReduceTask.java
Date Tue, 26 Jun 2007 20:30:41 GMT
Author: cutting
Date: Tue Jun 26 13:30:40 2007
New Revision: 550932

URL: http://svn.apache.org/viewvc?view=rev&rev=550932
Log:
HADOOP-1514.  Make reducers report progress while waiting for map output, so they're not killed.
 Contributed by Vivek.

Modified:
    lucene/hadoop/trunk/CHANGES.txt
    lucene/hadoop/trunk/src/java/org/apache/hadoop/mapred/ReduceTask.java

Modified: lucene/hadoop/trunk/CHANGES.txt
URL: http://svn.apache.org/viewvc/lucene/hadoop/trunk/CHANGES.txt?view=diff&rev=550932&r1=550931&r2=550932
==============================================================================
--- lucene/hadoop/trunk/CHANGES.txt (original)
+++ lucene/hadoop/trunk/CHANGES.txt Tue Jun 26 13:30:40 2007
@@ -254,6 +254,9 @@
  77. HADOOP-1515.  Add MultiFileInputFormat, which can pack multiple,
      typically small, input files into each split.  (Enis Soztutar via cutting)
 
+ 78. HADOOP-1514.  Make reducers report progress while waiting for map
+     outputs, so they're not killed.  (Vivek Ratan via cutting)
+
 
 Release 0.13.0 - 2007-06-08
 

Modified: lucene/hadoop/trunk/src/java/org/apache/hadoop/mapred/ReduceTask.java
URL: http://svn.apache.org/viewvc/lucene/hadoop/trunk/src/java/org/apache/hadoop/mapred/ReduceTask.java?view=diff&rev=550932&r1=550931&r2=550932
==============================================================================
--- lucene/hadoop/trunk/src/java/org/apache/hadoop/mapred/ReduceTask.java (original)
+++ lucene/hadoop/trunk/src/java/org/apache/hadoop/mapred/ReduceTask.java Tue Jun 26 13:30:40
2007
@@ -872,6 +872,9 @@
           // new, just wait for a bit
           try {
             if (numInFlight == 0 && numScheduled == 0) {
+              // we should indicate progress as we don't want TT to think
+              // we're stuck and kill us
+              reporter.progress();
               Thread.sleep(5000);
             }
           } catch (InterruptedException e) { } // IGNORE



Mime
View raw message