hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From d...@apache.org
Subject svn commit: r754927 - in /hadoop/core/trunk: CHANGES.txt src/mapred/org/apache/hadoop/mapred/ReduceTask.java
Date Mon, 16 Mar 2009 16:19:58 GMT
Author: ddas
Date: Mon Mar 16 16:19:57 2009
New Revision: 754927

URL: http://svn.apache.org/viewvc?rev=754927&view=rev
Log:
HADOOP-5493. The shuffle copier threads return the codecs back to the pool when the shuffle
completes. Contributed by Jothi Padmanabhan.

Modified:
    hadoop/core/trunk/CHANGES.txt
    hadoop/core/trunk/src/mapred/org/apache/hadoop/mapred/ReduceTask.java

Modified: hadoop/core/trunk/CHANGES.txt
URL: http://svn.apache.org/viewvc/hadoop/core/trunk/CHANGES.txt?rev=754927&r1=754926&r2=754927&view=diff
==============================================================================
--- hadoop/core/trunk/CHANGES.txt (original)
+++ hadoop/core/trunk/CHANGES.txt Mon Mar 16 16:19:57 2009
@@ -1001,6 +1001,9 @@
     HADOOP-5490. Fixes a synchronization problem in the EagerTaskInitializationListener
     class. (Jothi Padmanabhan via ddas)
 
+    HADOOP-5493. The shuffle copier threads return the codecs back to the pool when the
+    shuffle completes. (Jothi Padmanabhan via ddas)
+
 Release 0.19.2 - Unreleased
 
   BUG FIXES

Modified: hadoop/core/trunk/src/mapred/org/apache/hadoop/mapred/ReduceTask.java
URL: http://svn.apache.org/viewvc/hadoop/core/trunk/src/mapred/org/apache/hadoop/mapred/ReduceTask.java?rev=754927&r1=754926&r2=754927&view=diff
==============================================================================
--- hadoop/core/trunk/src/mapred/org/apache/hadoop/mapred/ReduceTask.java (original)
+++ hadoop/core/trunk/src/mapred/org/apache/hadoop/mapred/ReduceTask.java Mon Mar 16 16:19:57
2009
@@ -1238,7 +1238,7 @@
               finish(size, error);
             }
           } catch (InterruptedException e) { 
-            return; // ALL DONE
+            break; // ALL DONE
           } catch (FSError e) {
             LOG.error("Task: " + reduceTask.getTaskID() + " - FSError: " + 
                       StringUtils.stringifyException(e));
@@ -1253,6 +1253,11 @@
                       StringUtils.stringifyException(th));
           }
         }
+        
+        if (decompressor != null) {
+          CodecPool.returnDecompressor(decompressor);
+        }
+          
       }
       
       /** Copies a a map output from a remote host, via HTTP. 



Mime
View raw message