hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From cutt...@apache.org
Subject svn commit: r511100 - in /lucene/hadoop/trunk: CHANGES.txt src/contrib/streaming/src/java/org/apache/hadoop/streaming/PipeMapRed.java
Date Fri, 23 Feb 2007 20:48:42 GMT
Author: cutting
Date: Fri Feb 23 12:48:41 2007
New Revision: 511100

URL: http://svn.apache.org/viewvc?view=rev&rev=511100
Log:
HADOOP-878.  In contrib/streaming, fix reducer=NONE to work with multiple maps.  Contributed
by Arun.

Modified:
    lucene/hadoop/trunk/CHANGES.txt
    lucene/hadoop/trunk/src/contrib/streaming/src/java/org/apache/hadoop/streaming/PipeMapRed.java

Modified: lucene/hadoop/trunk/CHANGES.txt
URL: http://svn.apache.org/viewvc/lucene/hadoop/trunk/CHANGES.txt?view=diff&rev=511100&r1=511099&r2=511100
==============================================================================
--- lucene/hadoop/trunk/CHANGES.txt (original)
+++ lucene/hadoop/trunk/CHANGES.txt Fri Feb 23 12:48:41 2007
@@ -132,6 +132,9 @@
 38. HADOOP-1034.  Fix datanode to better log exceptions.
     (Philippe Gassmann via cutting)
 
+39. HADOOP-878.  In contrib/streaming, fix reducer=NONE to work with
+    multiple maps.  (Arun C Murthy via cutting)
+
 
 Release 0.11.2 - 2007-02-16
 

Modified: lucene/hadoop/trunk/src/contrib/streaming/src/java/org/apache/hadoop/streaming/PipeMapRed.java
URL: http://svn.apache.org/viewvc/lucene/hadoop/trunk/src/contrib/streaming/src/java/org/apache/hadoop/streaming/PipeMapRed.java?view=diff&rev=511100&r1=511099&r2=511100
==============================================================================
--- lucene/hadoop/trunk/src/contrib/streaming/src/java/org/apache/hadoop/streaming/PipeMapRed.java
(original)
+++ lucene/hadoop/trunk/src/contrib/streaming/src/java/org/apache/hadoop/streaming/PipeMapRed.java
Fri Feb 23 12:48:41 2007
@@ -185,13 +185,8 @@
 
   String getSideEffectFileName() {
     FileSplit split = StreamUtil.getCurrentSplit(job_);
-    String leaf = split.getPath().getName();
-    if (split.getStart() == 0) {
-      return leaf;
-    } else {
-      return new FileSplit(new Path(leaf), split.getStart(), 
-                           split.getLength(), job_).toString();
-    }
+    return new String(split.getPath().getName() + "-" + split.getStart() + 
+            "-" + split.getLength());
   }
 
   public void configure(JobConf job) {



Mime
View raw message