hadoop-mapreduce-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From tomwh...@apache.org
Subject svn commit: r909239 - in /hadoop/mapreduce/trunk: CHANGES.txt src/contrib/sqoop/src/java/org/apache/hadoop/sqoop/mapreduce/ExportJob.java
Date Fri, 12 Feb 2010 05:23:15 GMT
Author: tomwhite
Date: Fri Feb 12 05:23:15 2010
New Revision: 909239

URL: http://svn.apache.org/viewvc?rev=909239&view=rev
Log:
MAPREDUCE-1469. Sqoop should disable speculative execution in export. Contributed by Aaron
Kimball.

Modified:
    hadoop/mapreduce/trunk/CHANGES.txt
    hadoop/mapreduce/trunk/src/contrib/sqoop/src/java/org/apache/hadoop/sqoop/mapreduce/ExportJob.java

Modified: hadoop/mapreduce/trunk/CHANGES.txt
URL: http://svn.apache.org/viewvc/hadoop/mapreduce/trunk/CHANGES.txt?rev=909239&r1=909238&r2=909239&view=diff
==============================================================================
--- hadoop/mapreduce/trunk/CHANGES.txt (original)
+++ hadoop/mapreduce/trunk/CHANGES.txt Fri Feb 12 05:23:15 2010
@@ -322,6 +322,9 @@
     MAPREDUCE-1399. The archive command shows a null error message (nicholas
     via mahadev)
 
+    MAPREDUCE-1469. Sqoop should disable speculative execution in export.
+    (Aaron Kimball via tomwhite)
+
 Release 0.21.0 - Unreleased
 
   INCOMPATIBLE CHANGES

Modified: hadoop/mapreduce/trunk/src/contrib/sqoop/src/java/org/apache/hadoop/sqoop/mapreduce/ExportJob.java
URL: http://svn.apache.org/viewvc/hadoop/mapreduce/trunk/src/contrib/sqoop/src/java/org/apache/hadoop/sqoop/mapreduce/ExportJob.java?rev=909239&r1=909238&r2=909239&view=diff
==============================================================================
--- hadoop/mapreduce/trunk/src/contrib/sqoop/src/java/org/apache/hadoop/sqoop/mapreduce/ExportJob.java
(original)
+++ hadoop/mapreduce/trunk/src/contrib/sqoop/src/java/org/apache/hadoop/sqoop/mapreduce/ExportJob.java
Fri Feb 12 05:23:15 2010
@@ -172,6 +172,9 @@
       FileInputFormat.addInputPath(job, inputPath);
       job.setNumReduceTasks(0);
 
+      // Concurrent writes of the same records would be problematic.
+      job.setMapSpeculativeExecution(false);
+
       ConnManager mgr = new ConnFactory(conf).getManager(options);
       String username = options.getUsername();
       if (null == username || username.length() == 0) {



Mime
View raw message