Author: tomwhite
Date: Fri Feb 12 05:23:15 2010
New Revision: 909239
URL: http://svn.apache.org/viewvc?rev=909239&view=rev
Log:
MAPREDUCE-1469. Sqoop should disable speculative execution in export. Contributed by Aaron
Kimball.
Modified:
hadoop/mapreduce/trunk/CHANGES.txt
hadoop/mapreduce/trunk/src/contrib/sqoop/src/java/org/apache/hadoop/sqoop/mapreduce/ExportJob.java
Modified: hadoop/mapreduce/trunk/CHANGES.txt
URL: http://svn.apache.org/viewvc/hadoop/mapreduce/trunk/CHANGES.txt?rev=909239&r1=909238&r2=909239&view=diff
==============================================================================
--- hadoop/mapreduce/trunk/CHANGES.txt (original)
+++ hadoop/mapreduce/trunk/CHANGES.txt Fri Feb 12 05:23:15 2010
@@ -322,6 +322,9 @@
MAPREDUCE-1399. The archive command shows a null error message (nicholas
via mahadev)
+ MAPREDUCE-1469. Sqoop should disable speculative execution in export.
+ (Aaron Kimball via tomwhite)
+
Release 0.21.0 - Unreleased
INCOMPATIBLE CHANGES
Modified: hadoop/mapreduce/trunk/src/contrib/sqoop/src/java/org/apache/hadoop/sqoop/mapreduce/ExportJob.java
URL: http://svn.apache.org/viewvc/hadoop/mapreduce/trunk/src/contrib/sqoop/src/java/org/apache/hadoop/sqoop/mapreduce/ExportJob.java?rev=909239&r1=909238&r2=909239&view=diff
==============================================================================
--- hadoop/mapreduce/trunk/src/contrib/sqoop/src/java/org/apache/hadoop/sqoop/mapreduce/ExportJob.java
(original)
+++ hadoop/mapreduce/trunk/src/contrib/sqoop/src/java/org/apache/hadoop/sqoop/mapreduce/ExportJob.java
Fri Feb 12 05:23:15 2010
@@ -172,6 +172,9 @@
FileInputFormat.addInputPath(job, inputPath);
job.setNumReduceTasks(0);
+ // Concurrent writes of the same records would be problematic.
+ job.setMapSpeculativeExecution(false);
+
ConnManager mgr = new ConnFactory(conf).getManager(options);
String username = options.getUsername();
if (null == username || username.length() == 0) {
|