Author: acmurthy
Date: Mon Aug 1 22:49:09 2011
New Revision: 1152960
URL: http://svn.apache.org/viewvc?rev=1152960&view=rev
Log:
MAPREDUCE-2324. Removed usage of broken ResourceEstimator.getEstimatedReduceInputSize to check
against usable disk-space on TaskTracker. Contributed by Robert Evans.
Modified:
hadoop/common/branches/branch-0.20-security/CHANGES.txt
hadoop/common/branches/branch-0.20-security/src/mapred/org/apache/hadoop/mapred/JobInProgress.java
Modified: hadoop/common/branches/branch-0.20-security/CHANGES.txt
URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.20-security/CHANGES.txt?rev=1152960&r1=1152959&r2=1152960&view=diff
==============================================================================
--- hadoop/common/branches/branch-0.20-security/CHANGES.txt (original)
+++ hadoop/common/branches/branch-0.20-security/CHANGES.txt Mon Aug 1 22:49:09 2011
@@ -51,6 +51,10 @@ Release 0.20.204.0 - unreleased
BUG FIXES
+ MAPREDUCE-2324. Removed usage of broken
+ ResourceEstimator.getEstimatedReduceInputSize to check against usable
+ disk-space on TaskTracker. (Robert Evans via acmurthy)
+
MAPREDUCE-2621. TestCapacityScheduler fails with "Queue "q1" does not exist".
(Sherry Chen via mahadev)
Modified: hadoop/common/branches/branch-0.20-security/src/mapred/org/apache/hadoop/mapred/JobInProgress.java
URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.20-security/src/mapred/org/apache/hadoop/mapred/JobInProgress.java?rev=1152960&r1=1152959&r2=1152960&view=diff
==============================================================================
--- hadoop/common/branches/branch-0.20-security/src/mapred/org/apache/hadoop/mapred/JobInProgress.java
(original)
+++ hadoop/common/branches/branch-0.20-security/src/mapred/org/apache/hadoop/mapred/JobInProgress.java
Mon Aug 1 22:49:09 2011
@@ -2438,16 +2438,6 @@ public class JobInProgress {
return -1;
}
- long outSize = resourceEstimator.getEstimatedReduceInputSize();
- long availSpace = tts.getResourceStatus().getAvailableSpace();
- if(availSpace < outSize) {
- LOG.warn("No room for reduce task. Node " + taskTracker + " has " +
- availSpace +
- " bytes free; but we expect reduce input to take " + outSize);
-
- return -1; //see if a different TIP might work better.
- }
-
// 1. check for a never-executed reduce tip
// reducers don't have a cache and so pass -1 to explicitly call that out
tip = findTaskFromList(nonRunningReduces, tts, numUniqueHosts, false);
|