hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "SuYan (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-6912) CompletedMapTask contains failed and killed will lead mapreduce.job.reduce.slowstart.completedmaps not work properly
Date Thu, 06 Jul 2017 03:17:01 GMT
SuYan created MAPREDUCE-6912:
--------------------------------

             Summary: CompletedMapTask contains failed and killed will lead mapreduce.job.reduce.slowstart.completedmaps
not work properly
                 Key: MAPREDUCE-6912
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6912
             Project: Hadoop Map/Reduce
          Issue Type: Bug
            Reporter: SuYan


if the conf is set to 1, is about to make reduce task to be scheduled only after all map task
success

{code}

int completedMapsForReduceSlowstart = (int)Math.ceil(reduceSlowStart *
totalMaps);
if(completedMaps < completedMapsForReduceSlowstart) {}

///////////////////////////

int completedMaps = getJob().getCompletedMaps();

///////////////////////////
JobImpl
 @Override
public int getCompletedMaps() {
readLock.lock();
try {
return succeededMapTaskCount + failedMapTaskCount + killedMapTaskCount;
} finally {
readLock.unlock();
}
}
{code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org


Mime
View raw message