hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Raymond Jennings III <raymondj...@yahoo.com>
Subject I thought map and reduce could not overlap?
Date Sat, 14 Nov 2009 16:05:39 GMT
I thought there was a barrier that ensured the map phase would finish before the reduce phase
started but I see on the sample hadoop word count app:

09/11/14 10:58:50 INFO mapred.JobClient:  map 79% reduce 18%
09/11/14 10:58:54 INFO mapred.JobClient:  map 79% reduce 19%
09/11/14 10:58:55 INFO mapred.JobClient:  map 80% reduce 19%
09/11/14 10:58:58 INFO mapred.JobClient:  map 80% reduce 20%
09/11/14 10:59:00 INFO mapred.JobClient:  map 81% reduce 20%
09/11/14 10:59:04 INFO mapred.JobClient:  map 82% reduce 20%
09/11/14 10:59:05 INFO mapred.JobClient:  map 82% reduce 21%
09/11/14 10:59:08 INFO mapred.JobClient:  map 82% reduce 22%

That looks loke they are overlapping?



      

Mime
View raw message