hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Pavan Kulkarni <pavan.babu...@gmail.com>
Subject Significance of file.out.index during Shuffle Phase ?
Date Sun, 19 Aug 2012 03:35:07 GMT

  I was trying to understand how exactly the reducers find out how to fetch
the data of its own partition from Map nodes.
During the executions of MapReduce, I see that *file.out* is created on Map
nodes, so my question is how does a reducer
know what part of file.out to fetch? Is the *file.out.index* play any role?
Any help is appreciated .Thanks


--With Regards
Pavan Kulkarni

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message