hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ahmad Humayun" <ahmad.hu...@gmail.com>
Subject FS to DFS
Date Fri, 14 Mar 2008 11:37:28 GMT
Hi there,

Does the map input (for a certain node) on the DFS get copied to the local
FS before work starts on it? Can you point me to a place in the code for

Plus once the shuffle phase ends and the reduce task receives all the
intermediate data from all the maps, does every reduce copies the
intermediate data to the DFS for safe keeping?

thanks for all the help :)

Ahmad Humayun
Research Assistant
Computer Science Dpt., LUMS
+92 321 4457315

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message