hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From jagaran das <jagaran_...@yahoo.co.in>
Subject Re: Question regarding network data transfer
Date Sun, 29 May 2011 01:08:15 GMT
Mappers write to local persistance and reducers write to hdfs

- Jagaran 

From: Aishwarya Venkataraman <avenkata@cs.ucsd.edu>
To: common-dev@hadoop.apache.org
Sent: Sat, 28 May, 2011 4:11:13 PM
Subject: Question regarding network data transfer


Where exactly(Java class) does the network data transfer happen from a
mapper to a reducer ? Mapper seems to be writing data to the HDFS. Does
reducer read data from the mapper's HDFS over the network ? This is evading
me. Thanks in advance for the help.


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message