hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Owen O'Malley <omal...@apache.org>
Subject Re: Shuffle phase
Date Thu, 26 Feb 2009 22:07:21 GMT

On Feb 26, 2009, at 2:03 PM, Nathan Marz wrote:

> Do the reducers batch copy map outputs from a machine? That is, if a  
> machine M has 15 intermediate map outputs destined for machine R,  
> will machine R copy the intermediate outputs one at a time or all at  
> once?

Currently, one at a time. In 0.21 it will be batched up.

-- Owen

Mime
View raw message