hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Benjamin.Hil...@urz.uni-heidelberg.de
Subject Memory usage in the reducers
Date Sun, 09 Jan 2011 09:50:19 GMT
Hello everyone,

I do not have much practical experience using Hadoop and there is a  
thing I'd like to know but can't test it at the moment and I'm not  
sure about it theoretically ;)
On a Reducer, do all calls to reduce() share the main memory the  
Reducer has, or are all those calls sequential and the main memory one  
call uses gets freed again after it's done? Suppose the Reducer has 2  
GB of free main memory, can I expect to be able to use those 2 GB in  
every call to reduce?

Thanks in advance,


View raw message