hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Upendra Dadi <ud...@gmu.edu>
Subject how to set one map task for each input key-value pair
Date Fri, 27 Nov 2009 00:53:23 GMT
  I am trying to use MapReduce with some scientific data. I have key-value 
pairs such that the size of the value can range from few megabytes to 
several hundreds of megabytes. What happens when the size of the value 
exceeds block size? How do I set it up so that each key-value pair is 
associated with a seperate map? Please some one help. Thanks.


View raw message