hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jane Chen <jxchen_us_1...@yahoo.com>
Subject Re: How to Influence Reduce Task Location.
Date Sat, 18 Dec 2010 18:24:06 GMT
But how does this help me request which host to schedule the reduce task to?


--- On Sat, 12/18/10, Hari Sreekumar <hsreekumar@clickable.com> wrote:

From: Hari Sreekumar <hsreekumar@clickable.com>
Subject: Re: How to Influence Reduce Task Location.
To: mapreduce-user@hadoop.apache.org
Date: Saturday, December 18, 2010, 10:16 AM

Hi Jane,

         The partitioner class can be used to achieve this. (http://hadoop.apache.org/mapreduce/docs/r0.21.0/api/org/apache/hadoop/mapreduce/Partitioner.html).


On Sat, Dec 18, 2010 at 11:13 PM, Jane Chen <jxchen_us_1999@yahoo.com> wrote:

Hi All,

Is there anyway to influence where a reduce task is run?  We have a case where we'd like
to choose the host to run the reduce task based on the task's input key.

Any suggestion is greatly appreciated.


View raw message