hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Allen Wittenauer <awittena...@linkedin.com>
Subject Re: How to Influence Reduce Task Location.
Date Sun, 19 Dec 2010 23:59:16 GMT

On Dec 19, 2010, at 10:23 AM, Jane Chen wrote:

> Suppose that the output is written to a database, that only runs on certain nodes.  It
will be desirable to schedule the reducer tasks to run on the nodes local or close to the
database nodes.

	a) That's a side-effect--pretty much "against the rules".  Very little support is provided
for such things.

	b) At a minimum, you'll need to write your own scheduler.

View raw message