hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <qwertyman...@gmail.com>
Subject Re: Reduce Task Priority / Scheduler
Date Mon, 20 Dec 2010 03:45:50 GMT
You could use sort of a distributed lock service to achieve this
(ZooKeeper can help). But such things ought to be avoided as David
pointed out above.

On Sun, Dec 19, 2010 at 9:09 PM, Martin Becker <_martinbecker@web.de> wrote:
> Hello everybody,
>
> is there a possibility to make sure that certain/all reduce tasks,
> i.e. the reducers to certain keys, are executed in a specified order?
> This is Job internal, so the Job Scheduler is probably the wrong place to start?
> Does the order induced by the Comparable interface influence the
> execution order at all?
>
> Thanks in advance,
> Martin
>



-- 
Harsh J
www.harshj.com

Mime
View raw message