hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hemanth Yamijala <yhema...@thoughtworks.com>
Subject Re: Ignore keys while scheduling reduce jobs
Date Fri, 14 Sep 2012 11:13:56 GMT
Hi,

When do you know the keys to ignore ? You mentioned "after the map stage"
.. is this at the end of each map task, or at the end of all map tasks ?

Thanks
hemanth

On Fri, Sep 14, 2012 at 4:36 PM, Aseem Anand <aseem.iiith@gmail.com> wrote:

> Hi,
> Is there anyway I can ignore all keys except a certain key ( determined
> after the map stage) to start only 1 reduce job using a partitioner? If so
> could someone suggest such a method.
>
> Regards,
> Aseem
>
>

Mime
View raw message