hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sagar Naik <sa...@visvo.com>
Subject Re: Aborting Map Function
Date Wed, 16 Apr 2008 15:43:39 GMT
Chaman Singh Verma wrote:
> Hello,
> I am developing one application with MapReduce and in that whenever some
> MapTask condition is 
> met, I would like to broadcast to all other MapTask to abort their work. I
> am not quite sure whether
> such broadcasting functionality currently exist in Hadoop MapReduce. Could
> someone give some
> hints.
> Although extending this functionality may be easy as all the slaves
> periodically ping the master,
> I was just thinking of piggybacking one bit information from the slave to
> the master and master
> may send this information to all the slaves in the next round. Any
> suggestions to this approach ?
> Thanks.
> With Regards 
> -----
> Chaman Singh Verma
> Poona, India
One possible solution could be to use Counters 
Though it is advisable to look into details of implementation of it, and 
see if it can be used for multi-process shared variable

View raw message