hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Segel <michael_se...@hotmail.com>
Subject Re: how to execute different tasks on data nodes(simultaneously in hadoop).
Date Mon, 03 Sep 2012 16:25:43 GMT
Not sure what you are trying to do...

You want to pass through the entire data set on all nodes where each node runs a single filter?

You're thinking is orthogonal to how Hadoop works. 

You would be better off letting each node work on a portion of the data which is local to
that node running the entire filter set. 

On Sep 3, 2012, at 11:19 AM, mallik arjun <mallik.cloud@gmail.com> wrote:

> genrally in hadoop map function will be exeucted by all the data nodes on the input data
set ,against this how can i do the following.
> i have some filter programs , and what i want to do is each data node(slave) has to execute
one filter alogrithm  simultaneously, diffent from other data nodes executions.
> thanks in advance.

View raw message