Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of dechouxb@gmail.com designates
 209.85.216.176 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <BLU0-SMTP1158D3F87AA9A4CBA1003898FAB0@phx.gbl>
References: 
 <CAAHnRnOo5uzpC5Pes9=mUc_AVtARCLyKeCK6MxpK78oaASfX5A@mail.gmail.com>
	<BLU0-SMTP1158D3F87AA9A4CBA1003898FAB0@phx.gbl>
Date: Mon, 3 Sep 2012 18:31:08 +0200
Message-ID: 
 <CAO6W-2dTdcB8N_8yv02svOt0GfDj2a=RSuTAig0XBHCSi8iBUg@mail.gmail.com>
Subject: Re: how to execute different tasks on data nodes(simultaneously in
 hadoop).
From: Bertrand Dechoux <dechouxb@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=485b397dcd5b432e1e04c8ceab58

--485b397dcd5b432e1e04c8ceab58
Content-Type: text/plain; charset=ISO-8859-1

You can check the value of "map.input.file" in order to apply a different
logic for each type of files (in the mapper).
More information about your problem/context would help the readers to
provide a more extensive reply.

Regards

Bertrand

On Mon, Sep 3, 2012 at 6:25 PM, Michael Segel <michael_segel@hotmail.com>wrote:

> Not sure what you are trying to do...
>
> You want to pass through the entire data set on all nodes where each node
> runs a single filter?
>
> You're thinking is orthogonal to how Hadoop works.
>
> You would be better off letting each node work on a portion of the data
> which is local to that node running the entire filter set.
>
>
> On Sep 3, 2012, at 11:19 AM, mallik arjun <mallik.cloud@gmail.com> wrote:
>
> > genrally in hadoop map function will be exeucted by all the data nodes
> on the input data set ,against this how can i do the following.
> > i have some filter programs , and what i want to do is each data
> node(slave) has to execute one filter alogrithm  simultaneously, diffent
> from other data nodes executions.
> >
> > thanks in advance.
> >
> >
>
>


-- 
Bertrand Dechoux

--485b397dcd5b432e1e04c8ceab58
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

You can check the value of &quot;map.input.file&quot; in order to apply a d=
ifferent logic for each type of files (in the mapper).<br>More information =
about your problem/context would help the readers to provide a more extensi=
ve reply.<br>
<br>Regards<br><br>Bertrand<br><br><div class=3D"gmail_quote">On Mon, Sep 3=
, 2012 at 6:25 PM, Michael Segel <span dir=3D"ltr">&lt;<a href=3D"mailto:mi=
chael_segel@hotmail.com" target=3D"_blank">michael_segel@hotmail.com</a>&gt=
;</span> wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">Not sure what you are trying to do...<br>
<br>
You want to pass through the entire data set on all nodes where each node r=
uns a single filter?<br>
<br>
You&#39;re thinking is orthogonal to how Hadoop works.<br>
<br>
You would be better off letting each node work on a portion of the data whi=
ch is local to that node running the entire filter set.<br>
<div class=3D"HOEnZb"><div class=3D"h5"><br>
<br>
On Sep 3, 2012, at 11:19 AM, mallik arjun &lt;<a href=3D"mailto:mallik.clou=
d@gmail.com">mallik.cloud@gmail.com</a>&gt; wrote:<br>
<br>
&gt; genrally in hadoop map function will be exeucted by all the data nodes=
 on the input data set ,against this how can i do the following.<br>
&gt; i have some filter programs , and what i want to do is each data node(=
slave) has to execute one filter alogrithm =A0simultaneously, diffent from =
other data nodes executions.<br>
&gt;<br>
&gt; thanks in advance.<br>
&gt;<br>
&gt;<br>
<br>
</div></div></blockquote></div><br><br clear=3D"all"><br>-- <br>Bertrand De=
choux<br>

--485b397dcd5b432e1e04c8ceab58--