Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 0610DD992 for ; Mon, 3 Sep 2012 16:26:21 +0000 (UTC) Received: (qmail 34869 invoked by uid 500); 3 Sep 2012 16:26:16 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 34788 invoked by uid 500); 3 Sep 2012 16:26:16 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 34781 invoked by uid 99); 3 Sep 2012 16:26:16 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Sep 2012 16:26:16 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of michael_segel@hotmail.com designates 65.55.111.109 as permitted sender) Received: from [65.55.111.109] (HELO blu0-omc2-s34.blu0.hotmail.com) (65.55.111.109) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Sep 2012 16:26:07 +0000 Received: from BLU0-SMTP115 ([65.55.111.73]) by blu0-omc2-s34.blu0.hotmail.com with Microsoft SMTPSVC(6.0.3790.4675); Mon, 3 Sep 2012 09:25:47 -0700 X-Originating-IP: [173.15.87.37] X-EIP: [2FiL3/iLypt6kYMgafETka+a4sGfi6ti] X-Originating-Email: [michael_segel@hotmail.com] Message-ID: Received: from [192.168.0.104] ([173.15.87.37]) by BLU0-SMTP115.blu0.hotmail.com over TLS secured channel with Microsoft SMTPSVC(6.0.3790.4675); Mon, 3 Sep 2012 09:25:45 -0700 Content-Type: text/plain; charset="iso-8859-1" MIME-Version: 1.0 (Mac OS X Mail 6.0 \(1486\)) Subject: Re: how to execute different tasks on data nodes(simultaneously in hadoop). From: Michael Segel In-Reply-To: Date: Mon, 3 Sep 2012 11:25:43 -0500 Content-Transfer-Encoding: quoted-printable References: To: user@hadoop.apache.org X-Mailer: Apple Mail (2.1486) X-OriginalArrivalTime: 03 Sep 2012 16:25:45.0385 (UTC) FILETIME=[C4FF8990:01CD89F0] X-Virus-Checked: Checked by ClamAV on apache.org Not sure what you are trying to do... You want to pass through the entire data set on all nodes where each = node runs a single filter?=20 You're thinking is orthogonal to how Hadoop works.=20 You would be better off letting each node work on a portion of the data = which is local to that node running the entire filter set.=20 On Sep 3, 2012, at 11:19 AM, mallik arjun = wrote: > genrally in hadoop map function will be exeucted by all the data nodes = on the input data set ,against this how can i do the following. > i have some filter programs , and what i want to do is each data = node(slave) has to execute one filter alogrithm simultaneously, diffent = from other data nodes executions. >=20 > thanks in advance. >=20 >=20