Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 379FA6DA2 for ; Wed, 18 May 2011 15:37:48 +0000 (UTC) Received: (qmail 23418 invoked by uid 500); 18 May 2011 15:37:47 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 23301 invoked by uid 500); 18 May 2011 15:37:47 -0000 Mailing-List: contact mapreduce-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-user@hadoop.apache.org Delivered-To: mailing list mapreduce-user@hadoop.apache.org Received: (qmail 23293 invoked by uid 99); 18 May 2011 15:37:47 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 18 May 2011 15:37:47 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,RFC_ABUSE_POST,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of geoffry.roberts@gmail.com designates 209.85.160.176 as permitted sender) Received: from [209.85.160.176] (HELO mail-gy0-f176.google.com) (209.85.160.176) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 18 May 2011 15:37:42 +0000 Received: by gya6 with SMTP id 6so830292gya.35 for ; Wed, 18 May 2011 08:37:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=M8yX1kvNl54fh89LxwzANUv3JQFMq2LP72ujFmJtbn0=; b=FnIt2GxAizRESayM6c5PFdhHVEwNxEWcCwbksvALtKVhVwtIjVB/KthHP7riF3vZ9y n9b+A3q+Wd1YNyW92fyk8nxzp9/HsxyrFE0hrEzBm5iPE78U7zyDnYYtK2QQGaSb8aT3 fS6y0kQRX5VViHpEP92aXwg1Uby4l2dNWhX3Q= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=owxuzbmQll5yca7IdWgRMBbJQVq4PoNO5l8d5nNSvdDIZmk8qL5+BGOQ2QQZicBBzn MzlCt5p88CQb8DN6htY2vMVqX3g+1/CsYknJ2lokVAJfgTZzceO7PN2vz67r+2MOl6Yg jjyojLmnNe7jpi5wBfXCmZuEd+fjQu5UHvKH4= MIME-Version: 1.0 Received: by 10.90.248.6 with SMTP id v6mr1591640agh.143.1305733041568; Wed, 18 May 2011 08:37:21 -0700 (PDT) Received: by 10.90.87.3 with HTTP; Wed, 18 May 2011 08:37:21 -0700 (PDT) In-Reply-To: References: Date: Wed, 18 May 2011 08:37:21 -0700 Message-ID: Subject: Re: Running M/R jobs from java code From: Geoffry Roberts To: mapreduce-user@hadoop.apache.org Content-Type: multipart/alternative; boundary=0016363b880c1d3f5f04a38eaa2f --0016363b880c1d3f5f04a38eaa2f Content-Type: text/plain; charset=ISO-8859-1 I am confronted with the same problem. What I plan to do is to have a servlet simply execute a command on the machine from where I would start the job if I were running it from the command line. e.g. $ ssh '/bin/hadoop jar myjob.jar' Another possibility would be to rig some kind of RMI thing. Now here's an idea: Use an aglet. ;-) If I get into a funky mood I might just give this a try. On 18 May 2011 08:07, Lior Schachter wrote: > Another machine in the cluster. > > > On Wed, May 18, 2011 at 6:05 PM, Geoffry Roberts < > geoffry.roberts@gmail.com> wrote: > >> Is Tomcat installed on your hadoop name node? or another machine? >> >> >> On 18 May 2011 07:58, Lior Schachter wrote: >> >>> Hi, >>> I have my application installed on Tomcat and I wish to submit M/R jobs >>> programmatically. >>> Is there any standard way to do that ? >>> >>> Thanks, >>> Lior >>> >> >> >> >> -- >> Geoffry Roberts >> >> > -- Geoffry Roberts --0016363b880c1d3f5f04a38eaa2f Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable I am confronted with the same problem.=A0 What I plan to do is to have a se= rvlet simply execute a command on the machine from where I would start the = job if I were running it from the command line.

e.g.
$ ssh <re= mote host> '<hadoop_home>/bin/hadoop jar myjob.jar'

Another possibility would be to rig some kind of RMI thing.

Now = here's an idea:=A0 Use an aglet. ;-)=A0 If I get into a funky mood I mi= ght just give this a try.

On 18 May 2011 = 08:07, Lior Schachter <liors@infolinks.com> wrote:
= Another machine in the cluster.


On Wed, May 18, 2011 at 6:05 PM, Geoffry Roberts <geoffry.roberts@= gmail.com> wrote:
Is Tomcat install= ed on your hadoop name node? or another machine?

On 18 May 2011 07:58, Lior Schachter <liors@infolinks.com>= wrote:
= Hi,
I have my application installed on Tomcat and I wish to submit M/R j= obs programmatically.
Is there any standard way to do that ?

Thanks,
Lior



--
Geoffry Roberts





--
Geoffry Roberts

--0016363b880c1d3f5f04a38eaa2f--