Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-dev@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of msegel@navteq.com designates
 204.120.70.37 as permitted sender)
From: "Segel, Mike" <msegel@navteq.com>
To: "common-dev@hadoop.apache.org" <common-dev@hadoop.apache.org>
Date: Wed, 28 Jul 2010 09:10:47 -0500
Subject: RE: Starting a job on a hadoop cluster remotly
Thread-Topic: Starting a job on a hadoop cluster remotly
Thread-Index: AcsuUCFkIqbk+BR6TxeXuhuDAuVO1QADXIHA
Message-ID: 
 <ABC24175AFD3BE4DA15F4CD375ED413D0614B45B58@hq-ex-mb02.ad.navteq.com>
References: <1EDC794577E2394E9D3D74DFD4D41C210166498C@Mail05.o4b.fn>
In-Reply-To: <1EDC794577E2394E9D3D74DFD4D41C210166498C@Mail05.o4b.fn>
Accept-Language: en-US
Content-Language: en-US
acceptlanguage: en-US
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0

Hi,

Since you didn't get an answer... yes you can.

I'm working from memory so I may be a bit fuzzy on the details...

Your external app has to be 'cloud aware'. Essentially create a config fi=
le for your application that you can read in which lets your app know whe=
re the JT and NN are.

Then you can use the Tool (?interface/class) implement/extend with your j=
ob class and tell it to run...

Sorry for being terse... I'm under the gun on getting something out the d=
oor.

HTH

-Mike


-----Original Message-----
From: Sebastian Ruff (open4business GmbH) [mailto:ruff@open4business.de]=20
Sent: Wednesday, July 28, 2010 7:27 AM
To: common-dev@hadoop.apache.org
Subject: Starting a job on a hadoop cluster remotly

Hey,

=20

is it possible to start a job on a hadoop cluster from remote. For
example we have a web application

which runs on an apache tomcat server. And would like to start a
mapreduce job on our cluster, from

within the webapp.

=20

Is this possible? And if yes, what are the steps to get there? Do I just
have to put my namenode and datanode

in a core-site.xml in the webapp and call the api?

=20

Thanks a lot,

=20

Sebastian


The information contained in this communication may be CONFIDENTIAL and i=
s intended only for the use of the recipient(s) named above.  If you are =
not the intended recipient, you are hereby notified that any disseminatio=
n, distribution, or copying of this communication, or any of its contents=
, is strictly prohibited.  If you have received this communication in err=
or, please notify the sender and delete/destroy the original message and =
any copy of it from your computer or paper files.