Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D58951069B for ; Sun, 15 Feb 2015 10:57:23 +0000 (UTC) Received: (qmail 40827 invoked by uid 500); 15 Feb 2015 10:46:57 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 29645 invoked by uid 500); 15 Feb 2015 10:46:50 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 82537 invoked by uid 99); 15 Feb 2015 01:58:50 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 15 Feb 2015 01:58:50 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of yanghaogn@gmail.com designates 209.85.216.52 as permitted sender) Received: from [209.85.216.52] (HELO mail-qa0-f52.google.com) (209.85.216.52) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 15 Feb 2015 01:58:25 +0000 Received: by mail-qa0-f52.google.com with SMTP id v10so17726282qac.11 for ; Sat, 14 Feb 2015 17:58:24 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=diGfSEjnJND4w8WLrfnKLbWaoFaGcz+dqdjGmZzNqsc=; b=bZ/KiloYhTSwY/IDoLiL6cpQPJHhsAk0G2NL6ajSqbMdXZYRCoWZlQOeQjaYJc/vH6 Yxy4r+8LCQxGjgvKTqvnD6LmsjPEUkAeJt3HvFeg3nMk138CosvMlE+qwoyvisMuSPwd kNZcoKBB1840sIhaZQ8PWddxcxVlHdtLakRULQjF8h08rhvTee+OR8eiGd19BpNqpM27 DMK4LCyQQntpNkRaTIoo63YNgU0GaK/l2NZbeWmdWQGtBdPj0UXKBRqQSDBI/4fka2JL kx0NHfPcBTBBhOWmW7qV6sZzJ1IKU1ymHbSuHJ7iy3gMIjlZ4YImJFaqlFmrbB8MlNgT DZxQ== MIME-Version: 1.0 X-Received: by 10.140.237.6 with SMTP id i6mr13367755qhc.32.1423965504024; Sat, 14 Feb 2015 17:58:24 -0800 (PST) Received: by 10.96.209.78 with HTTP; Sat, 14 Feb 2015 17:58:23 -0800 (PST) In-Reply-To: <1969353470.4565098.1423867722221.JavaMail.yahoo@mail.yahoo.com> References: <54DE4035.3060207@gmail.com> <1969353470.4565098.1423867722221.JavaMail.yahoo@mail.yahoo.com> Date: Sun, 15 Feb 2015 09:58:23 +0800 Message-ID: Subject: Re: execute job in a remote jobtracker in YARN? From: =?UTF-8?B?5p2o5rWp?= To: user@hadoop.apache.org, Ravi Prakash Content-Type: multipart/alternative; boundary=001a11359c700a36bc050f16cef0 X-Virus-Checked: Checked by ClamAV on apache.org --001a11359c700a36bc050f16cef0 Content-Type: text/plain; charset=UTF-8 Do you mean you want to execute a job in the remote cluster which don't contain you node? If you copy the configure of RM to your own computer, and this computer will be taken as the hadoop client. Then you can execute the job through 'hadoop jar', the job will be executed on remote cluster 2015-02-14 6:48 GMT+08:00 Ravi Prakash : > Hi! > > There is no "JobTracker" in YARN. There is an ApplicationMaster. And there > is a ResourceManager. Which do you mean? > > You can use the ResourceManager REST API to submit new applications > > http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html#Cluster_Applications_APISubmit_Application > > Another option (and a rather convoluted one at that) is to create an MR > job which retrieves the job jar and conf and parameters from a common > source (FTP server e.g.) and launches a new job. This is something similar > to what Oozie does. However its unlikely that you need to do the same thing. > > HTH > Ravi > > > On Friday, February 13, 2015 10:20 AM, xeonmailinglist < > xeonmailinglist@gmail.com> wrote: > > > Hi, > > I want to execute a job remotely. So, I was thinking in serialize the > org.apache.hadoop.mapreduce.Job class and send it to a remote component > that I create that launches the job there, or find a way to transform > the Job class into a configuration file that my remote component will > execute the job. > > > Is it possible to execute a Job in a remote jobtracker in YARN? If so, > what is the best way to do it? > > Thanks, > > > --001a11359c700a36bc050f16cef0 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Do you mean you want to execute a job in the remote c= luster which don't contain you node?
If you copy the configure of = RM to your own computer, and this computer will be taken as the hadoop clie= nt. Then you can execute the job through 'hadoop jar', the job will= be executed on remote cluster

2015-02-14 6:48 GMT+08:00 Ravi Prakash <ravihoo@ymail.c= om>:
Hi!

There is no "JobTracker" in YARN. There is an ApplicationMaster. = And there is a ResourceManager. Which do you mean?

You can use the ResourceManager REST API to submit new applications
http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yar= n-site/ResourceManagerRest.html#Cluster_Applications_APISubmit_Application<= /a>

Another option (and a rather convoluted one at that) is to create an MR=20 job which retrieves the job jar and conf and parameters from a common=20 source (FTP server e.g.) and launches a new job. This is something=20 similar to what Oozie does. However its unlikely that you need to do the same thing.

HTH
Ravi

=


=
Hi,

I want to execute a job remotely. So, I was thinking in ser= ialize the
org.apache.hadoop.mapreduce.Job class and send it to a remot= e component
that I create that launches the job there, or find a way to= transform
the Job class into a configuration file that my remote compo= nent will
execute the job.


Is it possible to execute a Job i= n a remote jobtracker in YARN? If so,
what is the best way to do it?
Thanks,



--001a11359c700a36bc050f16cef0--