hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From 杨浩 <yangha...@gmail.com>
Subject Re: execute job in a remote jobtracker in YARN?
Date Sun, 15 Feb 2015 01:58:23 GMT
Do you mean you want to execute a job in the remote cluster which don't
contain you node?
If you copy the configure of RM to your own computer, and this computer
will be taken as the hadoop client. Then you can execute the job through
'hadoop jar', the job will be executed on remote cluster

2015-02-14 6:48 GMT+08:00 Ravi Prakash <ravihoo@ymail.com>:

> Hi!
>
> There is no "JobTracker" in YARN. There is an ApplicationMaster. And there
> is a ResourceManager. Which do you mean?
>
> You can use the ResourceManager REST API to submit new applications
>
> http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html#Cluster_Applications_APISubmit_Application
>
> Another option (and a rather convoluted one at that) is to create an MR
> job which retrieves the job jar and conf and parameters from a common
> source (FTP server e.g.) and launches a new job. This is something similar
> to what Oozie does. However its unlikely that you need to do the same thing.
>
> HTH
> Ravi
>
>
>   On Friday, February 13, 2015 10:20 AM, xeonmailinglist <
> xeonmailinglist@gmail.com> wrote:
>
>
> Hi,
>
> I want to execute a job remotely. So, I was thinking in serialize the
> org.apache.hadoop.mapreduce.Job class and send it to a remote component
> that I create that launches the job there, or find a way to transform
> the Job class into a configuration file that my remote component will
> execute the job.
>
>
> Is it possible to execute a Job in a remote jobtracker in YARN? If so,
> what is the best way to do it?
>
> Thanks,
>
>
>

Mime
View raw message