hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Natarajan, Senthil" <sent...@pitt.edu>
Subject RE: Remote Job Submission
Date Fri, 23 May 2008 21:10:57 GMT
The client machine doesn't have Hadoop installed and it is not a slave machine.
>From the client machine data and task nodes are not seen.

In this scenario how to load data to HDFS and submit the MapReduce job from client.
Is it possible?

If not what minimal things need to be setup so that the data and jobs can be submitted remotely
from the client machine.


-----Original Message-----
From: Ted Dunning [mailto:tdunning@veoh.com]
Sent: Friday, May 23, 2008 4:52 PM
To: core-user@hadoop.apache.org; 'hadoop-user@lucene.apache.org'
Subject: Re: Remote Job Submission

Both are possible.  You may have to have access to the data and task nodes
for some operations.  If you can see all of the nodes in your cluster, you
should be able to do everything.

On 5/23/08 1:46 PM, "Natarajan, Senthil" <senthil@pitt.edu> wrote:

> Hi,
> I was wondering is it possible to submit MapReduce job on remote Hadoop
> cluster.
> (i.e) Submitting the job from the machine which doesn't have Hadoop installed
> and submitting to different machine where Hadoop installed.
> Is it possible to do this?
> I guess at least data can be uploaded to HDFS through java program remotely
> right?
> Thanks,
> Senthil

View raw message