hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Devaraj K <devara...@huawei.com>
Subject RE: Basic question on HDFS - MR
Date Tue, 18 Oct 2011 11:24:09 GMT


            No need to copy the job jar file to every machine in the
cluster. You can copy the jar file to the job tracker and execute it using
the 'jar' command. If you want to submit the job from the other
system/application, you can use the Job.submit() API to submit the job. Job
tracker will make use of the cluster to complete it.


Devaraj K 

This e-mail and its attachments contain confidential information from
HUAWEI, which 
is intended only for the person or entity whose address is listed above. Any
use of the 
information contained herein in any way (including, but not limited to,
total or partial 
disclosure, reproduction, or dissemination) by persons other than the
recipient(s) is prohibited. If you receive this e-mail in error, please
notify the sender by 
phone or email immediately and delete it!ss



From: Stuti Awasthi [mailto:stutiawasthi@hcl.com] 
Sent: Tuesday, October 18, 2011 4:33 PM
To: hdfs-user@hadoop.apache.org
Subject: Basic question on HDFS - MR



I have a very basic question on MR jobs. Suppose I have a cluster 3 nodes
out of which 1 NN and 3 DN.

I wanted to run an MR job so I placed the jar on 1 of the cluster machine
and executed, it runs fine.

Now my question is do I need to copy my MR job to every DN for distributed


Placing MR jar on any of the machine does not make any difference , MR job
will run in distributed fashion.







The contents of this e-mail and any attachment(s) are confidential and
intended for the named recipient(s) only.
It shall not attach any liability on the originator or HCL or its
affiliates. Any views or opinions presented in
this email are solely those of the author and may not necessarily reflect
the opinions of HCL or its affiliates.
Any form of reproduction, dissemination, copying, disclosure, modification,
distribution and / or publication of
this message without the prior written consent of the author of this e-mail
is strictly prohibited. If you have
received this email in error please delete it and notify the sender
immediately. Before opening any mail and
attachments please check them for viruses and defect.


View raw message