hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Uma Maheswara Rao G 72686 <mahesw...@huawei.com>
Subject Re: Basic question on HDFS - MR
Date Tue, 18 Oct 2011 11:20:40 GMT
You did not tell about the TaskTrackers....

We need not place the job jar explicitly on any node. When the JT assigns a job to a particular
TT..all the resources required for the job are copied to the TT from HDFS.Just need to make
sure that the newly added TT is registered with the JT


----- Original Message -----
From: Stuti Awasthi <stutiawasthi@hcl.com>
Date: Tuesday, October 18, 2011 4:35 pm
Subject: Basic question on HDFS - MR
To: "hdfs-user@hadoop.apache.org" <hdfs-user@hadoop.apache.org>

> Hi,
> I have a very basic question on MR jobs. Suppose I have a cluster 
> 3 nodes out of which 1 NN and 3 DN.
> I wanted to run an MR job so I placed the jar on 1 of the cluster 
> machine and executed, it runs fine.
> Now my question is do I need to copy my MR job to every DN for 
> distributed processing?
> Or
> Placing MR jar on any of the machine does not make any difference 
> , MR job will run in distributed fashion.
> Thanks
> Stuti
> ________________________________
> -------------------------------------------------------------------
> ----------------------------------------------------
> The contents of this e-mail and any attachment(s) are confidential 
> and intended for the named recipient(s) only.
> It shall not attach any liability on the originator or HCL or its 
> affiliates. Any views or opinions presented in
> this email are solely those of the author and may not necessarily 
> reflect the opinions of HCL or its affiliates.
> Any form of reproduction, dissemination, copying, disclosure, 
> modification, distribution and / or publication of
> this message without the prior written consent of the author of 
> this e-mail is strictly prohibited. If you have
> received this email in error please delete it and notify the 
> sender immediately. Before opening any mail and
> attachments please check them for viruses and defect.
> -------------------------------------------------------------------
> ----------------------------------------------------

View raw message