hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Uma Maheswara Rao G 72686 <mahesw...@huawei.com>
Subject Re: Basic question on HDFS - MR
Date Tue, 18 Oct 2011 11:20:40 GMT
You did not tell about the TaskTrackers....

We need not place the job jar explicitly on any node. When the JT assigns a job to a particular
TT..all the resources required for the job are copied to the TT from HDFS.Just need to make
sure that the newly added TT is registered with the JT


regards,
Uma

----- Original Message -----
From: Stuti Awasthi <stutiawasthi@hcl.com>
Date: Tuesday, October 18, 2011 4:35 pm
Subject: Basic question on HDFS - MR
To: "hdfs-user@hadoop.apache.org" <hdfs-user@hadoop.apache.org>

> Hi,
> I have a very basic question on MR jobs. Suppose I have a cluster 
> 3 nodes out of which 1 NN and 3 DN.
> I wanted to run an MR job so I placed the jar on 1 of the cluster 
> machine and executed, it runs fine.
> Now my question is do I need to copy my MR job to every DN for 
> distributed processing?
> Or
> Placing MR jar on any of the machine does not make any difference 
> , MR job will run in distributed fashion.
> 
> Thanks
> Stuti
> 
> ________________________________
> ::DISCLAIMER::
> -------------------------------------------------------------------
> ----------------------------------------------------
> 
> The contents of this e-mail and any attachment(s) are confidential 
> and intended for the named recipient(s) only.
> It shall not attach any liability on the originator or HCL or its 
> affiliates. Any views or opinions presented in
> this email are solely those of the author and may not necessarily 
> reflect the opinions of HCL or its affiliates.
> Any form of reproduction, dissemination, copying, disclosure, 
> modification, distribution and / or publication of
> this message without the prior written consent of the author of 
> this e-mail is strictly prohibited. If you have
> received this email in error please delete it and notify the 
> sender immediately. Before opening any mail and
> attachments please check them for viruses and defect.
> 
> -------------------------------------------------------------------
> ----------------------------------------------------
> 

Mime
View raw message