hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Uddipan Mukherjee <Uddipan_Mukher...@infosys.com>
Subject RE: Replication Factor Modification
Date Wed, 05 Sep 2012 18:24:03 GMT

   Thanks for the help. But How I will set the replication factor as desired so that when
new files comes in it will automatically take the new value of dfs.replication without a cluster
restart. Please note we have a 200 nodes cluster.

Thanks and Regards,
Uddipan Mukherjee

From: Harsh J [mailto:harsh@cloudera.com]
Sent: Wednesday, September 05, 2012 7:17 PM
To: user@hadoop.apache.org
Subject: Re: Replication Factor Modification

Replication factor is per-file, and is a client-side property. So, this is doable.

1. Change the replication factor of all existing files (or needed ones):

$ hadoop fs -setrep -R <value> /

2. Change the dfs.replication parameter in all client configs to the desired <value>
On Wed, Sep 5, 2012 at 11:39 PM, Uddipan Mukherjee <Uddipan_Mukherjee@infosys.com<mailto:Uddipan_Mukherjee@infosys.com>>


   We have a requirement where we have change our Hadoop Cluster's Replication Factor without
restarting the Cluster. We are running our Cluster on Amazon EMR.

Can you please suggest the way to achieve this? Any pointer to this will be very helpful.

Thanks And Regards
Uddipan Mukherjee

**************** CAUTION - Disclaimer *****************

This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely

for the use of the addressee(s). If you are not the intended recipient, please

notify the sender by e-mail and delete the original message. Further, you are not

to copy, disclose, or distribute this e-mail or its contents to any other person and

any such actions are unlawful. This e-mail may contain viruses. Infosys has taken

every reasonable precaution to minimize this risk, but is not liable for any damage

you may sustain as a result of any virus in this e-mail. You should carry out your

own virus checks before opening the e-mail or attachment. Infosys reserves the

right to monitor and review the content of all messages sent to or from this e-mail

address. Messages sent to or from this e-mail address may be stored on the

Infosys e-mail system.

***INFOSYS******** End of Disclaimer ********INFOSYS***

Harsh J

View raw message