hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jun Ping Du <...@vmware.com>
Subject Re: Multidata center support
Date Sat, 31 Aug 2013 02:22:06 GMT
Although you can set datacenter layer on your network topology, it is never enabled in hadoop
as lacking of replica placement and task scheduling support. There are some work to add layers
other than rack and node under HADOOP-8848 but may not suit for your case. Agree with Adam
that a cluster spanning multiple data centers seems not make sense even for DR case. Do you
have other cases to do such a deployment? 



----- Original Message -----

From: "Adam Muise" <amuise@hortonworks.com> 
To: user@hadoop.apache.org 
Sent: Friday, August 30, 2013 6:26:54 PM 
Subject: Re: Multidata center support 

Nothing has changed. DR best practice is still one (or more) clusters per site and replication
is handled via distributed copy or some variation of it. A cluster spanning multiple data
centers is a poor idea right now. 

On Fri, Aug 30, 2013 at 12:35 AM, Rahul Bhattacharjee < rahul.rec.dgp@gmail.com > wrote:

My take on this. 

Why hadoop has to know about data center thing. I think it can be installed across multiple
data centers , however topology configuration would be required to tell which node belongs
to which data center and switch for block placement. 


On Fri, Aug 30, 2013 at 12:42 AM, Baskar Duraikannu < baskar.duraikannu@outlook.com >


We have a need to setup hadoop across data centers. Does hadoop support multi data center
configuration? I searched through archives and have found that hadoop did not support multi
data center configuration some time back. Just wanted to see whether situation has changed.

Please help. 



Adam Muise 
Solution Engineer 

Hortonworks - Develops, Distributes and Supports Enterprise Apache Hadoop. 

Hortonworks Virtual Sandbox 

Hadoop: Disruptive Possibilities by Jeff Needham 

NOTICE: This message is intended for the use of the individual or entity to which it is addressed
and may contain information that is confidential, privileged and exempt from disclosure under
applicable law. If the reader of this message is not the intended recipient, you are hereby
notified that any printing, copying, dissemination, distribution, disclosure or forwarding
of this communication is strictly prohibited. If you have received this communication in error,
please contact the sender immediately and delete it from your system. Thank You. 

View raw message