hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Visioner Sadak <visioner.sa...@gmail.com>
Subject Re: Multidata center support
Date Sat, 31 Aug 2013 13:30:56 GMT
lets say that

you have some machines in europe and some  in US I think you just need the
ips and configure them in your cluster set up
it will work...


On Sat, Aug 31, 2013 at 7:52 AM, Jun Ping Du <jdu@vmware.com> wrote:

> Hi,
>     Although you can set datacenter layer on your network topology, it is
> never enabled in hadoop as lacking of replica placement and task scheduling
> support. There are some work to add layers other than rack and node under
> HADOOP-8848 but may not suit for your case. Agree with Adam that a cluster
> spanning multiple data centers seems not make sense even for DR case. Do
> you have other cases to do such a deployment?
>
> Thanks,
>
> Junping
>
> ------------------------------
> *From: *"Adam Muise" <amuise@hortonworks.com>
> *To: *user@hadoop.apache.org
> *Sent: *Friday, August 30, 2013 6:26:54 PM
> *Subject: *Re: Multidata center support
>
>
> Nothing has changed. DR best practice is still one (or more) clusters per
> site and replication is handled via distributed copy or some variation of
> it. A cluster spanning multiple data centers is a poor idea right now.
>
>
>
>
> On Fri, Aug 30, 2013 at 12:35 AM, Rahul Bhattacharjee <
> rahul.rec.dgp@gmail.com> wrote:
>
>> My take on this.
>>
>> Why hadoop has to know about data center thing. I think it can be
>> installed across multiple data centers , however topology configuration
>> would be required to tell which node belongs to which data center and
>> switch for block placement.
>>
>> Thanks,
>> Rahul
>>
>>
>> On Fri, Aug 30, 2013 at 12:42 AM, Baskar Duraikannu <
>> baskar.duraikannu@outlook.com> wrote:
>>
>>> We have a need to setup hadoop across data centers.  Does hadoop support
>>> multi data center configuration? I searched through archives and have found
>>> that hadoop did not support multi data center configuration some time back.
>>> Just wanted to see whether situation has changed.
>>>
>>> Please help.
>>>
>>
>>
>
>
> --
> *
> *
> *
> *
> *Adam Muise*
> Solution Engineer
> *Hortonworks*
> amuise@hortonworks.com
> 416-417-4037
>
> Hortonworks - Develops, Distributes and Supports Enterprise Apache Hadoop.<http://hortonworks.com/>
>
> Hortonworks Virtual Sandbox <http://hortonworks.com/sandbox>
>
> Hadoop: Disruptive Possibilities by Jeff Needham<http://hortonworks.com/resources/?did=72&cat=1>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
>

Mime
View raw message