hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Visioner Sadak <visioner.sa...@gmail.com>
Subject Re: Multidata center support
Date Sat, 31 Aug 2013 18:50:04 GMT
What do you think friends I think hadoop clusters can run on multiple data
centers using FEDERATION


On Sat, Aug 31, 2013 at 8:39 PM, Visioner Sadak <visioner.sadak@gmail.com>wrote:

> The only problem i guess hadoop wont be able to duplicate data from one
> data center to another but i guess i can identify data nodes or namenodes
> from another data center correct me if i am wrong
>
>
> On Sat, Aug 31, 2013 at 7:00 PM, Visioner Sadak <visioner.sadak@gmail.com>wrote:
>
>> lets say that
>>
>> you have some machines in europe and some  in US I think you just need
>> the ips and configure them in your cluster set up
>> it will work...
>>
>>
>> On Sat, Aug 31, 2013 at 7:52 AM, Jun Ping Du <jdu@vmware.com> wrote:
>>
>>> Hi,
>>>     Although you can set datacenter layer on your network topology, it
>>> is never enabled in hadoop as lacking of replica placement and task
>>> scheduling support. There are some work to add layers other than rack and
>>> node under HADOOP-8848 but may not suit for your case. Agree with Adam that
>>> a cluster spanning multiple data centers seems not make sense even for DR
>>> case. Do you have other cases to do such a deployment?
>>>
>>> Thanks,
>>>
>>> Junping
>>>
>>> ------------------------------
>>> *From: *"Adam Muise" <amuise@hortonworks.com>
>>> *To: *user@hadoop.apache.org
>>> *Sent: *Friday, August 30, 2013 6:26:54 PM
>>> *Subject: *Re: Multidata center support
>>>
>>>
>>> Nothing has changed. DR best practice is still one (or more) clusters
>>> per site and replication is handled via distributed copy or some variation
>>> of it. A cluster spanning multiple data centers is a poor idea right now.
>>>
>>>
>>>
>>>
>>> On Fri, Aug 30, 2013 at 12:35 AM, Rahul Bhattacharjee <
>>> rahul.rec.dgp@gmail.com> wrote:
>>>
>>>> My take on this.
>>>>
>>>> Why hadoop has to know about data center thing. I think it can be
>>>> installed across multiple data centers , however topology configuration
>>>> would be required to tell which node belongs to which data center and
>>>> switch for block placement.
>>>>
>>>> Thanks,
>>>> Rahul
>>>>
>>>>
>>>> On Fri, Aug 30, 2013 at 12:42 AM, Baskar Duraikannu <
>>>> baskar.duraikannu@outlook.com> wrote:
>>>>
>>>>> We have a need to setup hadoop across data centers.  Does hadoop
>>>>> support multi data center configuration? I searched through archives
and
>>>>> have found that hadoop did not support multi data center configuration
some
>>>>> time back. Just wanted to see whether situation has changed.
>>>>>
>>>>> Please help.
>>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> *
>>> *
>>> *
>>> *
>>> *Adam Muise*
>>> Solution Engineer
>>> *Hortonworks*
>>> amuise@hortonworks.com
>>> 416-417-4037
>>>
>>> Hortonworks - Develops, Distributes and Supports Enterprise Apache
>>> Hadoop. <http://hortonworks.com/>
>>>
>>> Hortonworks Virtual Sandbox <http://hortonworks.com/sandbox>
>>>
>>> Hadoop: Disruptive Possibilities by Jeff Needham<http://hortonworks.com/resources/?did=72&cat=1>
>>>
>>> CONFIDENTIALITY NOTICE
>>> NOTICE: This message is intended for the use of the individual or entity
>>> to which it is addressed and may contain information that is confidential,
>>> privileged and exempt from disclosure under applicable law. If the reader
>>> of this message is not the intended recipient, you are hereby notified that
>>> any printing, copying, dissemination, distribution, disclosure or
>>> forwarding of this communication is strictly prohibited. If you have
>>> received this communication in error, please contact the sender immediately
>>> and delete it from your system. Thank You.
>>>
>>>
>>
>

Mime
View raw message