hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alexander Pivovarov <apivova...@gmail.com>
Subject Re: High Availability hadoop cluster.
Date Thu, 06 Nov 2014 17:38:32 GMT
For 17 box cluster it's probably good to run 5 ZKs and 5 JNs

So, run 2 ZKs on 2 NNs
3 ZKs on 3 DNs

same for JNs

you can start additional ZKs and JNs after you are done with initial
Enabling HA in Ambari




On Thu, Nov 6, 2014 at 3:01 AM, Oleg Ruchovets <oruchovets@gmail.com> wrote:

> Great.
> Thank you for the link.
> Just to be sure - JN can be installed on data nodes like zookeeper?
> If we have 2 Name Nodes and 15 Data Nodes - is it correct  to install ZK
> and JN on datanodes machines?
> Thanks
> Oleg.
>
>
> On Thu, Nov 6, 2014 at 5:06 PM, Alexander Pivovarov <apivovarov@gmail.com>
> wrote:
>
>> To Enable HA open Ambari, go to Admin, select HA, click enable HA
>>
>>
>> http://dev.hortonworks.com.s3.amazonaws.com/HDPDocuments/HDP2/HDP-2.0.9.0/bk_using_Ambari_book/content/install-ha_2x.html
>>
>> On Thu, Nov 6, 2014 at 12:45 AM, Oleg Ruchovets <oruchovets@gmail.com>
>> wrote:
>>
>>> Our deployment is 15 data nodes and 2 NN. ZKs installed also as part of
>>> hortonworks distributions.
>>> Sorry for dummy question - what is JN is?
>>> Can you please please point me on some manual wiki for installation /
>>> configuration.
>>>
>>> Thanks
>>> Oleg.
>>>
>>>
>>> On Thu, Nov 6, 2014 at 4:04 PM, Alexander Pivovarov <
>>> apivovarov@gmail.com> wrote:
>>>
>>>> 2 boxes for 2 NNs  (better dedicated boxes)
>>>> min 3 JNs
>>>> min 3 ZKs
>>>>
>>>> JNs and ZKs can share boxes with other services
>>>>
>>>>
>>>> On Wed, Nov 5, 2014 at 11:31 PM, Oleg Ruchovets <oruchovets@gmail.com>
>>>> wrote:
>>>>
>>>>> Hello.
>>>>> We are using hortonwork distribution and want to evaluate HA
>>>>> capabilities.
>>>>> Can community please share the best practices and potential problems?
>>>>> Is it required additional hardware?
>>>>>
>>>>> Thanks
>>>>> Oleg.
>>>>>
>>>>
>>>>
>>>
>>
>

Mime
View raw message