helix-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Erwin Karbasi <er...@optinity.com>
Subject Re: Is zookeeper for Helix has standalone JAVA process?
Date Fri, 14 Jun 2013 11:35:22 GMT
If I have 40 app server instances (JVMs) could I run participants on all of
them, controller and zookeeper just on 5 of then, but on the same process
of the 5 participants?
On Jun 14, 2013 2:29 PM, "Ming Fang" <mingfang@mac.com> wrote:

> ZAC currently runs Zookeeper in standalone mode.
> Therefore you can only run one instance.
> If you also run the participant in it then that limits you to one instance
> of the participant also.
>
>
> Sent from my iPad
>
> On Jun 14, 2013, at 7:23 AM, Erwin Karbasi <erwin@optinity.com> wrote:
>
> Hi Ming,
>
> Thank you for fast turnaround response.
>
> Could I run my app that uses Helix (participant), controller and zookeeper
> on the same process?
>
> Cheers,
> Erwin
> On Jun 14, 2013 2:16 PM, "Ming Fang" <mingfang@mac.com> wrote:
>
>> Erwin
>>
>> Here is an example of running Zookeeper, and Controller in the same
>> process,
>>
>> https://github.com/mingfang/apache-helix/blob/master/helix-example/src/main/java/org/apache/helix/examples/ZAC.java
>> We have this in production.
>>
>> Sent from my iPad
>>
>> On Jun 14, 2013, at 3:34 AM, Erwin Karbasi <erwin@optinity.com> wrote:
>>
>> I know that it's better that participants, controller and zookeeper will
>> have separate java processes but we have more then 40 boxes with app server
>> that we'd like to manage them with Helix Leader election and cannot add
>> more processes because each additional java process requires management
>> (monitoring, alarms, KPI, etc...), so we prefer to avoid the additional
>> java processes. We'll not manage to approve additional processes
>>
>> Your insight would appreciated.
>>
>> Thanks,
>> Erwin
>> On Jun 14, 2013 9:58 AM, "kishore g" <g.kishore@gmail.com> wrote:
>>
>>> Hi Erwin,
>>>
>>> This is how I would setup your cluster. Allocate 3 boxes that only run
>>> zookeeper and Helix controller. Its better that they are two separate
>>> process. These boxes need not be powerful but isolating zookeeper and helix
>>> controller from actual server is a good deployment practice. See
>>> http://zookeeper.apache.org/doc/trunk/zookeeperAdmin.html#sc_zkMulitServerSetupon
how to use zookeeper clustering ensemble.
>>>
>>>
>>> Run the real servers on the rest of the boxes. Do not start zookeeper as
>>> part of these processes, instead simply provide the zookeeper address
>>> (zk1:port1,zk2:port2,zk3:port3) when you invoke Helix Api.
>>>
>>>
>>> Thanks,
>>> Kishore G
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> On Thu, Jun 13, 2013 at 10:05 PM, Erwin Karbasi <erwin@optinity.com>wrote:
>>>
>>>> Hi Kishore,
>>>>
>>>> We have  more then 50 nodes.
>>>>
>>>> Cheers,
>>>> Erwin
>>>> On Jun 14, 2013 1:51 AM, "kishore g" <g.kishore@gmail.com> wrote:
>>>>
>>>>> Hi Erwin,
>>>>>
>>>>> How many nodes do you have in your cluster ?
>>>>>
>>>>> thanks,
>>>>> Kishore G
>>>>>
>>>>>
>>>>> On Thu, Jun 13, 2013 at 1:43 PM, Erwin Karbasi <erwin@optinity.com>wrote:
>>>>>
>>>>>> Hello Maters,
>>>>>>
>>>>>> We don't want to have separate/specific JAVA process for Zookeeper.
>>>>>> As I figured out from the Master-Slave sample we can start the
>>>>>> Zookeeper programmatically using the Zookeeper API.
>>>>>>
>>>>>> I have several questions:
>>>>>>
>>>>>> 1. If we are using the Zookeeper API for initializing the Zookeeper
>>>>>> from the Helix app (out app that uses Helix) would we have specific
process
>>>>>> for Zookeeper? Would we have one process for our app and another
for the
>>>>>> Zookeeper?
>>>>>> What happens if we'll not initialize the Zookeeper from the Helix
app
>>>>>> programmatically but using the commands, whether then would we have
>>>>>> specific process for Zookeeper?
>>>>>>
>>>>>> 2. If we'll decide to initialize Zookeeper from Helix app,
>>>>>> programmatically, How can we use Zookeeper clustering (ensemble)
, is there
>>>>>> any API for Zookeeper clustering, any direction would highly appreciated.
>>>>>>
>>>>>> 3. Is it possible to start the Zookeeper by using commands and not
>>>>>> initializing specific process for it but using the Helix app (our
app that
>>>>>> uses Helix API)?
>>>>>>
>>>>>> I hope my questions are enough clear.
>>>>>>
>>>>>> Thanks in advance,
>>>>>> Erwin Karbasi
>>>>>> AT&T, Senior Software Architect
>>>>>>
>>>>>
>>>>>
>>>

Mime
View raw message