storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stig Rohde Døssing <stigdoess...@gmail.com>
Subject Re: pacemaker question
Date Fri, 23 Aug 2019 13:32:34 GMT
As far as I know you can't use Storm without Zookeeper. Pacemaker is just
for receiving heartbeats, Storm still needs to store other information in
Zookeeper, e.g. which topologies are deployed.

Den fre. 23. aug. 2019 kl. 10.57 skrev Igor A. <igor.fraa@gmail.com>:

> Ethan,
>
> >Pacemaker is an additional daemon that takes some load from Zookeeper so
> it will not be overloaded, which means Zookeeper is still required.
>
> could you please confirm that Zookeeper is required in any Storm
> configuration?
>
> On Thu, Aug 22, 2019, 19:06 Ethan Li <ethanopensource@gmail.com> wrote:
>
>> Hi Ignor,
>>
>> If you are running 2.0.0 or higher version of topology on 2.x Storm
>> cluster, thanks to the changes of
>> https://issues.apache.org/jira/browse/STORM-2693,
>> https://github.com/apache/storm/pull/2433, Pacemaker is no longer
>> needed. It won’t do anything.
>>
>>
>> If you are running older version of topology on 2.x Storm cluster,
>>  Pacemaker is an additional daemon that takes some load from Zookeeper so
>> it will not be overloaded, which means Zookeeper is still required.
>> https://github.com/apache/storm/blob/master/docs/Pacemaker.md. So you
>> will see supervisors connecting to zookeeper.
>>
>> storm.zookeeper.port is used to connect to zookeeper so you want to set
>> it as your zookeeper port, default to 2181.
>> https://github.com/apache/storm/blob/master/storm-client/src/jvm/org/apache/storm/Config.java#L1067
>>
>>
>> Thanks
>> Ethan
>>
>>
>> On Aug 22, 2019, at 10:24 AM, Igor A. <igor.fraa@gmail.com> wrote:
>>
>> Hello all,
>>
>> I'm trying to run Storm version 2.0.0 with Pacemaker.
>> I've set up everything like it is described in documentation (there is
>> not so much parameters to miss something). Pacemaker is listening on
>> default :6699.
>> The issue is despite the fact storm.cluster.state.store is set to
>> "[...].PaceMakerStateStorageFactory", Storm Supervisor tries to connect to
>> Zookeeper on :2181.
>>
>> I can see in logs that Storm launched Zookeeper client and it runs in 3.4
>> compatibility mode.
>> I tried to set storm.zookeeper.port to 6699, but this caused Pacemaker to
>> die with an NPE. Note: after reading sources i've found that
>> PacemakerClient doesn't use zookeeper.port
>> Does anyone know how to make Storm communicate with Pacemaker? May be
>> somebody have a working storm.yaml to enable Pacemake Client?
>>
>>
>>
>>
>>

Mime
View raw message