zookeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Flavio Junqueira <...@apache.org>
Subject Re: Is it a accepted practice to share Zookeeper ensemble among Kafka, Storm and Solr
Date Wed, 30 Mar 2016 06:08:27 GMT
Sharing is definitely ok, and I'd say that is common practice, but it really depends on the
size of the cluster you're talking about and your workload. Storm can be quite demanding on
ZK, and Kafka typically isn't except during fail-over. I don't have experience with the workload
of Solr. If you have a way of testing it against some sample workload, I'd suggest you do


> On 30 Mar 2016, at 07:00, Ayon Sinha <ayonsinha@gmail.com> wrote:
> Hi,
> Say I have deployment design where Storm consumes from Kafka and publishes
> to SolrCloud and I own all 3 deployments + the Zookeeper ensemble. Should I
> build 3 independent ZK emsembles of 7-9 nodes each or is it okay to have
> one 7-9 node ensemble being shared by Kafka, Solr and Storm?
> Since the actual utilization of memory & CPU seems quite little per node,
> for simplicity of deployment it seems having 1 ensemble should be okay
> since 2-3 nodes will be in separate availability zones in the data center
> so total failure should not be a common occurence.
> Thoughts or experiences?
> thanks,
> Ayon

View raw message