zookeeper-bookkeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ivan Kelly <iv...@apache.org>
Subject Re: topic naming, grouping of messages and topic redistribution in Hedwig
Date Thu, 03 May 2012 17:25:34 GMT
> -  Are topic names unique across Hedwig instances (spread on
> different datacenters for example)? Is there a naming scheme?
No, a topic name is global to the system. If you publish to TopicA on
region1, a subscriber on region2 will get the message.


> - How can one ensure that a group of messages can be handled
> atomically by Hedwig (in particular 1 message persisted => all
> messages from the group persisted)? One way could be to create a
> single message containing all messages from the group, and send that
> to Hedwig, but maybe there is a better way?
Batching into one message is the only way to do this. 

> - when a hub fails, its topics are redistributed to other hubs, but
> would it be possible to control the redistribution? This could be
> useful in order to limit the number of hubs a client would have to
> connect to (in the case all topics are reallocated to distinct
> hubs). It seems that the current logic is in ZkTopicManager and
> redistribution of topic is based on load information gathered from
> the available hubs. But could this be made customizable?
There's actually work planned to make the TopicManager interfaces more
pluggable so that other backends could be plugged in. This work could
be folded into that maybe.

-Ivan

Mime
View raw message