incubator-s4-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From kishore g <>
Subject s4-110 s4 helix integration update
Date Mon, 11 Feb 2013 10:07:02 GMT

This is an update on S4 and Helix integration happening on S4-110-new
branch. Last week Matthieu and I made good progress. We have the initial
set of changes that allow us to configure the cluster management mode (
existing zk based or helix based).  We had to do some changes to the
existing  code to facilitate this.

Significant changes was that Emitters no longer hold the mapping of
partition to node. The logic of deciding the destination for an event is
moved to Sender. This allowed us to have clear separation
of responsibility between Sender and Emitter.

In order to add new helix implementations, we also made changes in some of
the bindings like S4Bootstrap, DeploymentManager, cluster, Emittter etc.

We still have the following pending

   - Tools are broken. they currently support only Helix based mode. We
   need to support additional configuration that indicates the mode(zk or
   - Need to add more test cases/documentation for helix related changes.
   - Fix broken test cases for s4 mode.
   - Other minor code clean up/refactoring.

Matthieu, please add items to this list( I am sure I have missed quite a
few) :-). The code is not yet ready for review, but feel free to comment on
design and code structure.

Kishore G

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message