aurora-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Joe Smith <>
Subject Re: [DISCUSS] Remove dependency on ZooKeeper for leader election?
Date Tue, 18 Aug 2015 17:32:56 GMT
Awesome spelunking, since we're already dependent on the log (and you've gazed towards the
future as well!) this sounds like a good plan.

> On Aug 18, 2015, at 10:24, Kevin Sweeney <> wrote:
> While perusing the replicated log code for an upcoming talk I realized we
> could drop the use of ZooKeeper for leader election in favor of directly
> using the Mesos replicated log. The reason for this is that we are required
> to be the leader to write anything to the log. So the ZK-based leader
> election operation would be replaced with an attempt to write a noop to the
> replicated log as in [1]. This would remove one of the 3 places we use ZK,
> the others being discovery of log replicas (via libmesos, and this is
> already optional) and announcement to ZooKeeper for service discovery by
> finagle clients. This could also be made optional, as some operators use
> alternative load balancers.
> Changing the leader election logic to use the replicated log is not
> incongruent with other efforts to replace the hand-rolled LogStorage with a
> real SQL database - the leader election function could be implemented with
> a native database function such as [2] or [3] in any serious candidate
> database.
> [1]
> [2]
> [3]

View raw message