distributedlog-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Khurrum Nasim <khurrumnas...@gmail.com>
Subject Distributed Log as Kafka's backend
Date Mon, 01 Aug 2016 16:01:15 GMT

Thank you so much for your quick reply. We are using Kafka now and we are
interested in the features in DL like durability and handling slow machines.

If it is okay to the community, we'd like to give a try and evaluate the
solution. Is there any process that I should follow?


On Sunday, July 31, 2016, Sijie Guo <sijie@apache.org
<javascript:_e(%7B%7D,'cvml','sijie@apache.org');>> wrote:

> Khurrum,
> Interesting. Thank you for your interests in DistributedLog.
> Three years ago when we started the project internally at Twitter, we did
> have a plan to use it as a backend for both kestrel (Twitter's in-house
> queue system) and Kafka. However, we didn't go down that direction.
> Instead, we built a similar self-serve pub/sub system over DistributedLog
> to consolidate our kestrel and kafka. So we don't have a concrete plan to
> build the kafka's interface over DistributedLog. The module was put under
> tutorials is mostly to give people an idea how it can be used for building
> a partition based pub/sub system.
> However, I don't have any strong preference here. If you think it would be
> useful to other people, you are welcome to contribute. We'd be happy to
> guide and offer any helps.
> Also, it might be good if you can explain more about what you are planning
> to do. Other people in the community can chime in and discuss.
> Please let us know your thoughts. You are very welcome to make any
> contributions.
> - Sijie
> On Sat, Jul 30, 2016 at 10:33 PM, Khurrum Nasim <khurrumnasimm@gmail.com>
> wrote:
> > Hello folks,
> >
> > I saw there is a 'distributedlog-kafka' module in tutorials. But it seems
> > not complete yet. I am wondering if there is a plan to fully implement
> the
> > kafka's interface. It would be great if we can use kafka's interface to
> > access distributed log. I'd like to contribute if there is a plan.
> >
> > Thanks,
> > KN
> >

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message