kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jun Rao <jun...@gmail.com>
Subject Re: kafka-49
Date Thu, 21 Jul 2011 14:44:31 GMT
Without replication, we can make ACK optional. With replication, a producer
can only write to the leader replica. Without ACK, there is no way that the
broker can inform the producer that it's trying to write to the wrong
broker.

Jun

On Wed, Jul 20, 2011 at 8:58 PM, Jay Kreps <jay.kreps@gmail.com> wrote:

> It might be nice to consider making the ack optional and part of the
> request. The current behavior is good for many uses, the request is
> instantaneously written to the socket buffer but sent asynchronously. I
> think that is a valuable use case where you care about throughput. I guess
> the question is whether the asynchronous api already covers that well
> enough
> and how much complexity exposing that causes.
>
> -Jay
>
> On Wed, Jul 20, 2011 at 5:51 PM, Jun Rao <junrao@gmail.com> wrote:
>
> > Jeff,
> >
> > I was thinking of making the ACK mandatory for the producer. The ACK can
> be
> > sent when the message either hits 1 replicas or multiple replicas,
> > depending
> > on the setting.
> >
> > Having the ACK include the starting offset of the message seems
> reasonable.
> > It will be a bit complicated for multisend since multiple offsets have to
> > be
> > returned. What do you need the offset for?
> >
> > Thanks,
> >
> > Jun
> >
> > On Wed, Jul 20, 2011 at 12:47 PM, Jeffrey Damick <
> jeffreydamick@gmail.com
> > >wrote:
> >
> > > Is there any current thought around KAFKA-49, for acknowledgement of
> > > producers?
> > > Will this be optional, a new message type(s)?
> > > Will the ack be synchronous or asynchronous or depending on request
> type?
> > >
> > > It would be fantastic if the ack contained the starting offset of the
> > > message published, and not just the ending.
> > >
> > > This is quickly becoming an issue for us, so we may be able to provide
> > some
> > > help in this area..
> > >
> > >
> > > thanks
> > > -jeff
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message