kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jay Kreps <jay.kr...@gmail.com>
Subject Re: kafka-49
Date Thu, 21 Jul 2011 19:47:21 GMT
Yeah, that makes sense. How are we going to handle production through a vip
in that case?

-Jay

On Thu, Jul 21, 2011 at 7:44 AM, Jun Rao <junrao@gmail.com> wrote:

> Without replication, we can make ACK optional. With replication, a producer
> can only write to the leader replica. Without ACK, there is no way that the
> broker can inform the producer that it's trying to write to the wrong
> broker.
>
> Jun
>
> On Wed, Jul 20, 2011 at 8:58 PM, Jay Kreps <jay.kreps@gmail.com> wrote:
>
> > It might be nice to consider making the ack optional and part of the
> > request. The current behavior is good for many uses, the request is
> > instantaneously written to the socket buffer but sent asynchronously. I
> > think that is a valuable use case where you care about throughput. I
> guess
> > the question is whether the asynchronous api already covers that well
> > enough
> > and how much complexity exposing that causes.
> >
> > -Jay
> >
> > On Wed, Jul 20, 2011 at 5:51 PM, Jun Rao <junrao@gmail.com> wrote:
> >
> > > Jeff,
> > >
> > > I was thinking of making the ACK mandatory for the producer. The ACK
> can
> > be
> > > sent when the message either hits 1 replicas or multiple replicas,
> > > depending
> > > on the setting.
> > >
> > > Having the ACK include the starting offset of the message seems
> > reasonable.
> > > It will be a bit complicated for multisend since multiple offsets have
> to
> > > be
> > > returned. What do you need the offset for?
> > >
> > > Thanks,
> > >
> > > Jun
> > >
> > > On Wed, Jul 20, 2011 at 12:47 PM, Jeffrey Damick <
> > jeffreydamick@gmail.com
> > > >wrote:
> > >
> > > > Is there any current thought around KAFKA-49, for acknowledgement of
> > > > producers?
> > > > Will this be optional, a new message type(s)?
> > > > Will the ack be synchronous or asynchronous or depending on request
> > type?
> > > >
> > > > It would be fantastic if the ack contained the starting offset of the
> > > > message published, and not just the ending.
> > > >
> > > > This is quickly becoming an issue for us, so we may be able to
> provide
> > > some
> > > > help in this area..
> > > >
> > > >
> > > > thanks
> > > > -jeff
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message