kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jason Gustafson <ja...@confluent.io>
Subject Re: [DISCUSS] KIP-517: Add consumer metric indicating time between poll calls
Date Fri, 13 Sep 2019 17:39:04 GMT
Hi Kevin,

This looks reasonable to me. I'd also +1 Radai's suggestion if you're
willing. Something like an idle ratio for the consumer would be helpful.

Thanks,
Jason

On Fri, Sep 13, 2019 at 10:08 AM radai <radai.rosenblatt@gmail.com> wrote:

> while youre at it another metric that we have found to be useful is %
> time spent in user code vs time spent in poll() (so time between poll
> calls / time inside poll calls) - the higher the % value the more
> indicative of user code being the cause of performance bottlenecks.
>
> On Fri, Sep 13, 2019 at 9:14 AM Kevin Lu <lu.kevin@berkeley.edu> wrote:
> >
> > Hi All,
> >
> > Happy Friday! Bumping this. Any thoughts?
> >
> > Thanks.
> >
> > Regards,
> > Kevin
> >
> > On Thu, Sep 5, 2019 at 9:35 AM Kevin Lu <lu.kevin@berkeley.edu> wrote:
> >
> > > Hi All,
> > >
> > > I'd like to propose a new consumer metric that measures the time
> between
> > > calls to poll() for use in issues related to hitting
> max.poll.interval.ms
> > > due to long processing time.
> > >
> > >
> > >
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-517%3A+Add+consumer+metric+indicating+time+between+poll+calls
> > >
> > > Please give it a read and let me know what you think.
> > >
> > > Thanks!
> > >
> > > Regards,
> > > Kevin
> > >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message