camel-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Von Landon (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CAMEL-10213) Camel Kafka doesn't support setting "max.poll.records" and "session.timeout.ms"
Date Fri, 18 Nov 2016 14:21:58 GMT

    [ https://issues.apache.org/jira/browse/CAMEL-10213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15676818#comment-15676818
] 

Von Landon commented on CAMEL-10213:
------------------------------------

Thank you.  Excuse my ignorance, but I have not used asciidoc before.  When I view the link
above, I'm seeing only raw text with markup; how should I be viewing that document?  I imagine
others will have the same question, as you make the transition.

> Camel Kafka doesn't support setting "max.poll.records" and "session.timeout.ms" 
> --------------------------------------------------------------------------------
>
>                 Key: CAMEL-10213
>                 URL: https://issues.apache.org/jira/browse/CAMEL-10213
>             Project: Camel
>          Issue Type: Improvement
>          Components: camel-kafka
>    Affects Versions: 2.18.0
>            Reporter: Oliver Holzmann
>            Assignee: Claus Ibsen
>            Priority: Minor
>             Fix For: 2.18.0
>
>
> Currently it is not possible to control the processing time in the poll loop in Camel
Kafka consumers. 
> It is important to have the possibility to control the poll loop by adjusting {{max.poll.records}}
and {{session.timeout.ms}} . Otherwise this warning is produced when consuming a large backlog
from kafka topic:
> {code}
> Auto offset commit failed for group consumerGroup: Commit cannot be 
> completed since the group has already rebalanced and assigned the 
> partitions to another member. This means that the time between 
> subsequent calls to poll() was longer than the configured 
> session.timeout.ms, which typically implies that the poll loop is spending 
> too much time message processing. You can address this either by 
> increasing the session timeout or by reducing the maximum size of batches
> returned in poll() with max.poll.records.
> {code}
> Please add {{max.poll.records}} and {{session.timeout.ms}} to Kafka endpoint configuration.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message