Mailing-List: contact issues-help@camel.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@camel.apache.org
Date: Fri, 18 Nov 2016 17:44:59 +0000 (UTC)
From: "ASF GitHub Bot (JIRA)" <jira@apache.org>
To: issues@camel.apache.org
Message-ID: <JIRA.12993926.1470048113000.314617.1479491099490@Atlassian.JIRA>
In-Reply-To: <JIRA.12993926.1470048113000@Atlassian.JIRA>
References: <JIRA.12993926.1470048113000@Atlassian.JIRA> <JIRA.12993926.1470048113040@arcas>
Subject: [jira] [Commented] (CAMEL-10213) Camel Kafka doesn't support
 setting "max.poll.records" and "session.timeout.ms"
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Fri, 18 Nov 2016 17:45:01 -0000


    [ https://issues.apache.org/jira/browse/CAMEL-10213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15677251#comment-15677251 ] 

ASF GitHub Bot commented on CAMEL-10213:
----------------------------------------

GitHub user landonvg opened a pull request:

    https://github.com/apache/camel/pull/1279

    Fix docs for maxPollRecords

    This syncs up the default and description with max.poll.records http://kafka.apache.org/documentation.html#newconsumerconfigs; see comment in https://issues.apache.org/jira/browse/CAMEL-10213

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/landonvg/camel master

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/camel/pull/1279.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #1279
    
----
commit fda945f64ea71cb4589599e850edf20cb98abbaa
Author: Von Landon <landonvg@familysearch.org>
Date:   2016-11-18T17:41:03Z

    Fix docs for maxPollRecords
    
    This syncs up the default and description with max.poll.records http://kafka.apache.org/documentation.html#newconsumerconfigs ; see comment in https://issues.apache.org/jira/browse/CAMEL-10213

commit 5eced81a83ece9407bb86c8358be4ca9b33e1288
Author: Von Landon <landonvg@familysearch.org>
Date:   2016-11-18T17:41:53Z

    Merge pull request #1 from landonvg/landonvg-patch-1
    
    Fix docs for maxPollRecords

----


> Camel Kafka doesn't support setting "max.poll.records" and "session.timeout.ms" 
> --------------------------------------------------------------------------------
>
>                 Key: CAMEL-10213
>                 URL: https://issues.apache.org/jira/browse/CAMEL-10213
>             Project: Camel
>          Issue Type: Improvement
>          Components: camel-kafka
>    Affects Versions: 2.18.0
>            Reporter: Oliver Holzmann
>            Assignee: Claus Ibsen
>            Priority: Minor
>             Fix For: 2.18.0
>
>
> Currently it is not possible to control the processing time in the poll loop in Camel Kafka consumers. 
> It is important to have the possibility to control the poll loop by adjusting {{max.poll.records}} and {{session.timeout.ms}} . Otherwise this warning is produced when consuming a large backlog from kafka topic:
> {code}
> Auto offset commit failed for group consumerGroup: Commit cannot be 
> completed since the group has already rebalanced and assigned the 
> partitions to another member. This means that the time between 
> subsequent calls to poll() was longer than the configured 
> session.timeout.ms, which typically implies that the poll loop is spending 
> too much time message processing. You can address this either by 
> increasing the session timeout or by reducing the maximum size of batches
> returned in poll() with max.poll.records.
> {code}
> Please add {{max.poll.records}} and {{session.timeout.ms}} to Kafka endpoint configuration.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)