camel-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CAMEL-9716) Camel KafkaConsumer should be able to re-consume the Kafka stream.
Date Fri, 18 Mar 2016 11:09:33 GMT

    [ https://issues.apache.org/jira/browse/CAMEL-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201324#comment-15201324
] 

ASF GitHub Bot commented on CAMEL-9716:
---------------------------------------

GitHub user sruehl opened a pull request:

    https://github.com/apache/camel/pull/910

    Feature/kafka seek support

    [CAMEL-9716] Camel KafkaConsumer should be able to re-consume the Kafka stream.
    
    This pull request enables a seek to beginning on the camel consumer

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/sruehl/camel feature/kafka-seek-support

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/camel/pull/910.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #910
    
----
commit 7850b59f20c47f787761937c00474d3f76175d5b
Author: Sebastian Rühl <sebastian.ruehl@senacor.com>
Date:   2016-03-16T13:51:56Z

    added seek support for kafka client

commit 5ef66d3126e7391d408c8510476208b41f42b017
Author: Sebastian Rühl <sebastian.ruehl@senacor.com>
Date:   2016-03-18T11:05:10Z

    Enable seekToBeginning by polling

----


> Camel KafkaConsumer should be able to re-consume the Kafka stream.
> ------------------------------------------------------------------
>
>                 Key: CAMEL-9716
>                 URL: https://issues.apache.org/jira/browse/CAMEL-9716
>             Project: Camel
>          Issue Type: New Feature
>          Components: camel-kafka
>    Affects Versions: 2.17.0
>            Reporter: Sebastian Rühl
>            Priority: Minor
>
> In some corner cases we should be able to re-consume a Kafka stream from the beginning
on startup of the endpoint.
> For this the Kafka-KafkaConsumer has a method
> {code:java}
>    public void seekToBeginning(TopicPartition... partitions) {
> {code}
> {panel:title= Sidenode |borderStyle=dashed|borderColor=#ccc|titleBGColor=#F7D6C1|bgColor=#FFFFCE}
> There are other methods to manipulate offsets but for this ticket we just look on the
re-consume corner case.
> {panel}
> Currently I have implemented this support in a branch here ([https://github.com/sruehl/camel/tree/feature/kafka-seek-support])
and have also written an jUnit test.
> -At this time this test still fails for unknown reasons.-
> I would be keen on some feedback on this feature and also would like to advance this
branch to make it mergable. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message