camel-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Kulp (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (CAMEL-10065) Support Iterator<...> for kafka component
Date Wed, 22 Jun 2016 19:51:16 GMT

     [ https://issues.apache.org/jira/browse/CAMEL-10065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Daniel Kulp resolved CAMEL-10065.
---------------------------------
       Resolution: Fixed
    Fix Version/s: 2.17.2
                   2.16.4

> Support Iterator<...> for kafka component
> -----------------------------------------
>
>                 Key: CAMEL-10065
>                 URL: https://issues.apache.org/jira/browse/CAMEL-10065
>             Project: Camel
>          Issue Type: Improvement
>          Components: camel-kafka
>            Reporter: Daniel Kulp
>            Assignee: Daniel Kulp
>             Fix For: 2.16.4, 2.17.2
>
>
> The kafka component currently takes the body of the message and sends that directly into
the kafka producer then sets the callback for when that particular message is delivered to
the kafka server.   This works, but is slow, particularly for thousands of little messages.
 (cannot really take advantage of the batching that is done in the kafka producer)
> It would be good to allow the camel-kafka producer to accept various collections (Iterable
and Iterator) and have it iterator through those creating kafka messages that can be uploaded
and processed in a batch.  dataformats (and aggregator) that can produce those could benefit
tremendously. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message