Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id B746A200B41 for ; Wed, 22 Jun 2016 21:51:17 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id B4C9A160A24; Wed, 22 Jun 2016 19:51:17 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 36B9C160A36 for ; Wed, 22 Jun 2016 21:51:17 +0200 (CEST) Received: (qmail 69862 invoked by uid 500); 22 Jun 2016 19:51:16 -0000 Mailing-List: contact issues-help@camel.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@camel.apache.org Delivered-To: mailing list issues@camel.apache.org Received: (qmail 69845 invoked by uid 99); 22 Jun 2016 19:51:16 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Jun 2016 19:51:16 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 4090D2C1F5D for ; Wed, 22 Jun 2016 19:51:16 +0000 (UTC) Date: Wed, 22 Jun 2016 19:51:16 +0000 (UTC) From: "Daniel Kulp (JIRA)" To: issues@camel.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Resolved] (CAMEL-10065) Support Iterator<...> for kafka component MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Wed, 22 Jun 2016 19:51:17 -0000 [ https://issues.apache.org/jira/browse/CAMEL-10065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Kulp resolved CAMEL-10065. --------------------------------- Resolution: Fixed Fix Version/s: 2.17.2 2.16.4 > Support Iterator<...> for kafka component > ----------------------------------------- > > Key: CAMEL-10065 > URL: https://issues.apache.org/jira/browse/CAMEL-10065 > Project: Camel > Issue Type: Improvement > Components: camel-kafka > Reporter: Daniel Kulp > Assignee: Daniel Kulp > Fix For: 2.16.4, 2.17.2 > > > The kafka component currently takes the body of the message and sends that directly into the kafka producer then sets the callback for when that particular message is delivered to the kafka server. This works, but is slow, particularly for thousands of little messages. (cannot really take advantage of the batching that is done in the kafka producer) > It would be good to allow the camel-kafka producer to accept various collections (Iterable and Iterator) and have it iterator through those creating kafka messages that can be uploaded and processed in a batch. dataformats (and aggregator) that can produce those could benefit tremendously. -- This message was sent by Atlassian JIRA (v6.3.4#6332)