Mailing-List: contact dev-help@flink.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@flink.apache.org
Date: Wed, 8 Jun 2016 21:02:20 +0000 (UTC)
From: "Elias Levy (JIRA)" <jira@apache.org>
To: dev@flink.apache.org
Message-ID: <JIRA.12977013.1465419698000.33195.1465419740931@Atlassian.JIRA>
In-Reply-To: <JIRA.12977013.1465419698000@Atlassian.JIRA>
References: <JIRA.12977013.1465419698000@Atlassian.JIRA> <JIRA.12977013.1465419698526@arcas>
Subject: [jira] [Created] (FLINK-4035) Bump Kafka producer in Kafka sink to
 Kafka 0.10.0.0
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Wed, 08 Jun 2016 21:02:22 -0000

Elias Levy created FLINK-4035:
---------------------------------

             Summary: Bump Kafka producer in Kafka sink to Kafka 0.10.0.0
                 Key: FLINK-4035
                 URL: https://issues.apache.org/jira/browse/FLINK-4035
             Project: Flink
          Issue Type: Bug
          Components: Kafka Connector
    Affects Versions: 1.0.3
            Reporter: Elias Levy
            Priority: Minor


Kafka 0.10.0.0 introduced protocol changes related to the producer.  Published messages now include timestamps and compressed messages now include relative offsets.  As it is now, brokers must decompress publisher compressed messages, assign offset to them, and recompress them, which is wasteful and makes it less likely that compression will be used at all.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)