flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Elias Levy (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-4035) Bump Kafka producer in Kafka sink to Kafka
Date Wed, 08 Jun 2016 21:02:20 GMT
Elias Levy created FLINK-4035:

             Summary: Bump Kafka producer in Kafka sink to Kafka
                 Key: FLINK-4035
                 URL: https://issues.apache.org/jira/browse/FLINK-4035
             Project: Flink
          Issue Type: Bug
          Components: Kafka Connector
    Affects Versions: 1.0.3
            Reporter: Elias Levy
            Priority: Minor

Kafka introduced protocol changes related to the producer.  Published messages now
include timestamps and compressed messages now include relative offsets.  As it is now, brokers
must decompress publisher compressed messages, assign offset to them, and recompress them,
which is wasteful and makes it less likely that compression will be used at all.

This message was sent by Atlassian JIRA

View raw message