kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthias J. Sax (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (KAFKA-5966) Support ByteBuffer serialization in Kafka Streams
Date Sun, 24 Sep 2017 01:33:00 GMT

     [ https://issues.apache.org/jira/browse/KAFKA-5966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Matthias J. Sax updated KAFKA-5966:
    Component/s: streams

> Support ByteBuffer serialization in Kafka Streams
> -------------------------------------------------
>                 Key: KAFKA-5966
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5966
>             Project: Kafka
>          Issue Type: Improvement
>          Components: streams
>            Reporter: Xavier Léauté
> Currently Kafka Streams only supports serialization using byte arrays. This means we
generate a lot of garbage and spend unnecessary time copying bytes, especially when working
with windowed state stores that rely on composite keys. In many places in the code we have
extract parts of the composite key to deserialize the either the timestamp or the message
key from the state store key (e.g. the methods in WindowStoreUtils)
> Having support for serde into/from ByteBuffers would allow us to reuse the underlying
bytearrays and just pass around slices of the underlying Buffers to avoid the unnecessary

This message was sent by Atlassian JIRA

View raw message