kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Guozhang Wang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (KAFKA-5533) Timestamp-based log compaction
Date Sat, 27 Jan 2018 04:27:00 GMT

     [ https://issues.apache.org/jira/browse/KAFKA-5533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Guozhang Wang updated KAFKA-5533:
    Fix Version/s:     (was: 1.1.0)

> Timestamp-based log compaction
> ------------------------------
>                 Key: KAFKA-5533
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5533
>             Project: Kafka
>          Issue Type: New Feature
>          Components: core
>    Affects Versions:
>            Reporter: Eno Thereska
>            Priority: Major
>              Labels: kip
> Today log compaction is based on offsets, not timestamps. That means that a late arriving
record with a small timestamp TS can over-write a record with a larger timestamp TL. This
affects computations that depend on correct processing of timestamps. For example, in the
streams library, this would mean that processing for KTables with late arriving data would
not be correct.
> This JIRA will require a KIP.

This message was sent by Atlassian JIRA

View raw message