kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ismael Juma (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (KAFKA-5533) Timestamp-based log compaction
Date Tue, 18 Jul 2017 12:17:00 GMT

     [ https://issues.apache.org/jira/browse/KAFKA-5533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ismael Juma updated KAFKA-5533:
-------------------------------
    Fix Version/s:     (was: 0.11.0.1)
                   0.11.1.0

> Timestamp-based log compaction
> ------------------------------
>
>                 Key: KAFKA-5533
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5533
>             Project: Kafka
>          Issue Type: New Feature
>          Components: core
>    Affects Versions: 0.11.0.0
>            Reporter: Eno Thereska
>              Labels: kip
>             Fix For: 0.11.1.0
>
>
> Today log compaction is based on offsets, not timestamps. That means that a late arriving
record with a small timestamp TS can over-write a record with a larger timestamp TL. This
affects computations that depend on correct processing of timestamps. For example, in the
streams library, this would mean that processing for KTables with late arriving data would
not be correct.
> This JIRA will require a KIP.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message