kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edoardo Comar (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (KAFKA-5201) Compacted topic could be misused to fill up a disk but deletion policy can't retain legitimate keys
Date Tue, 09 May 2017 02:55:04 GMT

     [ https://issues.apache.org/jira/browse/KAFKA-5201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Edoardo Comar updated KAFKA-5201:
---------------------------------
    Summary: Compacted topic could be misused to fill up a disk but deletion policy can't
retain legitimate keys   (was: Compacted topic could be misused up to fill a disk; )

> Compacted topic could be misused to fill up a disk but deletion policy can't retain legitimate
keys 
> ----------------------------------------------------------------------------------------------------
>
>                 Key: KAFKA-5201
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5201
>             Project: Kafka
>          Issue Type: Improvement
>            Reporter: Edoardo Comar
>
> Misuse of a topic with cleanup policy = compact
> could lead to a disk being filled if a misbehaving producer keeps producing messages
with unique keys.
> The mixed cleanup policy compact,delete could be adopted, but would not guarantee that
the latest "legitimate" keys will be kept.
> It would be desirable to have a cleanup policy that attempts to preserve messages with
'legitimate' keys
> This issue needs a KIP but I have no proposed solution yet at the time of writing.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message