kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jay Kreps (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (KAFKA-918) Change log.retention.hours to be log.retention.mins
Date Mon, 03 Mar 2014 17:39:21 GMT

     [ https://issues.apache.org/jira/browse/KAFKA-918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jay Kreps updated KAFKA-918:
----------------------------

    Issue Type: Improvement  (was: New Feature)

> Change log.retention.hours to be log.retention.mins
> ---------------------------------------------------
>
>                 Key: KAFKA-918
>                 URL: https://issues.apache.org/jira/browse/KAFKA-918
>             Project: Kafka
>          Issue Type: Improvement
>          Components: config
>    Affects Versions: 0.7.2
>            Reporter: Jason Weiss
>            Assignee: Alin Vasile
>              Labels: features, newbie
>             Fix For: 0.8.1
>
>         Attachments: issue_918.patch
>
>
> We stood up a cluster that is processing over 350,000 events per second, with each event
a fixed payload size of 2K. The storage required to process that much data over an hour is
beyond what we wanted to pay for at AWS. Additionally, we don't have a requirement to keep
the files around for an extended period after processing.
> It would be tremendously valuable for us to be able to define the log.retention in minutes,
not hours. For example, we would prefer to only keep 30 minutes of logs around.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message