kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Aman Rastogi <amanr.rast...@gmail.com>
Subject Re: Regarding : Store stream for infinite time
Date Wed, 24 Jan 2018 04:55:17 GMT
Thanks Matthias. This is really helpful.

Regards,
Aman

On Wed, Jan 24, 2018 at 2:47 AM, Matthias J. Sax <matthias@confluent.io>
wrote:

> It's simpler to set retention time to Long.MAX_VALUE instead of log
> compaction and generating unique keys. This effectively disable
> retention because the value is huge.
>
> The advantage is, that you don't need to worry about generating unique
> keys.
>
> -Matthias
>
> On 1/23/18 10:39 AM, Aman Rastogi wrote:
> > Thanks Svante.
> >
> > Regards,
> > Aman
> >
> > On Tue, Jan 23, 2018 at 11:38 PM, Svante Karlsson <
> svante.karlsson@csi.se>
> > wrote:
> >
> >> Yes, it will store the last value for each key
> >>
> >> 2018-01-23 18:30 GMT+01:00 Aman Rastogi <amanr.rastogi@gmail.com>:
> >>
> >>> Hi All,
> >>>
> >>> We have a use case to store stream for infinite time (given we have
> >> enough
> >>> storage).
> >>>
> >>> We are planning to solve this by Log Compaction. If each message key is
> >>> unique and Log compaction is enabled, it will store whole stream for
> >>> infinite time. Just wanted to check if my assumption is correct and
> this
> >> is
> >>> an appropriate way to solve this.
> >>>
> >>> Thanks in advance.
> >>>
> >>> Regards,
> >>> Aman
> >>>
> >>
> >
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message