kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Guozhang Wang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (KAFKA-3777) Extract the LRU cache out of RocksDBStore
Date Thu, 02 Jun 2016 22:45:59 GMT

     [ https://issues.apache.org/jira/browse/KAFKA-3777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Guozhang Wang updated KAFKA-3777:
---------------------------------
    Description: 
The LRU cache that is currently inside the RocksDbStore class. As part of KAFKA-3776 it needs
to come outside of RocksDbStore and be a separate component used in:

1. KGroupedStream.aggregate() / reduce(), 
2. KStream.aggregateByKey() / reduceByKey(),
3. KTable.to()

As all of the above operators can have a cache on top to deduplicate the materialized state
store in RocksDB.

  was:The LRU cache that is currently inside the RocksDbStore needs to come outside of RocksDbStore
and be a separate component used in KGroupedStream.aggregate() / reduce(), and KStream.aggregateByKey()
/ reduceByKey().


> Extract the LRU cache out of RocksDBStore
> -----------------------------------------
>
>                 Key: KAFKA-3777
>                 URL: https://issues.apache.org/jira/browse/KAFKA-3777
>             Project: Kafka
>          Issue Type: Sub-task
>          Components: streams
>    Affects Versions: 0.10.1.0
>            Reporter: Eno Thereska
>             Fix For: 0.10.1.0
>
>
> The LRU cache that is currently inside the RocksDbStore class. As part of KAFKA-3776
it needs to come outside of RocksDbStore and be a separate component used in:
> 1. KGroupedStream.aggregate() / reduce(), 
> 2. KStream.aggregateByKey() / reduceByKey(),
> 3. KTable.to()
> As all of the above operators can have a cache on top to deduplicate the materialized
state store in RocksDB.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message