Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 2E6D9200B0F for ; Fri, 3 Jun 2016 00:55:01 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 2D239160A51; Thu, 2 Jun 2016 22:55:01 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 737D7160A53 for ; Fri, 3 Jun 2016 00:55:00 +0200 (CEST) Received: (qmail 65686 invoked by uid 500); 2 Jun 2016 22:54:59 -0000 Mailing-List: contact dev-help@kafka.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@kafka.apache.org Delivered-To: mailing list dev@kafka.apache.org Received: (qmail 65643 invoked by uid 99); 2 Jun 2016 22:54:59 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Jun 2016 22:54:59 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 539042C1F6E for ; Thu, 2 Jun 2016 22:54:59 +0000 (UTC) Date: Thu, 2 Jun 2016 22:54:59 +0000 (UTC) From: "Guozhang Wang (JIRA)" To: dev@kafka.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (KAFKA-3777) Extract the LRU cache out of RocksDBStore MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Thu, 02 Jun 2016 22:55:01 -0000 [ https://issues.apache.org/jira/browse/KAFKA-3777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3777: --------------------------------- Description: The LRU cache that is currently inside the RocksDbStore class. As part of KAFKA-3776 it needs to come outside of RocksDbStore and be a separate component used in: 1. KGroupedStream.aggregate() / reduce(), 2. KStream.aggregateByKey() / reduceByKey(), 3. KTable.to() (this will be done in KAFKA-3779). As all of the above operators can have a cache on top to deduplicate the materialized state store in RocksDB. The scope of this JIRA is to extract out the cache of RocksDBStore, and keep them as item 1) and 2) above; and it should be done together / after KAFKA-3780. was: The LRU cache that is currently inside the RocksDbStore class. As part of KAFKA-3776 it needs to come outside of RocksDbStore and be a separate component used in: 1. KGroupedStream.aggregate() / reduce(), 2. KStream.aggregateByKey() / reduceByKey(), 3. KTable.to() (this will be done in KAFKA-3779). As all of the above operators can have a cache on top to deduplicate the materialized state store in RocksDB. The scope of this JIRA is to extract out the cache of RocksDBStore, and keep them as item 1) and 2) above. > Extract the LRU cache out of RocksDBStore > ----------------------------------------- > > Key: KAFKA-3777 > URL: https://issues.apache.org/jira/browse/KAFKA-3777 > Project: Kafka > Issue Type: Sub-task > Components: streams > Affects Versions: 0.10.1.0 > Reporter: Eno Thereska > Fix For: 0.10.1.0 > > > The LRU cache that is currently inside the RocksDbStore class. As part of KAFKA-3776 it needs to come outside of RocksDbStore and be a separate component used in: > 1. KGroupedStream.aggregate() / reduce(), > 2. KStream.aggregateByKey() / reduceByKey(), > 3. KTable.to() (this will be done in KAFKA-3779). > As all of the above operators can have a cache on top to deduplicate the materialized state store in RocksDB. > The scope of this JIRA is to extract out the cache of RocksDBStore, and keep them as item 1) and 2) above; and it should be done together / after KAFKA-3780. -- This message was sent by Atlassian JIRA (v6.3.4#6332)