Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id A8F67200D2B for ; Sat, 23 Sep 2017 06:28:34 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id A76541609D0; Sat, 23 Sep 2017 04:28:34 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id ECD3C1609E5 for ; Sat, 23 Sep 2017 06:28:33 +0200 (CEST) Received: (qmail 863 invoked by uid 500); 23 Sep 2017 04:28:33 -0000 Mailing-List: contact jira-help@kafka.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: jira@kafka.apache.org Delivered-To: mailing list jira@kafka.apache.org Received: (qmail 99974 invoked by uid 99); 23 Sep 2017 04:28:30 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 23 Sep 2017 04:28:30 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 31A2D192029 for ; Sat, 23 Sep 2017 04:28:30 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -100.002 X-Spam-Level: X-Spam-Status: No, score=-100.002 tagged_above=-999 required=6.31 tests=[RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id TqBwGvzyBjJD for ; Sat, 23 Sep 2017 04:28:29 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id D53686105F for ; Sat, 23 Sep 2017 04:28:27 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 1ADFBE260E for ; Sat, 23 Sep 2017 04:28:24 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id A3F432439F for ; Sat, 23 Sep 2017 04:28:19 +0000 (UTC) Date: Sat, 23 Sep 2017 04:28:19 +0000 (UTC) From: "Guozhang Wang (JIRA)" To: jira@kafka.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (KAFKA-4904) Performance of RocksDb with state record cache MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Sat, 23 Sep 2017 04:28:34 -0000 [ https://issues.apache.org/jira/browse/KAFKA-4904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4904: --------------------------------- Fix Version/s: (was: 1.0.0) 1.1.0 > Performance of RocksDb with state record cache > ---------------------------------------------- > > Key: KAFKA-4904 > URL: https://issues.apache.org/jira/browse/KAFKA-4904 > Project: Kafka > Issue Type: Improvement > Components: streams > Affects Versions: 0.10.2.0 > Reporter: Eno Thereska > Fix For: 1.1.0 > > > The performance of RocksDb without any record cache is slightly better than with the default of 10MB of the default cache. This needs investigating. It is likely to be the case that this is not an entirely apples-to-apples comparison since the record cache holds records for a maximum of 'commit.time.ms', which by default is 30 seconds. So the record cache is adding quite a bit of latency, and we know that, however documenting the tradeoff and looking if there is any other bugs needs to be done. -- This message was sent by Atlassian JIRA (v6.4.14#64029)