Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 45558200B87 for ; Mon, 19 Sep 2016 08:45:22 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 43F38160AE0; Mon, 19 Sep 2016 06:45:22 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id B0A5D160ACC for ; Mon, 19 Sep 2016 08:45:21 +0200 (CEST) Received: (qmail 31704 invoked by uid 500); 19 Sep 2016 06:45:20 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 31690 invoked by uid 99); 19 Sep 2016 06:45:20 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 19 Sep 2016 06:45:20 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 8EFF12C0D56 for ; Mon, 19 Sep 2016 06:45:20 +0000 (UTC) Date: Mon, 19 Sep 2016 06:45:20 +0000 (UTC) From: "Anoop Sam John (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HBASE-16650) Wrong usage of BlockCache eviction stat for heap memory tuning MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Mon, 19 Sep 2016 06:45:22 -0000 [ https://issues.apache.org/jira/browse/HBASE-16650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HBASE-16650: ----------------------------------- Status: Patch Available (was: Open) > Wrong usage of BlockCache eviction stat for heap memory tuning > -------------------------------------------------------------- > > Key: HBASE-16650 > URL: https://issues.apache.org/jira/browse/HBASE-16650 > Project: HBase > Issue Type: Sub-task > Reporter: Anoop Sam John > Assignee: Anoop Sam John > Fix For: 2.0.0 > > Attachments: HBASE-16650.patch > > > 1. We use the stat evictedBlocksCount - A block can get evicted because of eviction thread due to lack of space or because of removal of an HFile itself (After a compaction). We should not consider the latter in the tune decision at all. These are actually invalidation of blocks. Should the stat counter itself not use this count of evicted blocks? I think yes. This will give wrong message to users that there are lot of real eviction happening. > 2. In case L1+ L2 combined block cache, what we use is the sum of evictions from both. But we will be tuning L1 size alone. Eviction count from L2 should not affect the tuning of L1 -- This message was sent by Atlassian JIRA (v6.3.4#6332)