Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 0F0A8181B1 for ; Tue, 15 Dec 2015 08:53:47 +0000 (UTC) Received: (qmail 96989 invoked by uid 500); 15 Dec 2015 08:53:46 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 96931 invoked by uid 500); 15 Dec 2015 08:53:46 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 96896 invoked by uid 99); 15 Dec 2015 08:53:46 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Dec 2015 08:53:46 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id A5EDB2C1F71 for ; Tue, 15 Dec 2015 08:53:46 +0000 (UTC) Date: Tue, 15 Dec 2015 08:53:46 +0000 (UTC) From: "Elliott Clark (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-14978) Don't allow Multi to retain too many blocks MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-14978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057639#comment-15057639 ] Elliott Clark commented on HBASE-14978: --------------------------------------- bq.The check is still on getRowArray() Everything should be on value. > Don't allow Multi to retain too many blocks > ------------------------------------------- > > Key: HBASE-14978 > URL: https://issues.apache.org/jira/browse/HBASE-14978 > Project: HBase > Issue Type: Improvement > Affects Versions: 2.0.0, 1.2.0, 1.3.0 > Reporter: Elliott Clark > Assignee: Elliott Clark > Priority: Critical > Attachments: HBASE-14978-v1.patch, HBASE-14978.patch > > > Scans and Multi's have limits on the total size of cells that can be returned. However if those requests are not all pointing at the same blocks then the KeyValues can keep alive a lot more data than their size. > Take the following example: > A multi with a list of 10000 gets to a fat row. Each column being returned in in a different block. Each column is small 32 bytes or so. > So the total cell size will be 32 * 10000 = ~320kb. However if each block is 128k then total retained heap size will be almost 2gigs. -- This message was sent by Atlassian JIRA (v6.3.4#6332)