hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-14978) Don't allow Multi to retain too many blocks
Date Fri, 18 Dec 2015 00:51:46 GMT

    [ https://issues.apache.org/jira/browse/HBASE-14978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15063195#comment-15063195
] 

stack commented on HBASE-14978:
-------------------------------

[~eclark]

bq. ....and the apache build env is less than useless...

Disagree. Its turning up issues now before checkin even.... finding hangers before checkin
even.  Its starting to have value again. TestSplitLogManager is a test that hangs from time-to-time.
We need to fix it.

This patch for 1.2 only then?



> Don't allow Multi to retain too many blocks
> -------------------------------------------
>
>                 Key: HBASE-14978
>                 URL: https://issues.apache.org/jira/browse/HBASE-14978
>             Project: HBase
>          Issue Type: Improvement
>          Components: io, IPC/RPC, regionserver
>    Affects Versions: 2.0.0, 1.2.0, 1.3.0
>            Reporter: Elliott Clark
>            Assignee: Elliott Clark
>            Priority: Blocker
>             Fix For: 1.2.0, 3.0.0, 1.3.0
>
>         Attachments: HBASE-14978-branch-1.2.patch, HBASE-14978-branch-1.2.patch, HBASE-14978-branch-1.2.patch,
HBASE-14978-branch-1.2.patch, HBASE-14978-v1.patch, HBASE-14978-v2.patch, HBASE-14978-v3.patch,
HBASE-14978-v4.patch, HBASE-14978.patch
>
>
> Scans and Multi's have limits on the total size of cells that can be returned. However
if those requests are not all pointing at the same blocks then the KeyValues can keep alive
a lot more data than their size.
> Take the following example:
> A multi with a list of 10000 gets to a fat row. Each column being returned in in a different
block. Each column is small 32 bytes or so.
> So the total cell size will be 32 * 10000 = ~320kb. However if each block is 128k then
total retained heap size will be almost 2gigs.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message