hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Lawlor (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-11544) [Ergonomics] hbase.client.scanner.caching is dogged and will try to return batch even if it means OOME
Date Wed, 25 Feb 2015 22:41:06 GMT

     [ https://issues.apache.org/jira/browse/HBASE-11544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jonathan Lawlor updated HBASE-11544:
------------------------------------
    Attachment: HBASE-11544-v5.patch

New patch to reflect the most recent feedback from ReviewBoard. 

The failures that have been seen with respect the TestAcidGuarantees seem to be unrelated
and have been called out in HBASE-13097.

One of the more significant changes that this patch introduces is a rework of the return type
of InternalScanner#next(). Rather than simply return a boolean, a state object is now returned.
This allows callers of InternalScanner#next() determine important state information about
the scanner. It also helps us avoid unnecessary replication of size calculations.

> [Ergonomics] hbase.client.scanner.caching is dogged and will try to return batch even
if it means OOME
> ------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-11544
>                 URL: https://issues.apache.org/jira/browse/HBASE-11544
>             Project: HBase
>          Issue Type: Bug
>            Reporter: stack
>            Assignee: Jonathan Lawlor
>            Priority: Critical
>              Labels: beginner
>         Attachments: HBASE-11544-v1.patch, HBASE-11544-v2.patch, HBASE-11544-v3.patch,
HBASE-11544-v5.patch
>
>
> Running some tests, I set hbase.client.scanner.caching=1000.  Dataset has large cells.
 I kept OOME'ing.
> Serverside, we should measure how much we've accumulated and return to the client whatever
we've gathered once we pass out a certain size threshold rather than keep accumulating till
we OOME.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message