hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-12217) System load average based client pushback
Date Mon, 22 Jun 2015 18:46:03 GMT

    [ https://issues.apache.org/jira/browse/HBASE-12217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14596414#comment-14596414

Andrew Purtell commented on HBASE-12217:

bq. Over in HBASE-13103 Lars Hofhansl calls out several other metrics we'd want to know about
when auto-tuning number of regions.

Pardon, but this issue isn't about auto-tuning the number of regions. This issue is about
providing backpressure to the client based on server side conditions.

bq. I think we'd be interested in more than just load average if it was available. 

There are other proposed strategies on other JIRAs, linked as related items on HBASE-5162.
When/if we get around to this work the idea is the load estimation strategy and client response
will both be pluggable. It may be more challenging to make them composable. That would be
a stretch goal IMHO.

> System load average based client pushback
> -----------------------------------------
>                 Key: HBASE-12217
>                 URL: https://issues.apache.org/jira/browse/HBASE-12217
>             Project: HBase
>          Issue Type: New Feature
>            Reporter: Andrew Purtell
>            Assignee: Andrew Purtell
>             Fix For: 2.0.0, 1.3.0
> If a RegionServer host is already heavily loaded* then it might not be best to accept
more work in the form of coprocessor invocations. This could generalize to all RPC work, perhaps
as part of a broader admission control initiative, but I think it makes sense to start small
in an obvious place.
> *: We could use % CPU utilization or the UNIX 1min or 5min load average to determine
this, and provide an option for choosing between those alternatives. 

This message was sent by Atlassian JIRA

View raw message