hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-12217) System load average based client pushback
Date Sat, 07 Feb 2015 20:20:35 GMT

    [ https://issues.apache.org/jira/browse/HBASE-12217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14310910#comment-14310910

Andrew Purtell commented on HBASE-12217:

I recently came across [metrics-sigar|https://github.com/cb372/metrics-sigar], which integrates
Coda Hale's Metrics with the [SIGAR|https://support.hyperic.com/display/SIGAR/Home] cross-platform
native-based library for gathering system information. It's interesting but of course requires
native binaries be deployed and a system property set to point to them. Since we are just
interested in system load I think we are better off doing it like YARN does: a generic interface
(ResourceCalculatorPlugin) and OS-specific implementations (like LinuxResourceCalculatorPlugin,
which knows how to parse procfs), but let's mention both options.

> System load average based client pushback
> -----------------------------------------
>                 Key: HBASE-12217
>                 URL: https://issues.apache.org/jira/browse/HBASE-12217
>             Project: HBase
>          Issue Type: New Feature
>            Reporter: Andrew Purtell
> If a RegionServer host is already heavily loaded* then it might not be best to accept
more work in the form of coprocessor invocations. This could generalize to all RPC work, perhaps
as part of a broader admission control initiative, but I think it makes sense to start small
in an obvious place.
> *: We could use % CPU utilization or the UNIX 1min or 5min load average to determine
this, and provide an option for choosing between those alternatives. 

This message was sent by Atlassian JIRA

View raw message