hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-12217) System load average based client pushback
Date Sat, 07 Feb 2015 20:20:35 GMT

    [ https://issues.apache.org/jira/browse/HBASE-12217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14310910#comment-14310910
] 

Andrew Purtell commented on HBASE-12217:
----------------------------------------

I recently came across [metrics-sigar|https://github.com/cb372/metrics-sigar], which integrates
Coda Hale's Metrics with the [SIGAR|https://support.hyperic.com/display/SIGAR/Home] cross-platform
native-based library for gathering system information. It's interesting but of course requires
native binaries be deployed and a system property set to point to them. Since we are just
interested in system load I think we are better off doing it like YARN does: a generic interface
(ResourceCalculatorPlugin) and OS-specific implementations (like LinuxResourceCalculatorPlugin,
which knows how to parse procfs), but let's mention both options.

> System load average based client pushback
> -----------------------------------------
>
>                 Key: HBASE-12217
>                 URL: https://issues.apache.org/jira/browse/HBASE-12217
>             Project: HBase
>          Issue Type: New Feature
>            Reporter: Andrew Purtell
>
> If a RegionServer host is already heavily loaded* then it might not be best to accept
more work in the form of coprocessor invocations. This could generalize to all RPC work, perhaps
as part of a broader admission control initiative, but I think it makes sense to start small
in an obvious place.
> *: We could use % CPU utilization or the UNIX 1min or 5min load average to determine
this, and provide an option for choosing between those alternatives. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message