hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-11780) Add a resource based load balancer
Date Wed, 20 Aug 2014 17:32:28 GMT

    [ https://issues.apache.org/jira/browse/HBASE-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104170#comment-14104170
] 

Andrew Purtell commented on HBASE-11780:
----------------------------------------

Do you envision this as an improved cost function for the StochasticLoadBalancer?

How will heterogeneous hardware node attributes be discovered and communicated to the balancer?

Is static node weighting in clusters of ~hundreds or ~thousands viable? Assume some hardware
is always in churn. How would updates be communicated to the master? If by flat file somewhere,
will we have to restart the master for changes to take effect? 

Elsewhere it has been discussed that we'd like to slim down and ultimately remove RegionLoad
and replace that duplication of our metrics publishing with a metrics listener on the master
that accomplishes the same end. Would this issue work towards or against that goal? 

> Add a resource based load balancer
> ----------------------------------
>
>                 Key: HBASE-11780
>                 URL: https://issues.apache.org/jira/browse/HBASE-11780
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Esteban Gutierrez
>            Assignee: Esteban Gutierrez
>
> In some situations with heterogeneous hardware it might be helpful to take in account
the available resources such as RAM, cores or spindles before for the region assignment. A
form of weight per RS might be an initial approach but for also a limit of open regions in
a RS or maximum open store files could be used.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message