Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5BED910838 for ; Wed, 12 Feb 2014 01:15:31 +0000 (UTC) Received: (qmail 92487 invoked by uid 500); 12 Feb 2014 01:15:28 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 92345 invoked by uid 500); 12 Feb 2014 01:15:27 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 92205 invoked by uid 99); 12 Feb 2014 01:15:25 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 12 Feb 2014 01:15:25 +0000 Date: Wed, 12 Feb 2014 01:15:25 +0000 (UTC) From: "Enis Soztutar (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-10498) Add new APIs to load balancer interface MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-10498?page=3Dcom.atlassia= n.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D138= 98603#comment-13898603 ]=20 Enis Soztutar commented on HBASE-10498: --------------------------------------- bq. Can you not add a new attribute for the Stochastic LB to consider =E2= =80=93 colocation =E2=80=93 and weight it above others rather than add API? This is kind of the opposite of what we do for not co-locating the region r= eplicas. The patch at HBASE-10351 adds "soft" constraints for ensuring that= the replicas are not co-located. I highly suggest taking a look there. How= ever, for secondary indexing, co-locating regions should be a "hard constra= int" I imagine.=20 Still it should be possible to implement hard constraints like co-location = inside the core LB's, but implement the logic of deciding which regions to = co-locate as a pluggable layer.=20 > Add new APIs to load balancer interface > --------------------------------------- > > Key: HBASE-10498 > URL: https://issues.apache.org/jira/browse/HBASE-10498 > Project: HBase > Issue Type: Improvement > Components: Balancer > Reporter: rajeshbabu > Assignee: rajeshbabu > Fix For: 0.98.1, 0.99.0 > > > If a custom load balancer required to maintain region and corresponding s= erver locations, > we can capture this information when we run any balancer algorithm before= assignment(like random,retain). > But during master startup we will not call any balancer algorithm if a re= gion already assinged > During split also we open child regions first in RS and then notify to ma= ster through zookeeper.=20 > So split regions information cannot be captured into balancer. > Since balancer has access to master we can get the information from onlin= e regions or region plan data structures in AM. > But some use cases we cannot relay on this information(mainly to maintain= colocation of two tables regions).=20 > So it's better to add some APIs to load balancer to notify balancer when = *region is online or offline*. > These APIs helps a lot to maintain *regions colocation through custom loa= d balancer* which is very important in secondary indexing.=20 -- This message was sent by Atlassian JIRA (v6.1.5#6160)