Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id A6CAE200BCC for ; Tue, 15 Nov 2016 02:22:01 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id A578E160B18; Tue, 15 Nov 2016 01:22:01 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 23615160B0D for ; Tue, 15 Nov 2016 02:22:00 +0100 (CET) Received: (qmail 94284 invoked by uid 500); 15 Nov 2016 01:22:00 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 93868 invoked by uid 99); 15 Nov 2016 01:22:00 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Nov 2016 01:22:00 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id F19CA2C4C7A for ; Tue, 15 Nov 2016 01:21:59 +0000 (UTC) Date: Tue, 15 Nov 2016 01:21:59 +0000 (UTC) From: "Thiruvel Thirumoolan (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-16169) Make RegionSizeCalculator scalable MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Tue, 15 Nov 2016 01:22:01 -0000 [ https://issues.apache.org/jira/browse/HBASE-16169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15665653#comment-15665653 ] Thiruvel Thirumoolan commented on HBASE-16169: ---------------------------------------------- With this patch, the split calculation logic will only hit the getRegionLoad() RPC on those region servers which host the table. Other region servers will not be touched. > Make RegionSizeCalculator scalable > ---------------------------------- > > Key: HBASE-16169 > URL: https://issues.apache.org/jira/browse/HBASE-16169 > Project: HBase > Issue Type: Sub-task > Components: mapreduce, scaling > Reporter: Thiruvel Thirumoolan > Assignee: Thiruvel Thirumoolan > Fix For: 2.0.0, 1.4.0 > > Attachments: HBASE-16169.master.000.patch, HBASE-16169.master.001.patch, HBASE-16169.master.002.patch, HBASE-16169.master.003.patch, HBASE-16169.master.004.patch, HBASE-16169.master.005.patch, HBASE-16169.master.006.patch > > > RegionSizeCalculator is needed for better split generation of MR jobs. This requires RegionLoad which can be obtained via ClusterStatus, i.e. accessing Master. We don't want master to be in this path. > The proposal is to add an API to the RegionServer that gets RegionLoad of all regions hosted on it or those of a table if specified. RegionSizeCalculator can use the latter. -- This message was sent by Atlassian JIRA (v6.3.4#6332)