hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-16169) Make RegionSizeCalculator scalable
Date Thu, 17 Nov 2016 11:41:01 GMT

    [ https://issues.apache.org/jira/browse/HBASE-16169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15673493#comment-15673493
] 

Hudson commented on HBASE-16169:
--------------------------------

FAILURE: Integrated in Jenkins build HBase-Trunk_matrix #1968 (See [https://builds.apache.org/job/HBase-Trunk_matrix/1968/])
HBASE-16169: Make RegionSizeCalculator scalable (stack: rev 80acc2dca5435f46c683f9eae78861bc766589a6)
* (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/RequestConverter.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/master/MockRegionServer.java
* (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/Admin.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/util/RegionSizeCalculator.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestRegionSizeCalculator.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
* (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/ProtobufUtil.java
* (edit) hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/generated/AdminProtos.java
* (add) hbase-server/src/test/java/org/apache/hadoop/hbase/TestRegionLoad.java
* (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
* (edit) hbase-protocol-shaded/src/main/protobuf/Admin.proto


> Make RegionSizeCalculator scalable
> ----------------------------------
>
>                 Key: HBASE-16169
>                 URL: https://issues.apache.org/jira/browse/HBASE-16169
>             Project: HBase
>          Issue Type: Sub-task
>          Components: mapreduce, scaling
>            Reporter: Thiruvel Thirumoolan
>            Assignee: Thiruvel Thirumoolan
>             Fix For: 2.0.0
>
>         Attachments: HBASE-16169.master.000.patch, HBASE-16169.master.001.patch, HBASE-16169.master.002.patch,
HBASE-16169.master.003.patch, HBASE-16169.master.004.patch, HBASE-16169.master.005.patch,
HBASE-16169.master.006.patch, HBASE-16169.master.007.patch, HBASE-16169.master.007.patch,
HBASE-16169.master.008.patch
>
>
> RegionSizeCalculator is needed for better split generation of MR jobs. This requires
RegionLoad which can be obtained via ClusterStatus, i.e. accessing Master. We don't want master
to be in this path.
> The proposal is to add an API to the RegionServer that gets RegionLoad of all regions
hosted on it or those of a table if specified. RegionSizeCalculator can use the latter.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message