hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Yu (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-15249) Provide lower bound on number of regions in region normalizer for pre-split tables
Date Wed, 10 Feb 2016 22:10:19 GMT

     [ https://issues.apache.org/jira/browse/HBASE-15249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ted Yu updated HBASE-15249:
---------------------------
    Description: 
AMS (Ambari Metrics System) developer found the following scenario:

Metrics table was pre-split with many regions on large cluster (1600 nodes).
After some time, AMS stopped working because region normalizer merged the regions into few
big regions which were not able to serve high read / write load.
This is a big problem since the write requests flood the regions faster than the splits can
happen resulting in poor performance.

We should consider setting reasonable lower bound on region count.
If the table is pre-split, we can use initial region count as the lower bound.

  was:
AMS (Ambari Metrics System) developer found the following scenario:

Metrics table was pre-split with many regions on large cluster.
After some time, AMS stopped working because region normalizer merged the regions into few
big regions which were not able to serve high read / write load.

We should consider setting reasonable lower bound on region count.
If the table is pre-split, we can use initial region count as the lower bound.


> Provide lower bound on number of regions in region normalizer for pre-split tables
> ----------------------------------------------------------------------------------
>
>                 Key: HBASE-15249
>                 URL: https://issues.apache.org/jira/browse/HBASE-15249
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Ted Yu
>            Assignee: Ted Yu
>         Attachments: HBASE-15249.v1.txt, HBASE-15249.v2.txt
>
>
> AMS (Ambari Metrics System) developer found the following scenario:
> Metrics table was pre-split with many regions on large cluster (1600 nodes).
> After some time, AMS stopped working because region normalizer merged the regions into
few big regions which were not able to serve high read / write load.
> This is a big problem since the write requests flood the regions faster than the splits
can happen resulting in poor performance.
> We should consider setting reasonable lower bound on region count.
> If the table is pre-split, we can use initial region count as the lower bound.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message