hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Enis Soztutar (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-15518) Add Per-Table metrics back
Date Thu, 07 Apr 2016 19:22:25 GMT

    [ https://issues.apache.org/jira/browse/HBASE-15518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15230888#comment-15230888
] 

Enis Soztutar commented on HBASE-15518:
---------------------------------------

I've put this in a cluster to test. There is an issue it seems: 
{code}
 {
    "name" : "Hadoop:service=HBase,name=RegionServer,sub=Tables",
    "modelerType" : "RegionServer,sub=Tables",
    "tag.Context" : "regionserver",
    "tag.Hostname" : "cn017.l42scl.hortonworks.com",
    "Namespace_hbase_table_meta_metric_readRequestCount" : 2837518,
    "Namespace_hbase_table_meta_metric_writeRequestCount" : 218,
    "Namespace_hbase_table_meta_metric_totalRequestCount" : 2837736,
    "Namespace_default_table_tsdb-meta_metric_readRequestCount" : 509116,
    "Namespace_default_table_tsdb-meta_metric_writeRequestCount" : 0,
    "Namespace_default_table_tsdb-meta_metric_totalRequestCount" : 509116,
    "Namespace_hbase_table_namespace_metric_readRequestCount" : 341886,
    "Namespace_hbase_table_namespace_metric_writeRequestCount" : 0,
    "Namespace_hbase_table_namespace_metric_totalRequestCount" : 341886,
    "Namespace_default_table_usertable_metric_readRequestCount" : 3200321,
    "Namespace_default_table_usertable_metric_writeRequestCount" : 218,
    "Namespace_default_table_usertable_metric_totalRequestCount" : 3200539,
    "Namespace_default_table_tsdb-tree_metric_readRequestCount" : 1849882,
    "Namespace_default_table_tsdb-tree_metric_writeRequestCount" : 0,
    "Namespace_default_table_tsdb-tree_metric_totalRequestCount" : 1849882,
    "Namespace_default_table_tsdb_metric_readRequestCount" : 2276253,
    "Namespace_default_table_tsdb_metric_writeRequestCount" : 0,
    "Namespace_default_table_tsdb_metric_totalRequestCount" : 2276253,
    "Namespace_default_table_tsdb-uid_metric_readRequestCount" : 1520945,
    "Namespace_default_table_tsdb-uid_metric_writeRequestCount" : 0,
    "Namespace_default_table_tsdb-uid_metric_totalRequestCount" : 1520945,
    "Namespace_default_table_usertable-empty_metric_readRequestCount" : 3200321,
    "Namespace_default_table_usertable-empty_metric_writeRequestCount" : 218,
    "Namespace_default_table_usertable-empty_metric_totalRequestCount" : 3200539,
    "Namespace_default_table_TestTable_metric_readRequestCount" : 3076442,
    "Namespace_default_table_TestTable_metric_writeRequestCount" : 218,
    "Namespace_default_table_TestTable_metric_totalRequestCount" : 3076660,
    "numTables" : 9
  }
{code}

Something wrong with the aggregation for table names "usertable" and "usertable-empty". They
are showing the same values, versus only "usertable" should be having read requests. 

Also, look at this: 
{code}
    "Namespace_default_table_tsdb-tree_metric_readRequestCount" : 1849882,
{code} 
However, the region metrics for this table {{tsdb-tree}} is: 
{code}
    "Namespace_default_table_tsdb-tree_region_8cbc7ef45755eed3206858da0d8caa3e_metric_readRequestCount"
: 0,
{code}

[~aliciashu] can you please check what is going on. Thanks.

> Add Per-Table metrics back
> --------------------------
>
>                 Key: HBASE-15518
>                 URL: https://issues.apache.org/jira/browse/HBASE-15518
>             Project: HBase
>          Issue Type: Sub-task
>            Reporter: Enis Soztutar
>            Assignee: Alicia Ying Shu
>             Fix For: 2.0.0, 1.4.0
>
>         Attachments: HBASE-15518-v1.patch, HBASE-15518.patch
>
>
> We used to have per-table metrics, but it was removed in some restructuring. We have
per-region metrics, and per-regionserver metrics, but nothing in between. 
> For majority of users, per-region is too granular, they are mostly interested in table
level aggregates. This is especially useful in multi-tenant cases where a table's disk usage,
number of requests, etc can be made much more visible. 
> In this jira, we'll add the basic infrastructure to add a single (or a few) per-table
metrics. Than we can improve on that by adding remaining metrics from the region server level.

> The plan is to NOT aggregate per-table metrics at master for now. Just aggregation of
per-region metrics at the per-table level for every regionserver. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message