phoenix-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Elser (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PHOENIX-4042) Add hadoop-metrics2 server level metrics for secondary indexes
Date Wed, 19 Jul 2017 21:03:00 GMT

    [ https://issues.apache.org/jira/browse/PHOENIX-4042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16093775#comment-16093775
] 

Josh Elser commented on PHOENIX-4042:
-------------------------------------

{noformat}
{
    "name" : "Hadoop:service=HBase,name=RegionServer,sub=PhoenixIndexer",
    "modelerType" : "RegionServer,sub=PhoenixIndexer",
    "tag.Context" : "phoenix",
    "tag.Hostname" : "hw10447.local",
    "IndexPrepareTime_num_ops" : 4,
    "IndexPrepareTime_min" : 1,
    "IndexPrepareTime_max" : 56,
    "IndexPrepareTime_mean" : 28,
    "IndexPrepareTime_25th_percentile" : 1,
    "IndexPrepareTime_median" : 2,
    "IndexPrepareTime_75th_percentile" : 55,
    "IndexPrepareTime_90th_percentile" : 56,
    "IndexPrepareTime_95th_percentile" : 56,
    "IndexPrepareTime_98th_percentile" : 56,
    "IndexPrepareTime_99th_percentile" : 56,
    "IndexPrepareTime_99.9th_percentile" : 56,
    "DuplicateKeyCheckTime_num_ops" : 0,
    "DuplicateKeyCheckTime_min" : 0,
    "DuplicateKeyCheckTime_max" : 0,
    "DuplicateKeyCheckTime_mean" : 0,
    "DuplicateKeyCheckTime_25th_percentile" : 0,
    "DuplicateKeyCheckTime_median" : 0,
    "DuplicateKeyCheckTime_75th_percentile" : 0,
    "DuplicateKeyCheckTime_90th_percentile" : 0,
    "DuplicateKeyCheckTime_95th_percentile" : 0,
    "DuplicateKeyCheckTime_98th_percentile" : 0,
    "DuplicateKeyCheckTime_99th_percentile" : 0,
    "DuplicateKeyCheckTime_99.9th_percentile" : 0,
    "PostPutTime_num_ops" : 0,
    "PostPutTime_min" : 0,
    "PostPutTime_max" : 0,
    "PostPutTime_mean" : 0,
    "PostPutTime_25th_percentile" : 0,
    "PostPutTime_median" : 0,
    "PostPutTime_75th_percentile" : 0,
    "PostPutTime_90th_percentile" : 0,
    "PostPutTime_95th_percentile" : 0,
    "PostPutTime_98th_percentile" : 0,
    "PostPutTime_99th_percentile" : 0,
    "PostPutTime_99.9th_percentile" : 0,
    "slowPreWALRestoreCalls" : 0,
    "PreWALRestoreTime_num_ops" : 0,
    "PreWALRestoreTime_min" : 0,
    "PreWALRestoreTime_max" : 0,
    "PreWALRestoreTime_mean" : 0,
    "PreWALRestoreTime_25th_percentile" : 0,
    "PreWALRestoreTime_median" : 0,
    "PreWALRestoreTime_75th_percentile" : 0,
    "PreWALRestoreTime_90th_percentile" : 0,
    "PreWALRestoreTime_95th_percentile" : 0,
    "PreWALRestoreTime_98th_percentile" : 0,
    "PreWALRestoreTime_99th_percentile" : 0,
    "PreWALRestoreTime_99.9th_percentile" : 0,
    "slowPostOpenCalls" : 0,
    "slowIndexWriteCalls" : 0,
    "slowPostDeleteCalls" : 0,
    "IndexWriteTime_num_ops" : 4,
    "IndexWriteTime_min" : 4,
    "IndexWriteTime_max" : 13,
    "IndexWriteTime_mean" : 8,
    "IndexWriteTime_25th_percentile" : 5,
    "IndexWriteTime_median" : 6,
    "IndexWriteTime_75th_percentile" : 13,
    "IndexWriteTime_90th_percentile" : 13,
    "IndexWriteTime_95th_percentile" : 13,
    "IndexWriteTime_98th_percentile" : 13,
    "IndexWriteTime_99th_percentile" : 13,
    "IndexWriteTime_99.9th_percentile" : 13,
    "slowPostPutCalls" : 0,
    "PostDeleteTime_num_ops" : 0,
    "PostDeleteTime_min" : 0,
    "PostDeleteTime_max" : 0,
    "PostDeleteTime_mean" : 0,
    "PostDeleteTime_25th_percentile" : 0,
    "PostDeleteTime_median" : 0,
    "PostDeleteTime_75th_percentile" : 0,
    "PostDeleteTime_90th_percentile" : 0,
    "PostDeleteTime_95th_percentile" : 0,
    "PostDeleteTime_98th_percentile" : 0,
    "PostDeleteTime_99th_percentile" : 0,
    "PostDeleteTime_99.9th_percentile" : 0,
    "slowIndexPrepareCalls" : 0,
    "slowDuplicateKeyCheckCalls" : 0,
    "PostOpenTime_num_ops" : 4,
    "PostOpenTime_min" : 0,
    "PostOpenTime_max" : 0,
    "PostOpenTime_mean" : 0,
    "PostOpenTime_25th_percentile" : 0,
    "PostOpenTime_median" : 0,
    "PostOpenTime_75th_percentile" : 0,
    "PostOpenTime_90th_percentile" : 0,
    "PostOpenTime_95th_percentile" : 0,
    "PostOpenTime_98th_percentile" : 0,
    "PostOpenTime_99th_percentile" : 0,
    "PostOpenTime_99.9th_percentile" : 0
  }
{noformat}

Here's the output from a few index updates locally. Tried to keep the consistent naming from
Vincent's patch on PHOENIX-3807.

> Add hadoop-metrics2 server level metrics for secondary indexes
> --------------------------------------------------------------
>
>                 Key: PHOENIX-4042
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-4042
>             Project: Phoenix
>          Issue Type: Improvement
>            Reporter: Josh Elser
>            Assignee: Josh Elser
>             Fix For: 4.12.0
>
>
> PHOENIX-3807 has a patch which uses the new hbase-metrics API for capturing Phoenix 2ndary
indexing metrics inside of the RS.
> However, the hbase-metrics API doesn't show up until HBase-1.4. Let's put together an
implementation that works with hadoop metrics2 to hold us over until that point.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message