hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aravindan Vijayan (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HDDS-1136) Add metric counters to capture the RocksDB checkpointing statistics.
Date Fri, 01 Mar 2019 21:05:00 GMT

    [ https://issues.apache.org/jira/browse/HDDS-1136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16782063#comment-16782063
] 

Aravindan Vijayan edited comment on HDDS-1136 at 3/1/19 9:04 PM:
-----------------------------------------------------------------

Added metric gauges for tracking DB checkpointing statistics. The OMMetrics class will hold
these gauge values at any instant. We dont store historic values for these metrics. These
can be pulled from OM by a sink (File sink, Prometheus sink, Recon etc).

*Testing done*
Integration test for Servlet method that gets the OM DB checkpoint added.
Manually verified the patch on single node Ozone cluster.
Github PR returned clean run. 


was (Author: avijayan):
Added metric gauges for tracking DB checkpointing statistics. The OMMetrics class will hold
these gauge values at any instant. We dont store historic values for these metrics. These
can be pulled from OM by a sink (File sink, Prometheus sink, Recon etc).

*Testing done*
Integration test for Servlet method that gets the OM DB checkpoint added.
Manually verified the patch on single node Ozone cluster.

> Add metric counters to capture the RocksDB checkpointing statistics.
> --------------------------------------------------------------------
>
>                 Key: HDDS-1136
>                 URL: https://issues.apache.org/jira/browse/HDDS-1136
>             Project: Hadoop Distributed Data Store
>          Issue Type: Sub-task
>            Reporter: Aravindan Vijayan
>            Assignee: Aravindan Vijayan
>            Priority: Major
>              Labels: pull-request-available
>         Attachments: HDDS-1136-000.patch
>
>          Time Spent: 1h 50m
>  Remaining Estimate: 0h
>
> As per the discussion with [~anu] on HDDS-1085, this JIRA tracks the effort to add metric
counters to capture ROcksDB checkpointing performance. 
> From [~anu]'s comments, it might be interesting to have 3 counters – or a map of counters.
> * How much time are we taking for each CheckPoint
> * How much time are we taking for each Tar operation – along with sizes
> * How much time are we taking for the transfer.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message