hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Elek, Marton (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HDFS-12807) Ozone: Expose RockDB stats via JMX for Ozone metadata stores
Date Fri, 17 Nov 2017 14:52:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-12807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16257069#comment-16257069
] 

Elek, Marton edited comment on HDFS-12807 at 11/17/17 2:51 PM:
---------------------------------------------------------------

This patch expose the rocksdb statistical information on JMX with the helping of a dynamic
JMX bean. The level of the required information could be configured. 

The biggest change is the bump of the rocksdb version from 5.5.5 to 5.8.0. In rocksdb 5.5.5
there is no method to adjust the statistics level (in fact there is the method in the native
interface but it's not exposed to the java level, so we can't set to measure everything.)


To test:
Start a full ozone cluster and check /jmx endpoint on scm/ksm ui. There should be a rocksdb
metrics bean.



was (Author: elek):
This patch expose the rocksdb statistical information on JMX with the helping of a dynamic
JMX bean. The level of the required information could be configured. 

The biggest change is the bump of the rocksdb version from 5.5.5 to 5.8.0. In rocksdb 5.5.5
there is method to adjust the statistics level (in fact there is the method in the native
interface but it's not exposed to the java level, so we can't set to measure everything.)


To test:
Start a full ozone cluster and check /jmx endpoint on scm/ksm ui. There should be a rocksdb
metrics bean.


> Ozone: Expose RockDB stats via JMX for Ozone metadata stores
> ------------------------------------------------------------
>
>                 Key: HDFS-12807
>                 URL: https://issues.apache.org/jira/browse/HDFS-12807
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Xiaoyu Yao
>            Assignee: Elek, Marton
>         Attachments: HDFS-12807-HDFS-7240.001.patch
>
>
> RocksDB JNI has an option to expose stats, this can be further exposed to graphs and
monitoring applications. We should expose them to our Rocks metadata store implementation
for troubleshooting metadata related performance issues.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message