Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Date: Fri, 17 Nov 2017 14:52:00 +0000 (UTC)
From: "Elek, Marton (JIRA)" <jira@apache.org>
To: hdfs-issues@hadoop.apache.org
Message-ID: <JIRA.13118061.1510606102000.267231.1510930320351@Atlassian.JIRA>
In-Reply-To: <JIRA.13118061.1510606102000@Atlassian.JIRA>
References: <JIRA.13118061.1510606102000@Atlassian.JIRA> <JIRA.13118061.1510606102679@jira-lw-us.apache.org>
Subject: [jira] [Comment Edited] (HDFS-12807) Ozone: Expose RockDB stats via
 JMX for Ozone metadata stores
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Fri, 17 Nov 2017 14:52:04 -0000


    [ https://issues.apache.org/jira/browse/HDFS-12807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16257069#comment-16257069 ] 

Elek, Marton edited comment on HDFS-12807 at 11/17/17 2:51 PM:
---------------------------------------------------------------

This patch expose the rocksdb statistical information on JMX with the helping of a dynamic JMX bean. The level of the required information could be configured. 

The biggest change is the bump of the rocksdb version from 5.5.5 to 5.8.0. In rocksdb 5.5.5 there is no method to adjust the statistics level (in fact there is the method in the native interface but it's not exposed to the java level, so we can't set to measure everything.) 

To test:
Start a full ozone cluster and check /jmx endpoint on scm/ksm ui. There should be a rocksdb metrics bean.


was (Author: elek):
This patch expose the rocksdb statistical information on JMX with the helping of a dynamic JMX bean. The level of the required information could be configured. 

The biggest change is the bump of the rocksdb version from 5.5.5 to 5.8.0. In rocksdb 5.5.5 there is method to adjust the statistics level (in fact there is the method in the native interface but it's not exposed to the java level, so we can't set to measure everything.) 

To test:
Start a full ozone cluster and check /jmx endpoint on scm/ksm ui. There should be a rocksdb metrics bean.


> Ozone: Expose RockDB stats via JMX for Ozone metadata stores
> ------------------------------------------------------------
>
>                 Key: HDFS-12807
>                 URL: https://issues.apache.org/jira/browse/HDFS-12807
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Xiaoyu Yao
>            Assignee: Elek, Marton
>         Attachments: HDFS-12807-HDFS-7240.001.patch
>
>
> RocksDB JNI has an option to expose stats, this can be further exposed to graphs and monitoring applications. We should expose them to our Rocks metadata store implementation for troubleshooting metadata related performance issues.


--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org