hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Szehon Ho (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-10761) Create codahale-based metrics system for Hive
Date Tue, 19 May 2015 23:16:00 GMT
Szehon Ho created HIVE-10761:
--------------------------------

             Summary: Create codahale-based metrics system for Hive
                 Key: HIVE-10761
                 URL: https://issues.apache.org/jira/browse/HIVE-10761
             Project: Hive
          Issue Type: New Feature
            Reporter: Szehon Ho


There is a current Hive metrics system that hooks up to a JMX reporting, but all its measurements,
models are custom.

This is to make another metrics system that will be based on Codahale (ie yammer, dropwizard),
which has the following advantage:

* Well-defined metric model for frequently-needed metrics (ie JVM metrics)
* Well-defined measurements for all metrics (ie max, mean, stddev, mean_rate, etc), 
* Built-in reporting frameworks like JMX, Console, Log, JSON webserver

It is used for many projects, including several Apache projects like Oozie.  Overall, monitoring
tools should find it easier to understand these common metric, measurement, reporting models.

As part of this change, Hive's JVMPauseMonitor (that was using Hadoop's private one) is now
hooked into the new metric framework to give pause time counts.

The existing metric subsystem will be kept and can be enabled if backward compatibility is
desired.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message