hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Yang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-7436) Bundle Chukwa Metrics plugin in Hadoop
Date Thu, 30 Jun 2011 22:21:28 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-7436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13058105#comment-13058105
] 

Eric Yang commented on HADOOP-7436:
-----------------------------------

Chukwa uses a simple mechanism, serialize metrics to JSON string, and stream JSON string to
external system using Log4J socket appender.  Chukwa metrics plugin is in fact generic.  Hadoop
currently has FileSink plugin to demo how to interface with Metrics 2 framework.  It would
be useful to have a generic Metrics 2 plugin that can stream metrics to any monitoring system
that implements Log4J socket appender server.  Hence, this should not generate unmaintained
legacy code but a good interface for external monitoring systems.  If I rename this plugin
as Log4J Socket Metrics plugin, would this be a reasonable plugin to have in Hadoop?

> Bundle Chukwa Metrics plugin in Hadoop
> --------------------------------------
>
>                 Key: HADOOP-7436
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7436
>             Project: Hadoop Common
>          Issue Type: New Feature
>         Environment: Java 6
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>
> For monitoring hadoop cluster with Chukwa, the current step is to copy chukwa-hadoop-*-client.jar
and json-simple to hadoop classpath. (i.e. $HADOOP_HOME/lib or $HADOOP_PREFIX/share/hadoop/lib),
and modify the hadoop-metrics.properties to use org.apache.hadoop.chukwa.inputtools.log4j.Log4JMetricsContext
for emitting metrics.  It is preferred to reduce the number of manual steps that is required
to enable chukwa monitored hadoop cluster by moving the plugin code into hadoop code base.
 It is similar to bundling Ganglia metrics plugin in Hadoop code base.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message