chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Yang (JIRA)" <>
Subject [jira] Updated: (CHUKWA-545) Add ability to stream Hadoop metrics through syslog appender
Date Sun, 07 Nov 2010 21:20:10 GMT


Eric Yang updated CHUKWA-545:

    Attachment: CHUKWA-545.patch

- Converted Log4jMetricsContext to use syslog appender.
- Modified HadoopMetricsProcessor to parse syslog message.

> Add ability to stream Hadoop metrics through syslog appender 
> -------------------------------------------------------------
>                 Key: CHUKWA-545
>                 URL:
>             Project: Chukwa
>          Issue Type: New Feature
>          Components: data collection
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>             Fix For: 0.5.0
>         Attachments: CHUKWA-545.patch
> Hadoop metrics is currently streaming through Chukwa's customized log4j appender to delegate
the registration of metrics file with Chukwa agent.  Both Chukwa agent and chukwa hadoop client
keeps track of list of registered adaptors.  It is error prone to have adaptor list tracked
in two different places.  In addition, the management of metrics files is also a problem.
 Hence, I propose to remove both limitation by using syslog appeender to send hadoop metrics
to Chukwa.  This approach eliminates the adaptor and file management problems.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message