hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Babak Behzad (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-9704) Write metrics sink plugin for Hadoop/Graphite
Date Wed, 28 May 2014 16:47:03 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-9704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14011294#comment-14011294

Babak Behzad commented on HADOOP-9704:

Thanks Ravi. So, in order to enable this one has to put the following three lines in etc/hadoop-metrics2.properties
for each of the contexts (namenode, datanode, resource manager, etc):

Looking at the logs and source code, the socket connection is only created once in the init()
function for each of these contexts that you enable them, so at most 5 new connections are
created. This is exactly the same as other sinks such as FileSink and GangliaSink and I don't
think it is an issue.

Regarding a slow Graphite server, that's a good point. We will be able to test this soon,
but again looking at the current Hadoop code, Ganglia's sink is using DatagramSocket instead
of Socket. I am not sure if we need to do that later if we see problems with the current code.

> Write metrics sink plugin for Hadoop/Graphite
> ---------------------------------------------
>                 Key: HADOOP-9704
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9704
>             Project: Hadoop Common
>          Issue Type: New Feature
>    Affects Versions: 2.0.3-alpha
>            Reporter: Chu Tong
>         Attachments: 0001-HADOOP-9704.-Write-metrics-sink-plugin-for-Hadoop-Gr.patch,
HADOOP-9704.patch, HADOOP-9704.patch, Hadoop-9704.patch
> Write a metrics sink plugin for Hadoop to send metrics directly to Graphite in additional
to the current ganglia and file ones.

This message was sent by Atlassian JIRA

View raw message