hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Babak Behzad (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-9704) Write metrics sink plugin for Hadoop/Graphite
Date Wed, 28 May 2014 16:47:03 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-9704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14011294#comment-14011294
] 

Babak Behzad commented on HADOOP-9704:
--------------------------------------

Thanks Ravi. So, in order to enable this one has to put the following three lines in etc/hadoop-metrics2.properties
for each of the contexts (namenode, datanode, resource manager, etc):
namenode.sink.graphite.server_host=localhost
namenode.sink.graphite.server_port=2003
namenode.sink.graphite.metrics_prefix=test.namenode

Looking at the logs and source code, the socket connection is only created once in the init()
function for each of these contexts that you enable them, so at most 5 new connections are
created. This is exactly the same as other sinks such as FileSink and GangliaSink and I don't
think it is an issue.

Regarding a slow Graphite server, that's a good point. We will be able to test this soon,
but again looking at the current Hadoop code, Ganglia's sink is using DatagramSocket instead
of Socket. I am not sure if we need to do that later if we see problems with the current code.

> Write metrics sink plugin for Hadoop/Graphite
> ---------------------------------------------
>
>                 Key: HADOOP-9704
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9704
>             Project: Hadoop Common
>          Issue Type: New Feature
>    Affects Versions: 2.0.3-alpha
>            Reporter: Chu Tong
>         Attachments: 0001-HADOOP-9704.-Write-metrics-sink-plugin-for-Hadoop-Gr.patch,
HADOOP-9704.patch, HADOOP-9704.patch, Hadoop-9704.patch
>
>
> Write a metrics sink plugin for Hadoop to send metrics directly to Graphite in additional
to the current ganglia and file ones.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message