hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-10949) Write metrics2 sink plugin for Apache Kafka -- KafkaSink
Date Tue, 01 Sep 2015 19:27:46 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-10949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725921#comment-14725921
] 

Steve Loughran commented on HADOOP-10949:
-----------------------------------------

-1 to adding kafka on the hadoop-common classpath; too many people will hate us.

that means it either goes into a (new) {{hadoop-tools/hadoop-sinks}} or {{hadoop-tools/hadoop-kafka}};
with the latter allowing us to add more kafka features (logging, ...)

Personally, I'd prefer a hadoop-kafka one

Code-wise, I think the obvious thing to me is that you can/should use SLF4J instead of commons-logging;
you get to avoid all the if-clauses around logs and have the strings built for you


> Write metrics2 sink plugin for Apache Kafka -- KafkaSink
> --------------------------------------------------------
>
>                 Key: HADOOP-10949
>                 URL: https://issues.apache.org/jira/browse/HADOOP-10949
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: metrics
>            Reporter: Babak Behzad
>            Assignee: Babak Behzad
>         Attachments: HADOOP-10949-1.patch, HADOOP-10949-2.patch, HADOOP-10949-4.patch,
HADOOP-10949.patch, HADOOP-10949.patch, HADOOP-10949.patch, HADOOP-10949.patch, HADOOP-10949.patch,
HADOOP-10949.patch, HADOOP-10949.patch, HADOOP-10949.patch, HADOOP-10949.patch, HADOOP-10949.patch,
HADOOP-10949.patch
>
>
> Write a metrics2 sink plugin for Hadoop to send metrics directly to Apache Kafka in addition
to the current, Graphite ([Hadoop-9704|https://issues.apache.org/jira/browse/HADOOP-9704]),
Ganglia and File sinks.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message