ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AMBARI-8522) Enable Flume metrics sink to AMS
Date Fri, 05 Dec 2014 20:53:13 GMT

    [ https://issues.apache.org/jira/browse/AMBARI-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14236085#comment-14236085
] 

Hudson commented on AMBARI-8522:
--------------------------------

SUCCESS: Integrated in Ambari-trunk-Commit #1115 (See [https://builds.apache.org/job/Ambari-trunk-Commit/1115/])
AMBARI-8522. Enable Flume metrics sink to AMS. (Szilard Nemethy via mpapirkovskyy) (mpapyrkovskyy:
http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=b42150cad1fb21d777519e029154614072a5b219)
* ambari-metrics/ambari-metrics-flume-sink/src/test/org/apache/hadoop/metrics2/sink/flume/FlumeTimelineMetricsSinkTest.java
* ambari-metrics/ambari-metrics-hadoop-sink/src/main/java/org/apache/hadoop/metrics2/sink/timeline/HadoopTimelineMetricsSink.java
* ambari-metrics/ambari-metrics-hadoop-sink/src/main/java/org/apache/hadoop/metrics2/sink/timeline/TimelineMetricsSink.java
* ambari-metrics/ambari-metrics-common/pom.xml
* ambari-metrics/ambari-metrics-hadoop-sink/src/main/conf/hadoop-metrics2-hbase.properties.j2
* ambari-metrics/ambari-metrics-flume-sink/src/main/java/org/apache/hadoop/metrics2/sink/flume/FlumeTimelineMetricsSink.java
* ambari-metrics/ambari-metrics-flume-sink/src/main/conf/flume-metrics2.properties.j2
* ambari-metrics/pom.xml
* ambari-metrics/ambari-metrics-common/src/main/java/org/apache/hadoop/metrics2/sink/timeline/base/AbstractTimelineMetricsSink.java
* ambari-metrics/ambari-metrics-common/src/main/java/org/apache/hadoop/metrics2/sink/timeline/cache/TimelineMetricsCache.java
* ambari-metrics/ambari-metrics-common/src/main/java/org/apache/hadoop/metrics2/sink/timeline/TimelineMetrics.java
* ambari-metrics/ambari-metrics-common/src/main/java/org/apache/hadoop/metrics2/sink/timeline/configuration/Configuration.java
* ambari-metrics/ambari-metrics-common/src/main/java/org/apache/hadoop/metrics2/sink/timeline/TimelineMetric.java
* ambari-metrics/ambari-metrics-flume-sink/pom.xml
* ambari-metrics/ambari-metrics-hadoop-sink/src/main/java/org/apache/hadoop/metrics2/sink/timeline/TimelineMetrics.java
* ambari-metrics/ambari-metrics-hadoop-sink/src/main/java/org/apache/hadoop/metrics2/sink/timeline/AbstractTimelineMetricsSink.java
* ambari-metrics/ambari-metrics-flume-sink/src/main/assemblies/sink.xml
* ambari-metrics/ambari-metrics-hadoop-sink/pom.xml
* ambari-metrics/ambari-metrics-hadoop-sink/src/main/java/org/apache/hadoop/metrics2/sink/timeline/TimelineMetric.java
* ambari-metrics/ambari-metrics-hadoop-sink/src/main/java/org/apache/hadoop/metrics2/sink/timeline/TimelineMetricsCache.java
* ambari-metrics/ambari-metrics-timelineservice/pom.xml
* ambari-metrics/ambari-metrics-hadoop-sink/src/main/conf/hadoop-metrics2.properties.j2
* ambari-metrics/ambari-metrics-flume-sink/src/main/assemblies/empty.xml


> Enable Flume metrics sink to AMS
> --------------------------------
>
>                 Key: AMBARI-8522
>                 URL: https://issues.apache.org/jira/browse/AMBARI-8522
>             Project: Ambari
>          Issue Type: Improvement
>          Components: ambari-metrics
>    Affects Versions: 2.0.0
>            Reporter: Erik Bergenholtz
>            Assignee: Szilard Nemethy
>            Priority: Critical
>             Fix For: 2.0.0
>
>         Attachments: AMBARI-8522.patch
>
>
> Ambari Metrics needs to be able to collect metrics from Flume (https://github.com/apache/flume)
> -Create a TimelineMetricsSink class that implements MonitorService.
> Look at org.apache.flume.instrumentation.GangliaServer
> - Configure Flume if Ambari Metrics is deployed to use TimelineMetricsSink in its classpath
> http://flume.apache.org/FlumeUserGuide.html#custom-reporting
> - Look into how to support GET queries for FLUME agent, stacks/HDP/2.0.6/services/FLUME/metrics.json
> User is unaware of group name and Channel name for a given agent.
> *Key points*:
> - Store the appId = 'flume"
> - Allow for regex queries in GET API, example if flume metrics looks like: "agentName.groupName.channelName.MetricName",
user can query AMS API as (\\w)\+.(\\w)\+.(\\w)\+.metricName
> This transforms to a LIKE SQL clause which needs to be added to the timeline service
API
> http://phoenix.apache.org/language/index.html#expression



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message