Mailing-List: contact dev-help@ambari.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@ambari.apache.org
Date: Mon, 12 Oct 2015 17:18:06 +0000 (UTC)
From: "Hudson (JIRA)" <jira@apache.org>
To: dev@ambari.apache.org
Message-ID: <JIRA.12902948.1444212329000.15127.1444670286109@Atlassian.JIRA>
In-Reply-To: <JIRA.12902948.1444212329000@Atlassian.JIRA>
References: <JIRA.12902948.1444212329000@Atlassian.JIRA>
 <JIRA.12902948.1444212329774@arcas>
Subject: [jira] [Commented] (AMBARI-13336) Flume agent specific metrics not
 showing up as graphs
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/AMBARI-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14953420#comment-14953420 ] 

Hudson commented on AMBARI-13336:
---------------------------------

ABORTED: Integrated in Ambari-branch-2.1 #669 (See [https://builds.apache.org/job/Ambari-branch-2.1/669/])
AMBARI-13336 Flume agent specific metrics not showing up as graphs (dsen: [http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=c68074f78bf5e37520c21fe806d149d0a2e2ca4d])
* ambari-metrics/ambari-metrics-flume-sink/src/main/java/org/apache/hadoop/metrics2/sink/flume/FlumeTimelineMetricsSink.java
* ambari-metrics/ambari-metrics-flume-sink/src/test/java/org/apache/hadoop/metrics2/sink/flume/FlumeTimelineMetricsSinkTest.java
* ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/timeline/AMSPropertyProvider.java
* ambari-server/src/main/java/org/apache/ambari/server/controller/internal/AbstractPropertyProvider.java
* ambari-server/src/main/resources/common-services/FLUME/1.4.0.2.0/metrics.json
* ambari-metrics/ambari-metrics-common/src/main/java/org/apache/hadoop/metrics2/sink/timeline/cache/TimelineMetricsCache.java


> Flume agent specific metrics not showing up as graphs
> -----------------------------------------------------
>
>                 Key: AMBARI-13336
>                 URL: https://issues.apache.org/jira/browse/AMBARI-13336
>             Project: Ambari
>          Issue Type: Bug
>          Components: ambari-metrics, ambari-server
>    Affects Versions: 2.1.2
>            Reporter: Dmytro Sen
>            Assignee: Dmytro Sen
>            Priority: Critical
>             Fix For: 2.1.3
>
>         Attachments: AMBARI-13336_13.patch
>
>
> After creating a Flume agent with below configuration, I selected the host in the agents table of Flume service summary page. I was expecting graphs of metrics to show up for that host, but I dont see any graphs.
> {noformat}
> # Name the components on this agent
> a1.sources = r1
> a1.sinks = k1
> a1.channels = c1
> #
> # # Describe/configure the source
> a1.sources.r1.type = netcat
> a1.sources.r1.bind = localhost
> a1.sources.r1.port = 44444
> #
> # # Describe the sink
> #a1.sinks.k1.type = logger
> a1.sinks.k1.type = hdfs
> a1.sinks.k1.hdfs.path = /tmp/events_a1_%y-%m-%d/%H%M/%S
> a1.sinks.k1.hdfs.filePrefix = events-
> a1.sinks.k1.hdfs.round = true
> a1.sinks.k1.hdfs.roundValue = 1
> a1.sinks.k1.hdfs.roundUnit = minute
> a1.sinks.k1.hdfs.useLocalTimeStamp = true
> #
> # # Use a channel which buffers events in memory
> a1.channels.c1.type = memory
> a1.channels.c1.capacity = 1000
> a1.channels.c1.transactionCapacity = 100
> #
> # # Bind the source and sink to the channel
> a1.sources.r1.channels = c1
> a1.sinks.k1.channel = c1
> {noformat}
> The reason graphs are not getting created is the below GET call which should return (from Ambari-1.7.0)
> {code}
> {
>   "href" : "http://gs170-1:8080/api/v1/clusters/c1/hosts/gs170-3/host_components/FLUME_HANDLER?fields=metrics/flume/flume/CHANNEL/*&_=1443160542629",
>   "HostRoles" : {
>     "cluster_name" : "c1",
>     "component_name" : "FLUME_HANDLER",
>     "host_name" : "gs170-3"
>   },
>   "host" : {
>     "href" : "http://gs170-1:8080/api/v1/clusters/c1/hosts/gs170-3"
>   },
>   "metrics" : {
>     "flume" : {
>       "flume" : {
>         "CHANNEL" : {
>           "c1" : {
>             "ChannelCapacity" : 1000.0,
>             "ChannelFillPercentage" : 0.0,
>             "ChannelSize" : 0.0,
>             "EventPutAttemptCount" : 0.0,
>             "EventPutSuccessCount" : 0.0,
>             "EventTakeAttemptCount" : 99.0,
>             "EventTakeSuccessCount" : 0.0,
>             "StartTime" : 1.4431597139E12,
>             "StopTime" : 0.0
>           }
>         }
>       }
>     }
>   }
> }
> {code}
> but instead returns without the channel name:
> {code}
> {
>   "href" : "http://c6401:8080/api/v1/clusters/c1/hosts/c6402.ambari.apache.org/host_components/FLUME_HANDLER?fields=metrics/flume/flume/CHANNEL/*&_=1443161204742",
>   "HostRoles" : {
>     "cluster_name" : "c1",
>     "component_name" : "FLUME_HANDLER",
>     "host_name" : "c6402.ambari.apache.org"
>   },
>   "host" : {
>     "href" : "http://c6401:8080/api/v1/clusters/c1/hosts/c6402.ambari.apache.org"
>   },
>   "metrics" : {
>     "flume" : {
>       "flume" : {
>         "CHANNEL" : {
>           "ChannelCapacity" : 1000.0,
>           "ChannelFillPercentage" : 0.0,
>           "ChannelSize" : 0.0,
>           "EventPutAttemptCount" : 0.0,
>           "EventPutSuccessCount" : 0.0,
>           "EventTakeAttemptCount" : 8.0,
>           "EventTakeSuccessCount" : 0.0,
>           "StartTime" : 1.443127087019E12,
>           "StopTime" : 0.0
>         }
>       }
>     }
>   }
> }
> {code}
> Due to this reason no metric graphs are created and the sections are empty.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)