flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Keith Wiggins <keith.wigg...@genband.com>
Subject RE: How to monitor flume agents
Date Thu, 19 Nov 2015 14:35:33 GMT
Hi,

You can set up ‘http’ monitoring when you start your process to get the metrics of your
Flume.

Example;

-Dflume.monitoring.type=http -Dflume.monitoring.port=34545

Then you can connect a browser to your IP and port.  I use Firefox to do that as the output
is JSON.  You just need to refresh your browser.  Not sure if that’s what you are looking
for.

Example;
{"CHANNEL.fileChannel":{"EventPutSuccessCount":"56665000","ChannelFillPercentage":"0.0","Type":"CHANNEL","StopTime":"0","EventPutAttemptCount":"56665000","ChannelSize":"0","StartTime":"1447855497117","EventTakeSuccessCount":"56665000","ChannelCapacity":"1000000","EventTakeAttemptCount":"56719994"},"SOURCE.LSMetrics":{"OpenConnectionCount":"1","Type":"SOURCE","AppendBatchAcceptedCount":"566650","AppendBatchReceivedCount":"566650","EventAcceptedCount":"56665000","AppendReceivedCount":"0","StopTime":"0","StartTime":"1447855497515","EventReceivedCount":"56665000","AppendAcceptedCount":"0"}}

Keith

From: Gonzalo Herreros [mailto:gherreros@gmail.com]
Sent: Thursday, November 19, 2015 4:25 AM
To: user
Subject: Re: How to monitor flume agents

Using a distribution like Cloudera or Hortonworks. They both have free versions.
Alternatively you can use standard linux process monitoring tools.

Regards,
Gonzalo

On 19 November 2015 at 09:11, Zhishan Li <zhishanlee@gmail.com<mailto:zhishanlee@gmail.com>>
wrote:


Is there a way to  simply and conveniently monitor flume agents?

Currently, I check the flume’s log on each flume node everyday.


Thanks,


Mime
View raw message