flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sanne de Roever <sanne.de.roe...@gmail.com>
Subject Re: Yammer metrics
Date Fri, 08 Apr 2016 10:12:29 GMT
Thanks Chesnay.

Might I make a tentative case for Yammer? I'm not an expert, but I am
currently trying to pull together information on this and was reviewing
jmxtrans. This is all tentative, I've just dived in a few days ago. Please
find the information below.

Using Yammer it is possible to load an MBean that queries all metrics and
exports them en masse to a target destination, statsd or graphite for
example, but any destination will to. The gist is that the metrics do not
have to be queried one by one, and that the export can be arranged by
loading an extra jar.

An example of this setup can be seen at:
https://github.com/airbnb/kafka-statsd-metrics2

Put the MBean jar in the classpath, add a config file, and presto. This
would work for Kafka, and Cassandra, and I would not need a separate
JMXtrans server.




On Fri, Apr 8, 2016 at 11:01 AM, Chesnay Schepler <chesnay@apache.org>
wrote:

> Flink currently doesn't expose any metrics beyond those shown in the
> Dashboard.
>
> I am currently working on integrating a new metrics system that is partly
> *based* on Yammer/Codahale/Dropwizard metrics.
>
> For a first version it is planned to export metrics only via JMX as this
> effectively covers all use-cases with the help of JMXTrans and similar
> tools.
>
> Reporting to specific systems is something we want to add as well though.
>
> Regards,
> Chesnay Schepler
>
>
> On 08.04.2016 09:32, Sanne de Roever wrote:
>
> Hi,
>
> I´m looking into setting up monitoring for our (Flink) environment and
> realized that both Kafka and Cassandra use the yammer metrics library. This
> library enables the direct export of all metrics to Graphite (and possibly
> statsd). Does Flink use Yammer metrics?
>
> Cheers,
>
> Sanne
>
>
>

Mime
View raw message