falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ajay Yadav <ajayn...@gmail.com>
Subject Re: Consuming feed/process metrics generated by Falcon
Date Wed, 11 Mar 2015 10:54:50 GMT
Hi Adam,

Excellent suggestions, in fact we are actually thinking on same lines and I
am working on enabling SLA and alerts for both processes and feeds. SLA
tags are already added to feeds and processes but currently they are not
being consumed or passed to oozie. These features will not make to 0.6.1
release but will definitely be released as part of next release. Idea is to
have API which can be used by alerting tools and WEB UI.

For now the workaround would be using falcon's rest api and run a cron job
to do periodic checks for status/availability, it will be ugly/inefficient
but it definitely works. You can listen to ActiveMQ messages for now and it
should work but please follow FALCON-1031.

As for your suggestions, I am not sure how you intend to generate alerts
using metrics, as far as I know metrics only log certain server response
times like REST API and graph db. I am curious and would like to know if
you have any workaround using metrics.log We are actually planning to take
approach 2 (by leveraging oozie)(FALCON-722). I have created a JIRA for the
same so that you can track the progress (FALCON-1090)

On Wed, Mar 11, 2015 at 3:14 PM, Adam Kawa <kawa.adam@gmail.com> wrote:

> Hi,
> What tools do you use/recommends to consume feed+process metrics generated
> by Falcon and convert them into alerts/emails (e.g. when the process fails
> or doesn't meet its SLA)?
> Do you recommend to consume events from ActiveMQ or from
> the falcon.metric.log file?
> In case of ActiveMQ, do you recommend some clients or web consoles? I don't
> have much experience with ActiveMQ and this is why I ask for the best
> practices :)
> Thanks in advance!
> Adam
> PS. Do you think that it would be useful if:
> 1. Falcon displays the content of the falcon.metric.log file in the web UI
> and allows to search by entity type and name, status as described in
> https://issues.apache.org/jira/browse/FALCON-994. If you don't like this
> idea, do you use/know any cool ActiveMQ web console that displays the
> content of all Falcon-related topic in a nice way?
> 2. Add an additional tag in the process specification that lets you specify
> where an email should be sent when the process fails, succeeds or is late.
> This could leverage Ooozie for sending emails as Oozie already provides the
> email action.

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message