nifi-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NIFI-987) Add Processor for Writing Events to Riemann
Date Wed, 21 Oct 2015 12:18:27 GMT

    [ https://issues.apache.org/jira/browse/NIFI-987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14966725#comment-14966725
] 

ASF GitHub Bot commented on NIFI-987:
-------------------------------------

Github user rickysaltzer commented on the pull request:

    https://github.com/apache/nifi/pull/91#issuecomment-149875162
  
    @busbey good question. I envision that we can later extend the Riemann bundle to allow
internal NiFi reporting to Riemann, similar to how Ambari was recently added. For now, there
are plenty of situations where it would be useful to allow reporting of a flowfile's existence
and/or attributes to Riemann for basic data flow reporting and monitoring. 
    
    Let me give you a few examples:
    
    * Send a notification to Riemann for each flowfile passed through a specific processor.
 This not only allows for monitoring, but also alerting if desired. 
    * Each node in the NiFi cluster can periodically send a message with a TTL that if expires
would indicate that the node in the cluster is no longer running. 
    * Immediate alerting when specific data flow scenarios are met (e.g. failed to extract
archive, failed to hit an API). 
    * To extend on what @trkurc said, you could very easily report metrics from files if desired.
Or - you could use the ExecuteProcess to collect metrics using arbitrary commands. 
    
    I'm sure there are other use cases that can be applied. 



> Add Processor for Writing Events to Riemann
> -------------------------------------------
>
>                 Key: NIFI-987
>                 URL: https://issues.apache.org/jira/browse/NIFI-987
>             Project: Apache NiFi
>          Issue Type: New Feature
>            Reporter: Ricky Saltzer
>            Assignee: Ricky Saltzer
>         Attachments: Sample Riemann Dataflow .png
>
>
> Riemann (http://riemann.io) is a new framework for monitoring distributed systems. It's
particular useful for sending ad-hoc events such as, heartbeats and metrics. It would be nice
if NiFi had a PutRiemann processor for writing events using the NiFi expression language.
> A simple use case would be a data flow that repeatedly checks specific services over
TCP, HTTP, etc and checks into Riemann. Another example would be detecting a blip in events
coming down a stream using a simple event heartbeat mechanism. I'll post a couple visuals
to help make these examples more concrete.
> I have an initial PutRiemann processor made. I will post the patch via a Github pull
request later today.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message