nifi-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Joe Witt <joe.w...@gmail.com>
Subject Re: New NiFi Metric
Date Fri, 15 Mar 2019 15:46:08 GMT
Mark

Certainly sounds interesting and adding such a metric makes good sense.

On Fri, Mar 15, 2019 at 11:39 AM Owens, Mark <jmowens@evoforge.org> wrote:

> Hi,
>
> I'm looking to implement a new metric in NiFi based upon some research
> performed by an intern last summer. It would be a 'time-to-capacity'
> estimate that would predict capacity overloads in dataflows. The goal would
> be to predict estimated time to overload within data flows and provide
> means to alert interested parties prior to that overload failure. The
> initial method would involve sampling real-time information directly from
> NiFi and calculating the rate of input/output for data connections using a
> sliding window in time. A value would be calculated estimating the
> remaining time until capacity overload by assuming a constant input/output
> difference over the sampled timeframe. This value would be updated at
> regular intervals using the latest input/output information. This method
> could be refined and improved as needed in time.
>
>  I'm seeking comments on the level of difficulty you think this would
> entail, i.e., does it sound feasible? I'm also seeking a sense on how
> amenible the community would be to adding a new metric to NiFi and having
> it added to the stats page. Suggestions as to good portions of code where
> existing metric calculations are made and presented would be helpful as
> well.
>
> Thanks,
> Mark
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message