edgent-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dale LaBossiere (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (EDGENT-230) Add timer triggered window aggregations
Date Thu, 02 Mar 2017 15:14:46 GMT

     [ https://issues.apache.org/jira/browse/EDGENT-230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Dale LaBossiere updated EDGENT-230:
    Component/s: API

> Add timer triggered window aggregations
> ---------------------------------------
>                 Key: EDGENT-230
>                 URL: https://issues.apache.org/jira/browse/EDGENT-230
>             Project: Edgent
>          Issue Type: New Feature
>          Components: API
>            Reporter: Dale LaBossiere
>            Assignee: Dale LaBossiere
> A recent use case involved the desire for "timer triggered" instead of "partition content
change triggered" window aggregations.  E.g., "I want to trigger an aggregation every second
over the last 10 tuples in a window partition" -- a count-based window with timer triggered
> I propose adding 3 methods to TWindow.  Two in direct support of "timer triggered" aggregations
(this processing model seems like it could be common enough to warrant making it conveniently
available) and one to make it easier to use the lower level Window API to define and use other
processing models.
> I'm submitting a PR with the details for review but the net is these additions to TWindow:
> ```
>     <U> TStream<U> timedAggregate(long period, TimeUnit unit, BiFunction<List<T>,
K, U> aggregator);
>     <U> TStream<U> timedBatch(long period, TimeUnit unit, BiFunction<List<T>,
K, U> batcher);
>     <U, L extends List<T>> TStream<U> process(Window<T,K,L> window,
BiFunction<List<T>, K, U> aggregator);
> ```
> See https://github.com/apache/incubator-quarks/pull/167

This message was sent by Atlassian JIRA

View raw message