apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Siyuan Hua <siy...@datatorrent.com>
Subject Re: Operator Utility To Convert Time Into Number Of Windows
Date Mon, 14 Dec 2015 16:50:19 GMT
Hey Tim,

+1

Please add me to watcher list to the ticket for this. The highlevel API may
need this work.
For example, stream.window(TimeUnit.SECOND, 10) etc.

Thanks!

On Sat, Dec 12, 2015 at 5:36 PM, Timothy Farkas <tim@datatorrent.com> wrote:

> will do
>
> On Sat, Dec 12, 2015 at 4:36 PM, Chandni Singh <chandni@datatorrent.com>
> wrote:
>
> > Hey Tim,
> >
> > There is a util package under library. Can this be put under
> util/windows ?
> >
> > Chandni
> >
> > On Fri, Dec 11, 2015 at 5:50 PM, Amol Kekre <amol@datatorrent.com>
> wrote:
> >
> > > Good idea.
> > >
> > > Thks
> > > Amol
> > >
> > > On Fri, Dec 11, 2015 at 4:13 PM, Timothy Farkas <tim@datatorrent.com>
> > > wrote:
> > >
> > > > I'd like to propose creating an operator utility in
> > > > com.datatorrent.lib.operatorutils to convert time into number of
> > windows
> > > > and tuples / second into tuples / window. The way in which this
> > currently
> > > > can be specified is through a property like operationWindowCount or
> > > > tuplesPerWindow. This works but I've observed that this can lead to
> > > > confusion. The confusion comes from the fact that the people who
> > develop
> > > > apps are not necessarily the ones who test deployment configurations
> > and
> > > > manage the apps, so they think in time not application windows. Also
> > the
> > > > default application window count and streaming window size is not
> > common
> > > > knowledge, so it's not easy to compute the conversion from windows to
> > > time.
> > > > This small utility method could be reused across operators.
> > > >
> > > > Any feedback?
> > > >
> > > > Thanks,
> > > > Tim
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message