beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anton Kedin (JIRA)" <>
Subject [jira] [Created] (BEAM-3360) [SQL] Do not assign triggers for HOP/TUMBLE
Date Fri, 15 Dec 2017 18:01:00 GMT
Anton Kedin created BEAM-3360:

             Summary: [SQL] Do not assign triggers for HOP/TUMBLE
                 Key: BEAM-3360
             Project: Beam
          Issue Type: Task
          Components: dsl-sql
            Reporter: Anton Kedin

Currently when parsing HOP/TUMBLE expressions we create a repeating trigger for the defined
windows, see:


  private Trigger createTriggerWithDelay(GregorianCalendar delayTime) {
    return Repeatedly.forever(AfterWatermark.pastEndOfWindow().withLateFirings(AfterProcessingTime

This will not work correctly with joins, as joins with multiple trigger firings are currently
broken: .

Even if joins with multiple firings worked correctly, SQL parsing stage is still probably
an incorrect place to infer them.

Better alternatives:
 - inherit the user-defined triggers for the input pcollection without modification;
 - triggering at sinks ( ) might define a way to backpropagate
triggers with correct semantics;

This message was sent by Atlassian JIRA

View raw message