beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jingsong Lee (JIRA)" <>
Subject [jira] [Created] (BEAM-1589) Add OnWindowExpiration method to Stateful DoFn
Date Thu, 02 Mar 2017 03:38:45 GMT
Jingsong Lee created BEAM-1589:

             Summary: Add OnWindowExpiration method to Stateful DoFn
                 Key: BEAM-1589
             Project: Beam
          Issue Type: New Feature
          Components: runner-core, sdk-java-core
            Reporter: Jingsong Lee

See BEAM-1517
This allows the user to do some work before the state's garbage collection.
It seems kind of annoying, but on the other hand forgetting to set a final timer to flush
state is probably data loss most of the time.
FlinkRunner does this work very simply, but other runners, such as DirectRunner, need to traverse
all the states to do this, and maybe it's a little hard.

This message was sent by Atlassian JIRA

View raw message