beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Bradshaw (JIRA)" <j...@apache.org>
Subject [jira] [Created] (BEAM-1002) Enable caching of side-input dependent computations
Date Thu, 17 Nov 2016 18:08:59 GMT
Robert Bradshaw created BEAM-1002:
-------------------------------------

             Summary: Enable caching of side-input dependent computations
                 Key: BEAM-1002
                 URL: https://issues.apache.org/jira/browse/BEAM-1002
             Project: Beam
          Issue Type: New Feature
          Components: beam-model
            Reporter: Robert Bradshaw
            Assignee: Frances Perry


Sometimes the kind of computations one wants to perform in startBundle depend on side inputs
(and, implicitly, the window). For example, one might want to initialize a (non-serializable)
stateful object. In particular, this leads to users incorrectly (in the case of triggered
or non-globally-windowed side inputs) memoizing this computation in the first processElement
call. 

One option would be to fold this into a customizable ViewFn. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message