beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Davor Bonaci (JIRA)" <j...@apache.org>
Subject [jira] [Created] (BEAM-22) DirectPipelineRunner: support for unbounded collections
Date Fri, 19 Feb 2016 01:01:31 GMT
Davor Bonaci created BEAM-22:
--------------------------------

             Summary: DirectPipelineRunner: support for unbounded collections
                 Key: BEAM-22
                 URL: https://issues.apache.org/jira/browse/BEAM-22
             Project: Beam
          Issue Type: Improvement
            Reporter: Davor Bonaci
            Assignee: Davor Bonaci


DirectPipelineRunner currently runs over bounded PCollections only, and implements only a
portion of the Beam Model.

We should improve it to faithfully implement the full Beam Model, such as add ability to run
over unbounded PCollections, and better resemble execution model in a distributed system.

This further enables features such as a testing source which may simulate late data and test
triggers in the pipeline.

Once this is done, we should update this StackOverflow question:
http://stackoverflow.com/questions/35350113/testing-triggers-with-processing-time/35401426#35401426



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message